00010000:00010000:1.0:1789518300.822836:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782a8c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf0 expref: 38 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.822867:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782a93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf0 expref: 37 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.822877:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:1.0:1789518300.822880:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518300.822884:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44e00, rc 0) 00000100:00100000:1.0:1789518300.822953:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+37:17459:x1876445617077888:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 402us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518300.822961:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:1.0:1789518300.826212:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617078144 00000100:00100000:1.0:1789518300.826223:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617078144 00000100:00100000:1.0:1789518300.826320:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:1.0:1789518300.826333:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+37:17459:x1876445617078144:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518300.826442:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782a9a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.826459:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782a9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.826469:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782a9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518300.826973:0:18928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1789518300.826983:0:18928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354823368613ns, next at 355823366443ns, rc = 0 00000004:00010000:1.0:1789518300.827077:0:18928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055b7584e reply state 00000000d6547434 transno 12884901920 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782a9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518300.827102:0:18928:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518300.827208:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+39:17459:x1876445617078144:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 877us (1158us total) trans 12884901920 rc 0/0 00000100:00100000:1.0:1789518300.827216:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:1.0:1789518300.829445:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617078272 00000100:00100000:1.0:1789518300.829455:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617078272 00000100:00100000:1.0:1789518300.829513:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1789518300.829524:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+38:17459:x1876445617078272:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518300.829551:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518300.829570:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782aa1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcdf7 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.829682:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782aa1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf7 expref: 39 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.829699:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782aa1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf7 expref: 39 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.829721:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:1.0:1789518300.829723:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518300.829726:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45400, rc 0) 00000100:00100000:1.0:1789518300.829788:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+39:17459:x1876445617078272:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 265us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518300.829796:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1789518300.843060:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518300.851216:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518300.861312:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518300.864760:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617079936 00000100:00100000:1.0:1789518300.864772:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617079936 00000100:00100000:1.0:1789518300.864844:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:1.0:1789518300.864856:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+41:17459:x1876445617079936:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789518300.904504:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518300.904519:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627528320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789518300.904572:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518300.907504:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518300.950125:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617080320 00000100:00100000:1.0:1789518300.950134:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617080320 00000100:00100000:1.0:1789518300.950202:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:1.0:1789518300.950213:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+13:17459:x1876445617080320:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518300.950261:0:18928:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518300.950285:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c782aaf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdfe expref: 13 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.950315:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:1.0:1789518300.950320:0:18928:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518300.950347:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ac4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.950360:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ac4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.950370:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ac4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518300.950551:0:18928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092a52990 reply state 00000000776b8334 transno 12884901922 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ac4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518300.950568:0:18928:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518300.950693:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+14:17459:x1876445617080320:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 481us (760us total) trans 12884901922 rc 0/0 00000100:00100000:1.0:1789518300.950700:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:1.0:1789518300.966927:0:19931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617080960 00000100:00100000:1.0:1789518300.966937:0:19931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617080960 00000100:00100000:1.0:1789518300.966997:0:19931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518300.967008:0:19931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2342:x1876445617080960:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789518300.967107:0:19931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.967127:0:19931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c782abd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce0c expref: 7 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.967136:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518300.967141:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518300.967146:0:19931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.967180:0:19931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c782abd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce0c expref: 7 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.967208:0:19931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c782abd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce0c expref: 7 pid: 19931 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518300.967419:0:19931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19931:1876445627528576:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518300.967495:0:19931:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518300.973754:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518300.974326:0:19931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.974343:0:19931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.974370:0:19931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.974377:0:19931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.974383:0:19931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.974387:0:19931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518300.974390:0:19931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.974396:0:19931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.974416:0:19931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.974422:0:19931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782ad2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518300.974458:0:19931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+6:2342:x1876445617080960:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 7453us (7628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518300.974463:0:19931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518300.976649:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617081344 00000100:00100000:1.0:1789518300.976656:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617081344 00000100:00100000:1.0:1789518300.976690:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:1.0:1789518300.976698:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+12:17459:x1876445617081344:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518300.976751:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.976764:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.976774:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.976989:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ae0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.977001:0:18928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782aa1 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf7 expref: 13 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.977020:0:18928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ae0 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.977050:0:18928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782aa1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf7 expref: 13 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.977063:0:18928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782aa1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf7 expref: 13 pid: 18929 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518300.977076:0:18928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627528704:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518300.977144:0:18928:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518300.979256:0:18928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627528704:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518300.979283:0:18928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ae0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518300.982454:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+14:2342:x1876445617081472:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518300.982479:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518300.982487:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782aa1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf7 expref: 14 pid: 18929 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.982502:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782aa1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf7 expref: 14 pid: 18929 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.982529:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782aa1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdf7 expref: 14 pid: 18929 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.982544:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99ffc2fdca00) 00010000:00010000:3.0:1789518300.982549:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ae0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.982558:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ae0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.982566:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ae0 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.982599:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518300.982721:0:18928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ae0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.982728:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782ae0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518300.982897:0:18928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000001:00080000:1.0:1789518300.982996:0:18928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901924 00000001:00080000:1.0:1789518300.983037:0:18928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00000100:00100000:1.0:1789518300.983119:0:18928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18928:1876445627528832:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789518300.983219:0:18928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518300.983257:0:18928:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518300.983349:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+16:2342:x1876445617081472:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 897us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518300.983359:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518300.984548:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627528960 00000100:00100000:1.0:1789518300.984554:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627528960 00000100:00100000:1.0:1789518300.984593:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518300.984601:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:18928:x1876445627528960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789518300.985308:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18928:x1876445627528960:12345-0@lo:1000:mdt00_001.0 Request processed in 706us (896us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1789518300.985314:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518300.988741:0:18928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627529088:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518300.988766:0:18928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989715:0:18928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989724:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989736:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989742:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989748:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989754:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518300.989758:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989765:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989782:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:1.0:1789518300.989785:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518300.989789:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989795:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782ae7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989806:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989812:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989817:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989822:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518300.989825:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989831:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989838:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:1.0:1789518300.989840:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518300.989842:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518300.989848:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c782ad9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518300.990054:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+15:17459:x1876445617081344:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 13355us (13527us total) trans 12884901927 rc 0/0 00000100:00100000:1.0:1789518300.990063:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000020:00080000:1.0:1789518300.990067:0:18928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789518300.993120:0:18930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617081856 00000100:00100000:3.0:1789518300.993129:0:18930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617081856 00000100:00100000:3.0:1789518300.993172:0:18930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518300.993181:0:18930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+15:17459:x1876445617081856:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789518300.994067:0:18930:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789518300.994173:0:18930:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00010000:00010000:3.0:1789518300.994230:0:18930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c782aee lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.994246:0:18930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c782aee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.994256:0:18930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c782aee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.994264:0:18930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c782aee lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.994270:0:18930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c782aee lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.994919:0:18930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c782aee lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518300.994941:0:18930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518300.995046:0:18930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+17:17459:x1876445617081856:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1862us (2105us total) trans 12884901929 rc 0/0 00000100:00100000:3.0:1789518300.995056:0:18930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000020:00080000:3.0:1789518300.995066:0:18930:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1789518301.149291:0:21100:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 3 synced_idx: 0 lgh_last_idx: 3 00000040:00080000:3.0:1789518301.149300:0:21100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518301.149338:0:21100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789518301.149355:0:21100:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789518301.149358:0:21100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518301.149398:0:21100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1789518301.149403:0:21100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 3 00000100:00100000:3.0:1789518301.208956:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617082112 00000100:00100000:3.0:1789518301.208965:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617082112 00000100:00100000:3.0:1789518301.209031:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:3.0:1789518301.209042:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+17:17469:x1876445617082112:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518301.209064:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518301.209083:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfce13 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518301.209163:0:18929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789518301.209285:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782af5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce13 expref: 19 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.209299:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:3.0:1789518301.209302:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518301.209307:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce13 expref: 19 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.209324:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd800, rc 0) 00000100:00100000:3.0:1789518301.209376:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+18:17469:x1876445617082112:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 334us (496us total) trans 12884901930 rc 301/301 00000100:00100000:3.0:1789518301.209385:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1789518301.211309:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.217980:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617082496 00000100:00100000:1.0:1789518301.217990:0:18931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617082496 00000100:00100000:1.0:1789518301.218066:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518301.218081:0:18931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+18:17469:x1876445617082496:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518301.218359:0:18931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+19:17469:x1876445617082496:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 279us (504us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1789518301.218367:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1789518301.242129:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.247349:0:18930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617083136 00000100:00100000:3.0:1789518301.247357:0:18930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617083136 00000100:00100000:3.0:1789518301.247398:0:18930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518301.247407:0:18930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+21:17472:x1876445617083136:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518301.247633:0:18930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+22:17472:x1876445617083136:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 207us (343us total) trans 12884901933 rc 0/0 00000100:00100000:3.0:1789518301.247642:0:18930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518301.266268:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.266346:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617083392 00000100:00100000:1.0:1789518301.266356:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617083392 00000100:00100000:1.0:1789518301.266414:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:1.0:1789518301.266424:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+22:15052:x1876445617083392:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518301.266448:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518301.266466:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782b42 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfce21 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.266550:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782b49 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.266564:0:18927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782b2d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce1a expref: 23 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.266588:0:18927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782b49 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.266736:0:18927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782b2d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce1a expref: 23 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.266750:0:18927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782b2d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce1a expref: 23 pid: 18929 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518301.266763:0:18927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18927:1876445627529216:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518301.266839:0:18927:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518301.269216:0:18927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18927:1876445627529216:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518301.269257:0:18927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782b49 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518301.269586:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518301.270072:0:18927:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782b49 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.270084:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782b49 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518301.270109:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 9 00010000:00010000:1.0:1789518301.270257:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782b42 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce21 expref: 24 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.270272:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782b49 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce21 expref: 23 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.270290:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:1.0:1789518301.270293:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789518301.270295:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45600, rc 0) 00000100:00100000:1.0:1789518301.270319:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+23:15052:x1876445617083392:12345-192.168.206.51@tcp:101:bash.0 Request processed in 3898us (4060us total) trans 12884901934 rc 0/0 00000100:00100000:1.0:1789518301.270326:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1789518301.273871:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617083776 00000100:00100000:3.0:1789518301.273880:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617083776 00000100:00100000:3.0:1789518301.273968:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1789518301.273978:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+23:15052:x1876445617083776:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:3.0:1789518301.274242:0:20802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.274257:0:20802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.274267:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518301.274329:0:20802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901935 00000004:00010000:3.0:1789518301.274353:0:20802:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f9e8e0a reply state 00000000b914fe2f transno 12884901936 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518301.274361:0:20802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789518301.274466:0:20802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901936 00000100:00100000:3.0:1789518301.274560:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+27:15052:x1876445617083776:12345-192.168.206.51@tcp:36:bash.0 Request processed in 583us (770us total) trans 12884901937 rc 0/0 00000100:00100000:3.0:1789518301.274567:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000020:00080000:3.0:1789518301.274572:0:20802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789518301.277860:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.277877:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.277885:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.277891:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518301.277896:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.277960:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.277977:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:1.0:1789518301.278035:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518301.278042:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.278049:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c782b57 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518301.280323:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617083904 00000100:00100000:3.0:1789518301.280350:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617083904 00000100:00100000:3.0:1789518301.280426:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:3.0:1789518301.280437:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+26:15052:x1876445617083904:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518301.280467:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518301.280494:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c782b5e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfce28 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.280572:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c782b5e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce28 expref: 27 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.280589:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c782b5e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce28 expref: 27 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.280892:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:3.0:1789518301.280897:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518301.280902:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bdc00, rc 0) 00000100:00100000:3.0:1789518301.283571:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617084032 00000100:00100000:3.0:1789518301.283583:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617084032 00000100:00100000:1.0:1789518301.286801:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.329245:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617084544 00000100:00100000:1.0:1789518301.329253:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617084544 00000100:00100000:1.0:1789518301.329305:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518301.329314:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+29:17486:x1876445617084544:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1789518301.329376:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.329392:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.329402:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.329416:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.329422:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.329428:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.329972:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.329982:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.329989:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518301.330034:0:18927:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330045:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330050:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330056:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330061:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518301.330065:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330071:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330082:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99ffc9af7c00) 00010000:00010000:1.0:1789518301.330085:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518301.330089:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330095:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782b81 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330106:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330112:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330125:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330130:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518301.330133:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330138:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330146:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518301.330148:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518301.330151:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330157:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782b88 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330170:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330176:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330181:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330196:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518301.330199:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330215:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330223:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:1.0:1789518301.330225:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518301.330227:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.330232:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782b8f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518301.330303:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+29:17486:x1876445617084544:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 989us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518301.330311:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518301.354851:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.361542:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.366513:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.369496:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.369686:0:18930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617085568 00000100:00100000:3.0:1789518301.369695:0:18930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617085568 00000100:00100000:3.0:1789518301.369746:0:18930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518301.369756:0:18930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+31:17489:x1876445617085568:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518301.369983:0:18930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+32:17489:x1876445617085568:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 228us (491us total) trans 12884901941 rc 0/0 00000100:00100000:3.0:1789518301.369990:0:18930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518301.408160:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.413046:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.423263:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518301.425075:0:18916:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518301.425082:0:18916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c782bf8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.425089:0:18916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14dc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518301.425093:0:18916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c782bf8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.425110:0:18916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c782bf8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.425120:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:1.0:1789518301.425122:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518301.425126:0:18916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c782bf8 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.425132:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c782bf8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518301.425154:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518301.425156:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518301.425158:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518301.450202:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.457545:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.461560:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.461729:0:18930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617086976 00000100:00100000:3.0:1789518301.461745:0:18930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617086976 00000100:00100000:3.0:1789518301.461823:0:18930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518301.461852:0:18930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+36:17507:x1876445617086976:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:3.0:1789518301.462319:0:18930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+37:17507:x1876445617086976:12345-192.168.206.51@tcp:35:bash.0 Request processed in 467us (756us total) trans 12884901946 rc 0/0 00000100:00100000:3.0:1789518301.462328:0:18930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518301.517104:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.520689:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.558170:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.560473:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.560530:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.560580:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617087744 00000100:00100000:3.0:1789518301.560587:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617087744 00010000:00010000:3.0:1789518301.560698:0:18912:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782c29 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce52 expref: 42 pid: 18929 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518301.560745:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518301.560755:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+42:2343:x1876445617087744:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518301.560767:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518301.560772:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782c29 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce52 expref: 41 pid: 18929 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.560819:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782c29 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce52 expref: 41 pid: 18929 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.560844:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c782c29 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce52 expref: 41 pid: 18929 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.560856:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:3.0:1789518301.560859:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c782c53 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.560866:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c782c53 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.560887:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c782c53 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.560919:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518301.560944:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+39:2343:x1876445617087744:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 192us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518301.560953:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:1.0:1789518301.562869:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.566084:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.568873:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.571685:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.606338:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.609128:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.612514:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.613041:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.616786:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.621040:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.622797:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518301.622851:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617089920 00000100:00100000:3.0:1789518301.622860:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617089920 00000100:00100000:3.0:1789518301.622929:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1789518301.622940:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+45:17536:x1876445617089920:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:3.0:1789518301.622967:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518301.622996:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c782c37 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce59 expref: 45 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518301.623019:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:3.0:1789518301.623024:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518301.623072:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+44:17536:x1876445617089920:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 134us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518301.623079:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1789518301.624060:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518301.627293:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.011796:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.017550:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.022462:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.025338:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.032398:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.039402:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.043044:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.046773:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.050297:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.053922:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.056753:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.059095:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.061053:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.065288:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.065441:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617092736 00000100:00100000:3.0:1789518302.065452:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617092736 00000100:00100000:3.0:1789518302.065506:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518302.065515:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+6:2342:x1876445617092736:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518302.065530:0:19616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518302.065551:0:19616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c782d3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcead expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518302.065577:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e1de, blocks: 0x1 00010000:00010000:3.0:1789518302.065594:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789518302.065598:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518302.065607:0:19616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c782d3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcead expref: 7 pid: 19616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.065660:0:19616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c782d3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcead expref: 7 pid: 19616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.065687:0:19616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:3.0:1789518302.065752:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2342:x1876445617092736:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 237us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518302.065760:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1789518302.068411:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.070950:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.071310:0:19931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617093120 00000100:00100000:3.0:1789518302.071321:0:19931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617093120 00000100:00100000:3.0:1789518302.071447:0:19931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1789518302.071459:0:19931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:17537:x1876445617093120:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518302.071760:0:19931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518302.071784:0:19931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c782d41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfceb4 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.071823:0:19931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c782d3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcead expref: 8 pid: 19616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.071835:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518302.071840:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518302.071846:0:19931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c782d41 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfceb4 expref: 8 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.071889:0:19931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c782d3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcead expref: 8 pid: 19616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.071906:0:19931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c782d3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcead expref: 8 pid: 19616 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518302.071923:0:19931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19931:1876445627530112:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518302.072334:0:19931:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518302.075783:0:19931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19931:1876445627530112:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518302.075840:0:19931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c782d41 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfceb4 expref: 8 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.075891:0:19931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:3.0:1789518302.075993:0:19931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:17537:x1876445617093120:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 4530us (5058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518302.076003:0:19931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518302.076671:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.081664:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.085830:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000020:00080000:1.0:1789518302.113885:0:18966:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934629 committed batchid 4294967527 00000020:00080000:1.0:1789518302.114225:0:18966:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000100:00100000:1.0:1789518302.114422:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+15:17537:x1876445617093504:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 28351us (28600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518302.114431:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:3.0:1789518302.115356:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789518302.115847:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fffc5f0a80 x1876445627530368/t12884901892(12884901892) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518318 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789518302.115860:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fffc5f0a80/2, rc 0, transno 12884901892 00000100:00100000:3.0:1789518302.115865:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627530368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518302.117166:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.164138:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.166222:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518302.166514:0:20802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782d4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.166520:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782d4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.166540:0:20802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782d4f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.166544:0:20802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782d4f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.166549:0:20802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782d4f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.166553:0:20802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518302.166556:0:20802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782d4f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.166576:0:20802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782d4f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.166586:0:20802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff99ffc2ad3900) 00010000:00010000:3.0:1789518302.166588:0:20802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789518302.166591:0:20802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782d4f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.166595:0:20802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c782d4f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518302.166653:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+14:17537:x1876445617094272:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 2391us (2522us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789518302.166659:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:1.0:1789518302.168264:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.168303:0:19931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617094528 00000100:00100000:3.0:1789518302.168309:0:19931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617094528 00000100:00100000:3.0:1789518302.168337:0:19931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518302.168342:0:19931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2345:x1876445617094528:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789518302.168368:0:19931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.168380:0:19931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c782d41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfceb4 expref: 7 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.168386:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518302.168390:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518302.168392:0:19931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.168419:0:19931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c782d41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfceb4 expref: 7 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.168428:0:19931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c782d41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfceb4 expref: 7 pid: 19931 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518302.168437:0:19931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19931:1876445627530624:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518302.168490:0:19931:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518302.171191:0:19931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19931:1876445627530624:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518302.171286:0:19931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.171301:0:19931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.171310:0:19931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.171333:0:19931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.171347:0:19931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.171374:0:19931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.171394:0:19931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518302.171399:0:19931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.171409:0:19931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.171432:0:19931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.171440:0:19931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c782d56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518302.171539:0:19931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+6:2345:x1876445617094528:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 3195us (3278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518302.171547:0:19931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1789518302.173422:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617094912 00000100:00100000:1.0:1789518302.173430:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617094912 00000100:00100000:1.0:1789518302.173476:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:1.0:1789518302.173485:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+14:17537:x1876445617094912:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518302.173547:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.173573:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.173583:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.173864:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782d64 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.173875:0:18927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782d25 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce9f expref: 15 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.173882:0:18927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782d64 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.173911:0:18927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782d25 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce9f expref: 15 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.173923:0:18927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782d25 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce9f expref: 15 pid: 18928 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518302.173936:0:18927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2974e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18927:1876445627530752:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518302.174048:0:18927:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518302.175918:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617095040 00000100:00100000:3.0:1789518302.175928:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617095040 00010000:00010000:3.0:1789518302.175953:0:18912:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782d25 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce9f expref: 16 pid: 18928 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518302.175981:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1789518302.176002:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe00d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+16:2342:x1876445617095040:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518302.176014:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518302.176021:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782d25 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce9f expref: 16 pid: 18928 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.176032:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782d25 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce9f expref: 16 pid: 18928 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.176049:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782d25 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce9f expref: 16 pid: 18928 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.176062:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff99ffc2ad3900) 00010000:00010000:3.0:1789518302.176066:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782d64 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.176073:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782d64 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.176079:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782d64 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.176106:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518302.176149:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe00d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+15:2342:x1876445617095040:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 149us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518302.176156:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1789518302.177377:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627531008 00000100:00100000:1.0:1789518302.177382:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627531008 00000100:00100000:1.0:1789518302.177409:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518302.177416:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:18927:x1876445627531008:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789518302.177543:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18927:x1876445627531008:12345-0@lo:1000:mdt00_000.0 Request processed in 127us (203us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1789518302.177556:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518302.180313:0:18927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18927:1876445627531136:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518302.180338:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c782cb5 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180347:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c782cb5 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180374:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180385:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180395:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180404:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180410:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180416:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180422:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518302.180425:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180432:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180453:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:1.0:1789518302.180456:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518302.180460:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180466:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c782d6b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180476:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180483:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180489:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180495:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518302.180498:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180503:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180510:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:1.0:1789518302.180512:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518302.180515:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518302.180520:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782d5d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518302.180761:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+18:17537:x1876445617094912:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 7276us (7457us total) trans 12884901963 rc 0/0 00000100:00100000:1.0:1789518302.180771:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00000020:00080000:1.0:1789518302.180781:0:18927:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789518302.180989:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.181065:0:18930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617095168 00000100:00100000:1.0:1789518302.181073:0:18930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617095168 00000100:00100000:1.0:1789518302.181111:0:18930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:1.0:1789518302.181121:0:18930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+18:17536:x1876445617095168:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:1.0:1789518302.181228:0:18930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+18:17536:x1876445617095168:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 108us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518302.181235:0:18930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518302.183062:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.183105:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.183155:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617095680 00000100:00100000:1.0:1789518302.183169:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617095680 00000100:00100000:1.0:1789518302.183228:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:1.0:1789518302.183239:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+18:17536:x1876445617095680:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:1.0:1789518302.183563:0:18928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].3, 136 off8600 00000100:00100000:1.0:1789518302.183651:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+20:17536:x1876445617095680:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 415us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518302.183658:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 106 00010000:00010000:3.0:1789518302.184426:0:21040:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518302.184438:0:21040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c782d72 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.184445:0:21040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518302.184449:0:21040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c782d72 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.184457:0:21040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c782d72 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.184468:0:21040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff99ffc2ad3100) 00010000:00010000:3.0:1789518302.184471:0:21040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518302.184476:0:21040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c782d72 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.184482:0:21040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c782d72 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518302.184498:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518302.184500:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518302.184501:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518302.204731:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518302.207812:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518302.209717:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000040:00080000:3.0:1789518302.632478:0:21151:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 3 synced_idx: 0 lgh_last_idx: 3 00000040:00080000:3.0:1789518302.632488:0:21151:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518302.632528:0:21151:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789518302.632543:0:21151:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789518302.632545:0:21151:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518302.632582:0:21151:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 4 count 4 00000040:00080000:3.0:1789518302.632585:0:21151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 3 00010000:00010000:1.0:1789518302.707137:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518303.223963:0:18963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ae680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18963:1876445627531392:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518303.225016:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518303.225196:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617096320 00000100:00100000:3.0:1789518303.225215:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617096320 00000100:00100000:3.0:1789518303.225329:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:3.0:1789518303.225339:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+21:17551:x1876445617096320:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518303.225370:0:20802:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518303.225472:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+21:17551:x1876445617096320:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 134us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518303.225480:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:3.0:1789518303.228205:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617096576 00000100:00100000:3.0:1789518303.228215:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617096576 00000100:00100000:3.0:1789518303.228263:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1789518303.228272:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+21:17551:x1876445617096576:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518303.228290:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518303.228309:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c782d95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcec2 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.228398:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782d9c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.228412:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782d9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.228425:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782d9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518303.228440:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789518303.228544:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c782d95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcec2 expref: 24 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.228559:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c782d9c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcec2 expref: 23 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.228575:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:3.0:1789518303.228576:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518303.228579:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:3.0:1789518303.228662:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+23:17551:x1876445617096576:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 391us (548us total) trans 12884901967 rc 0/0 00000100:00100000:3.0:1789518303.228668:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1789518303.232812:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617096960 00000100:00100000:3.0:1789518303.232818:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617096960 00000100:00100000:3.0:1789518303.232855:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:3.0:1789518303.232877:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+23:17551:x1876445617096960:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518303.232950:0:20802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.233153:0:20802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.233165:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.233326:0:20802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.233332:0:20802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.233337:0:20802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.233348:0:20802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518303.233351:0:20802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.233358:0:20802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.233367:0:20802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:3.0:1789518303.233369:0:20802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518303.233373:0:20802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518303.233379:0:20802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782daa lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518303.233517:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+23:17551:x1876445617096960:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 653us (1055us total) trans 12884901968 rc 0/0 00000100:00100000:3.0:1789518303.233525:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000040:00080000:1.0:1789518303.233575:0:18963:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 3 synced_idx: 0 lgh_last_idx: 3 00000040:00080000:1.0:1789518303.233581:0:18963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518303.233669:0:18963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789518303.233692:0:18963:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789518303.233696:0:18963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518303.233723:0:18963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 4 count 4 00000040:00080000:1.0:1789518303.233727:0:18963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 3 00000040:00080000:1.0:1789518304.135523:0:21202:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 3 synced_idx: 0 lgh_last_idx: 3 00000040:00080000:1.0:1789518304.135532:0:21202:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518304.135569:0:21202:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789518304.135583:0:21202:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789518304.135586:0:21202:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518304.135639:0:21202:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 4 count 4 00000040:00080000:1.0:1789518304.135643:0:21202:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 3 00000100:00100000:3.0:1789518304.234594:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518304.234655:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617097472 00000100:00100000:3.0:1789518304.234664:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617097472 00000100:00100000:3.0:1789518304.234725:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:3.0:1789518304.234736:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+24:17572:x1876445617097472:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518304.234758:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518304.234778:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782db1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcec9 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.234887:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c782db8 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.234908:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c782db8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.234922:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c782db8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518304.234934:0:18929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789518304.235049:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782db1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcec9 expref: 27 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.235067:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c782db8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcec9 expref: 26 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.235077:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:3.0:1789518304.235080:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518304.235084:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:3.0:1789518304.235147:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+26:17572:x1876445617097472:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 413us (562us total) trans 12884901970 rc 0/0 00000100:00100000:3.0:1789518304.235154:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:3.0:1789518304.238169:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617097600 00000100:00100000:3.0:1789518304.238189:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617097600 00000100:00100000:3.0:1789518304.238248:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:3.0:1789518304.238256:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+26:17572:x1876445617097600:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:3.0:1789518304.238314:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.238329:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.238351:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.238486:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.238492:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.238500:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.238505:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518304.238510:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.238517:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.238528:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:3.0:1789518304.238531:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518304.238535:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518304.238541:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782dc6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518304.238684:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+26:17572:x1876445617097600:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 427us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518304.238692:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:1.0:1789518304.306418:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518304.371136:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627531520 00000100:00100000:1.0:1789518304.371145:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627531520 00000100:00100000:1.0:1789518304.371208:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789518304.371217:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4b3836a-38c9-4257-b2e7-4883536aaaca+19:3281:x1876445627531520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518304.372162:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627532032 00000100:00100000:3.0:1789518304.372184:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627532032 00000100:00100000:3.0:1789518304.372258:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518304.372269:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627532032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518304.372313:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789518304.372401:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627532032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518304.372420:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518304.372464:0:19931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627531648 00000100:00100000:3.0:1789518304.372470:0:19931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627531648 00000100:00100000:3.0:1789518304.372543:0:19931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627531776 00000100:00100000:3.0:1789518304.372550:0:19931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627531776 00000100:00100000:3.0:1789518304.372583:0:19931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518304.372591:0:19931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627531648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518304.372665:0:19931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627531648:12345-0@lo:400:kworker.0 Request processed in 75us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518304.372671:0:19931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518304.372685:0:19931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518304.372706:0:19931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627531776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518304.372744:0:19931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627531776:12345-0@lo:400:kworker.0 Request processed in 41us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518304.372749:0:19931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518304.372794:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518304.372802:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627532160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518304.373262:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627532160:12345-0@lo:400:kworker.0 Request processed in 458us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518304.373272:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518304.373392:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4b3836a-38c9-4257-b2e7-4883536aaaca+19:3281:x1876445627531520:12345-0@lo:400:kworker.0 Request processed in 2173us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518304.373406:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00010000:3.0:1789518304.755249:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518304.884439:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627532416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518304.884492:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518304.884777:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627532416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789518305.780116:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518306.797195:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617098880 00000100:00100000:1.0:1789518306.797215:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617098880 00000100:00100000:1.0:1789518306.797384:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518306.797397:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+26:17291:x1876445617098880:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789518306.797562:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+26:17291:x1876445617098880:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 167us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518306.797570:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518306.799470:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617099136 00000100:00100000:1.0:1789518306.799481:0:18931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617099136 00000100:00100000:1.0:1789518306.799550:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518306.799563:0:18931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+26:17291:x1876445617099136:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518306.800299:0:18931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+27:17291:x1876445617099136:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 736us (963us total) trans 12884901971 rc 0/0 00000100:00100000:1.0:1789518306.800309:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000001:00080000:3.0:1789518307.485727:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901966 is committed 00000001:00080000:3.0:1789518307.485748:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901971 is committed 00000020:00080000:3.0:1789518307.485772:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934629 batchid updated 00000004:00080000:3.0:1789518307.485791:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789518307.485806:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fffffbe540 refcount 2 committed 0 result 0 batchid 8589934630 00000020:00080000:1.0:1789518307.485809:0:18966:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934629 00000020:00080000:3.0:1789518307.485812:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffd849f300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fffffbe240 00000020:00080000:3.0:1789518307.485815:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffd849f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fffd79dc00 00000020:00080000:1.0:1789518307.485818:0:18966:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934630 committed batchid 8589934629 00000020:00080000:1.0:1789518307.486177:0:18966:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934629 00000100:00100000:3.0:1789518307.486343:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518307.486361:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627532544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789518307.486427:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518307.486505:0:19931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627532544 00000100:00100000:1.0:1789518307.486514:0:19931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627532544 00000100:00100000:1.0:1789518307.486566:0:19931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518307.486575:0:19931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc591f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627532544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789518307.486596:0:19931:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:66 count 1 00010000:00010000:1.0:1789518307.486651:0:19931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.486673:0:19931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c782b65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce2f expref: 5 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.486683:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1789518307.486700:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518307.486705:0:19931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.486957:0:19931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c782b65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce2f expref: 5 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.486974:0:19931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c782b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce2f expref: 5 pid: 19614 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518307.486986:0:19931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19931:1876445627532672:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518307.487055:0:19931:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aed780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518307.496136:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518307.496186:0:19931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2975500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19931:1876445627532672:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518307.496194:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617099264 00000100:00100000:1.0:1789518307.496206:0:18914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617099264 00010000:00010000:1.0:1789518307.496268:0:18914:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c782b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce2f expref: 6 pid: 19614 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518307.496301:0:19931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518307.496316:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518307.496339:0:18914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+6:2342:x1876445617099264:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518307.496360:0:18914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518307.496367:0:18914:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c782b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce2f expref: 6 pid: 19614 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.496383:0:18914:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c782b65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce2f expref: 6 pid: 19614 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.496428:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c782b65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce2f expref: 6 pid: 19614 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.496446:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518307.496451:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518307.496457:0:18914:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.496469:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.496500:0:18914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518307.496566:0:18914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+5:2342:x1876445617099264:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 233us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518307.496574:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00080000:1.0:1789518307.496605:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789518307.496640:0:19931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.496651:0:19931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.496663:0:19931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.496683:0:19931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.496705:0:19931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789518307.497421:0:19931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc591f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627532544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10845us (10992us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789518307.497433:0:19931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518307.497471:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1789518307.497481:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1789518307.497518:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fec2974700 x1876445627532544/t12884901896(12884901896) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518323 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789518307.497529:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec2974700/2, rc 0, transno 12884901896 00000100:00100000:3.0:1789518307.497535:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627532544:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789518307.497690:0:21040:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518307.497699:0:21040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.497710:0:21040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518307.497715:0:21040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.497726:0:21040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.497746:0:21040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.497753:0:21040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c782dd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518307.497776:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518307.497785:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518307.497787:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518307.827838:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518307.987943:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518307.993739:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518307.993783:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.058423:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.058509:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617099904 00000100:00100000:3.0:1789518308.058523:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617099904 00000100:00100000:3.0:1789518308.058585:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1789518308.058609:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+14:18221:x1876445617099904:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518308.058673:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.058694:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782dfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcede expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.058749:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.058762:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.058775:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.058790:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.058797:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.058802:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059088:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059096:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059104:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059124:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.059129:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059136:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059147:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:3.0:1789518308.059150:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.059163:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059170:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059185:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059191:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059197:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059202:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.059205:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059211:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059229:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe06b53f9 (ffff99ffe6f98400) 00010000:00010000:3.0:1789518308.059232:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.059235:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059241:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059271:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782dfe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcede expref: 15 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059280:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:3.0:1789518308.059283:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.059286:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782dfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcede expref: 15 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.059294:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc200, rc 0) 00000100:00100000:3.0:1789518308.059362:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+14:18221:x1876445617099904:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 756us (957us total) trans 0 rc 301/301 00000100:00100000:3.0:1789518308.059370:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1789518308.064604:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.067820:0:18928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6500e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627532800:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518308.067843:0:18928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.068034:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.068197:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617100288 00000100:00100000:1.0:1789518308.068203:0:18914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617100288 00010000:00010000:1.0:1789518308.068254:0:18914:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78281d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcd48 expref: 6 pid: 18928 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518308.068293:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518308.068302:0:18914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+6:2343:x1876445617100288:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518308.068315:0:18914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518308.068321:0:18914:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78281d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcd48 expref: 6 pid: 18928 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.068332:0:18914:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78281d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcd48 expref: 6 pid: 18928 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.068350:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78281d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcd48 expref: 6 pid: 18928 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.068364:0:18914:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:1.0:1789518308.068367:0:18914:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.068374:0:18914:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.068391:0:18914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.068408:0:18914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518308.068440:0:18914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2343:x1876445617100288:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 141us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518308.068445:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00010000:00010000:3.0:1789518308.068572:0:18928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.068584:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.068608:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782e1a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.068651:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782e1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.068659:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782e1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518308.069957:0:18928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x6:0x0]: returning size 16384 00010000:00010000:3.0:1789518308.069969:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.069977:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.069984:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.069990:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.069994:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.070002:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.070013:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3e00) 00010000:00010000:3.0:1789518308.070016:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.070027:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.070033:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c782e13 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518308.070050:0:18928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062c0bad8 reply state 0000000098d753af transno 12884901973 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782e1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.070058:0:18928:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518308.070137:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+15:18221:x1876445617100160:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 5292us (5536us total) trans 12884901973 rc 0/0 00000100:00100000:3.0:1789518308.070144:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:1.0:1789518308.083335:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.087944:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.088144:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617100544 00000100:00100000:1.0:1789518308.088162:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617100544 00000100:00100000:1.0:1789518308.088207:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1789518308.088218:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+15:18222:x1876445617100544:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:1.0:1789518308.088233:0:20802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518308.088249:0:20802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782e2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfceec expref: -99 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088311:0:20802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088323:0:20802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088333:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088347:0:20802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088354:0:20802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088371:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088444:0:20802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c782e44 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088452:0:20802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c782e44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088459:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c782e44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518308.088485:0:20802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x6:0x0]: returning size 16384 00000004:00200000:1.0:1789518308.088488:0:20802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518308.088513:0:20802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c782e44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088524:0:20802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088530:0:20802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088536:0:20802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088542:0:20802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518308.088547:0:20802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088554:0:20802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088575:0:20802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:1.0:1789518308.088579:0:20802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518308.088583:0:20802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088589:0:20802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c782e36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088601:0:20802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088607:0:20802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088690:0:20802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088697:0:20802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518308.088700:0:20802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088713:0:20802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088721:0:20802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe06b53f9 (ffff99ffc2fdcf00) 00010000:00010000:1.0:1789518308.088723:0:20802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518308.088726:0:20802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088731:0:20802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c782e3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe06b53f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088770:0:20802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c782e2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfceec expref: 17 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088783:0:20802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c782e44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfceec expref: 16 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.088790:0:20802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518308.088793:0:20802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518308.088795:0:20802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44600, rc 0) 00000100:00100000:1.0:1789518308.088897:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+16:18222:x1876445617100544:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 681us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518308.088903:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1789518308.091072:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.091150:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617100800 00000100:00100000:3.0:1789518308.091167:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617100800 00000100:00100000:3.0:1789518308.091257:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:3.0:1789518308.091267:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+16:18222:x1876445617100800:12345-192.168.206.51@tcp:36:chmod.0 00010000:00010000:3.0:1789518308.091306:0:18927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518308.091326:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c782e44 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfceec expref: 16 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.091342:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:3.0:1789518308.091351:0:18927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518308.091372:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e4b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.091384:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.091393:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518308.091590:0:18927:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d68c7265 reply state 00000000a19bb42e transno 12884901974 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782e4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.091600:0:18927:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789518308.091606:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x6:0x0]: returning size 16384 00000100:00100000:3.0:1789518308.091712:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+17:18222:x1876445617100800:12345-192.168.206.51@tcp:36:chmod.0 Request processed in 445us (644us total) trans 12884901974 rc 0/0 00000100:00100000:3.0:1789518308.091719:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:1.0:1789518308.123514:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.124213:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617100928 00000100:00100000:3.0:1789518308.124223:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617100928 00000100:00100000:3.0:1789518308.124282:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:3.0:1789518308.124292:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+16:18228:x1876445617100928:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:3.0:1789518308.124314:0:18928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.124333:0:18928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782e52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcef3 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518308.145544:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.148050:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.148207:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1789518308.148216:0:18931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+19:18228:x1876445617101568:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:1.0:1789518308.149005:0:18931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+20:18228:x1876445617101568:12345-192.168.206.51@tcp:35:dd.500 Request processed in 788us (961us total) trans 12884901976 rc 0/0 00000100:00100000:1.0:1789518308.149014:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1789518308.184488:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.188200:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617101952 00000100:00100000:3.0:1789518308.188209:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617101952 00000100:00100000:3.0:1789518308.188261:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:3.0:1789518308.188270:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+21:18234:x1876445617101952:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518308.188288:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.188304:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ea6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf0f expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.188388:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782ead lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.188407:0:18929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c782e83 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcefa expref: 22 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.188415:0:18929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782ead lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.188452:0:18929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c782e83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcefa expref: 22 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.188465:0:18929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c782e83 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcefa expref: 22 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.188478:0:18929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18929:1876445627532928:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518308.188644:0:18929:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd807a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518308.193749:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.193867:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617102080 00000100:00100000:1.0:1789518308.193875:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617102080 00010000:00010000:1.0:1789518308.193915:0:18912:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c782e83 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcefa expref: 23 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518308.193980:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1789518308.193989:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+23:2342:x1876445617102080:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518308.194002:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518308.194010:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c782e83 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcefa expref: 23 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.194023:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c782e83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcefa expref: 23 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.194045:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c782e83 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcefa expref: 23 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.194061:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2ad3200) 00010000:00010000:1.0:1789518308.194066:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782ead lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.194076:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782ead lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.194083:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782ead lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.194110:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518308.194168:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+22:2342:x1876445617102080:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 179us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518308.194179:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1789518308.198572:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.210609:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.215291:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617102592 00000100:00100000:3.0:1789518308.215300:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617102592 00000100:00100000:3.0:1789518308.215413:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1789518308.215423:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+6:2342:x1876445617102592:12345-192.168.206.51@tcp:1:lfs.500 00010000:00010000:3.0:1789518308.215463:0:19614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.215481:0:19614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d809ea6/0x631fd8698c782e91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf01 expref: 6 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.215512:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518308.215517:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518308.215522:0:19614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.215557:0:19614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d809ea6/0x631fd8698c782e91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf01 expref: 6 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.215576:0:19614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d809ea6/0x631fd8698c782e91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf01 expref: 6 pid: 19616 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.215590:0:19614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19614:1876445627533056:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518308.215825:0:19614:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd807a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518308.217976:0:19614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19614:1876445627533056:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518308.218001:0:19614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518308.222471:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617102848 00000100:00100000:1.0:1789518308.222480:0:18914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617102848 00010000:00010000:1.0:1789518308.222515:0:18914:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d809ea6/0x631fd8698c782e91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf01 expref: 9 pid: 19616 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518308.222605:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1789518308.222690:0:18914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe00d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+9:2345:x1876445617102848:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518308.222706:0:18914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789518308.222722:0:18914:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1789518308.222725:0:18914:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb mtime from disk: 0 -> 1789518308 00002000:00010000:1.0:1789518308.222728:0:18914:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb atime from disk: 0 -> 1789518308 00002000:00010000:1.0:1789518308.222729:0:18914:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x43:0x0] updating lvb ctime from disk: 0 -> 1789518308 00010000:00010000:1.0:1789518308.222736:0:18914:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d809ea6/0x631fd8698c782e91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf01 expref: 9 pid: 19616 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.222749:0:18914:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d809ea6/0x631fd8698c782e91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf01 expref: 9 pid: 19616 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.222770:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d809ea6/0x631fd8698c782e91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf01 expref: 9 pid: 19616 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.222786:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518308.222790:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518308.222796:0:18914:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.222804:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.222851:0:18914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518308.222912:0:18914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe00d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2345:x1876445617102848:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 298us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518308.222920:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00010000:00010000:3.0:1789518308.223030:0:19614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.223040:0:19614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.223064:0:19614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.223079:0:19614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.223092:0:19614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.223099:0:19614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518308.223104:0:19614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.223113:0:19614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.223126:0:19614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.223133:0:19614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a53e1245/0x631fd8698c782ed7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.223202:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2342:x1876445617102592:12345-192.168.206.51@tcp:1:lfs.500 Request processed in 7781us (8032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518308.223210:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1789518308.225658:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.225695:0:18930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617103104 00000100:00100000:3.0:1789518308.225704:0:18930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617103104 00000100:00100000:3.0:1789518308.225812:0:18930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1789518308.225833:0:18930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+24:18234:x1876445617103104:12345-192.168.206.51@tcp:35:lfs.500 00000004:00010000:3.0:1789518308.225885:0:18930:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000013a1:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c782ec2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf16 expref: 24 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518308.226164:0:18930:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901979 00000001:00080000:3.0:1789518308.226218:0:18930:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901980 00000001:00080000:3.0:1789518308.226940:0:18930:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901981 00010000:00010000:3.0:1789518308.226998:0:18930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.227013:0:18930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c782ed0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf1d expref: 28 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.227032:0:18930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.227065:0:18930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c782ed0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf1d expref: 28 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.227080:0:18930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c782ed0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf1d expref: 28 pid: 18927 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.227093:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:18930:1876445627533184:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518308.227273:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd807a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518308.229178:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:18930:1876445627533184:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518308.229203:0:18930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518308.229837:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518308.230381:0:18930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.230396:0:18930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518308.230746:0:18930:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901982 00000001:00080000:3.0:1789518308.230940:0:18930:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901983 00000100:00100000:3.0:1789518308.231052:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:18930:1876445627533312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518308.231104:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518308.231124:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc1254f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518308.233016:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:18930:1876445627533312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789518308.233662:0:18930:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901984 00000100:00100000:3.0:1789518308.233748:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:18930:1876445627533440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518308.233797:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518308.233831:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518308.234790:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:18930:1876445627533440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789518308.234841:0:18930:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901985 00010000:00010000:3.0:1789518308.234877:0:18930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.234887:0:18930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.234895:0:18930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.234901:0:18930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.234915:0:18930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.234922:0:18930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.234937:0:18930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:3.0:1789518308.234941:0:18930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789518308.234946:0:18930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.235441:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782ede lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18930 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518308.235825:0:18930:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789518308.235935:0:18930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].4, 64 off8472 00000004:00080000:3.0:1789518308.235955:0:18930:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362232331572ns, next at 363232329308ns, rc = 0 00000001:00080000:3.0:1789518308.235963:0:18930:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901986 00010000:00010000:3.0:1789518308.236012:0:18930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2ad3d00) 00010000:00010000:3.0:1789518308.236015:0:18930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518308.236023:0:18930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c782ec2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf16 expref: 32 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.236138:0:18930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+31:18234:x1876445617103104:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 10305us (10485us total) trans 12884901987 rc 0/0 00000100:00100000:3.0:1789518308.236145:0:18930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000020:00080000:3.0:1789518308.236160:0:18930:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518308.239205:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.245937:0:21417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617103616 00000100:00100000:3.0:1789518308.245947:0:21417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617103616 00000100:00100000:3.0:1789518308.246066:0:21417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518308.246077:0:21417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+32:18234:x1876445617103616:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:3.0:1789518308.246325:0:21417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+33:18234:x1876445617103616:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 250us (530us total) trans 12884901988 rc 0/0 00000100:00100000:3.0:1789518308.246333:0:21417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518308.296578:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617103872 00000100:00100000:3.0:1789518308.296595:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617103872 00000100:00100000:3.0:1789518308.296718:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:3.0:1789518308.296731:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+33:18244:x1876445617103872:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518308.296764:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.296791:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782eec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf2b expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518308.296903:0:18929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x6:0x0]: returning size 16384 00010000:00010000:3.0:1789518308.297066:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782eec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf2b expref: 35 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.297095:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:3.0:1789518308.297099:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518308.297110:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782eec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf2b expref: 35 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.297128:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bca00, rc 0) 00000100:00100000:3.0:1789518308.297223:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+34:18244:x1876445617103872:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 494us (749us total) trans 12884901989 rc 301/301 00000100:00100000:3.0:1789518308.297231:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:1.0:1789518308.299845:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.301899:0:18930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617104256 00000100:00100000:3.0:1789518308.301906:0:18930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617104256 00000100:00100000:3.0:1789518308.301951:0:18930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1789518308.301959:0:18930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+34:18244:x1876445617104256:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518308.302265:0:18930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+35:18244:x1876445617104256:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 305us (435us total) trans 12884901990 rc 0/0 00000100:00100000:3.0:1789518308.302272:0:18930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518308.344012:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.344166:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617104512 00000100:00100000:3.0:1789518308.344174:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617104512 00000100:00100000:3.0:1789518308.344255:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:3.0:1789518308.344265:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+35:18250:x1876445617104512:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:3.0:1789518308.344293:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.344312:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782f0f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf32 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344378:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344391:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344402:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344416:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344424:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344430:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344546:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782f24 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344551:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782f24 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344556:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782f24 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518308.344562:0:18929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x7:0x0]: returning size 1024 00010000:00010000:3.0:1789518308.344642:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344648:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344652:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344655:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.344658:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344662:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344670:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:3.0:1789518308.344672:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.344675:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344686:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f16 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344696:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344699:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344702:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344705:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.344707:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344710:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344714:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0xa340e02b (ffff99ffe6f98300) 00010000:00010000:3.0:1789518308.344715:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.344717:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344720:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f1d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344749:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782f0f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf32 expref: 38 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344764:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c782f24 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf32 expref: 37 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.344769:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:3.0:1789518308.344771:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518308.344772:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:3.0:1789518308.344879:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+37:18250:x1876445617104512:12345-192.168.206.51@tcp:101:dd.500 Request processed in 615us (871us total) trans 12884901991 rc 0/0 00000100:00100000:3.0:1789518308.344886:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:1.0:1789518308.347033:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.347268:0:21417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617104768 00000100:00100000:3.0:1789518308.347280:0:21417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617104768 00000100:00100000:3.0:1789518308.347345:0:21417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1789518308.347356:0:21417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+37:18250:x1876445617104768:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:3.0:1789518308.347676:0:21417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+38:18250:x1876445617104768:12345-192.168.206.51@tcp:35:dd.500 Request processed in 321us (651us total) trans 12884901992 rc 0/0 00000100:00100000:3.0:1789518308.347685:0:21417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518308.425302:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.467517:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.467722:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617105664 00000100:00100000:3.0:1789518308.467746:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617105664 00000100:00100000:3.0:1789518308.467827:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:3.0:1789518308.467838:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+41:18268:x1876445617105664:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:3.0:1789518308.467868:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.467872:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518308.467907:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c782e9f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf08 expref: 41 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.467953:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:3.0:1789518308.467959:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518308.467977:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782f5c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf40 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468192:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468209:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468221:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468237:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468244:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468251:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468320:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782f71 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468329:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782f71 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468530:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782f71 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518308.468548:0:18929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x7:0x0]: returning size 2048 00010000:00010000:3.0:1789518308.468791:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468800:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468807:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468814:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.468819:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468827:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468838:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:3.0:1789518308.468840:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.468845:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468851:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782f63 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468864:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468870:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468888:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468894:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.468897:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468903:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468911:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0xa340e02b (ffff99ffe6f98300) 00010000:00010000:3.0:1789518308.468914:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.468917:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468924:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782f6a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468972:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782f5c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf40 expref: 43 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468986:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c782f71 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf40 expref: 42 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.468992:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:3.0:1789518308.468994:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518308.468997:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc200, rc 0) 00000100:00100000:3.0:1789518308.469076:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+42:18268:x1876445617105664:12345-192.168.206.51@tcp:101:dd.500 Request processed in 1239us (1571us total) trans 12884901997 rc 0/0 00000100:00100000:3.0:1789518308.469094:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:1.0:1789518308.471974:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518308.479206:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c782f7f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.479229:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c782f7f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.479238:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c782f7f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.479245:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518308.479251:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c782f7f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.479260:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c782f7f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.479302:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:1.0:1789518308.479306:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518308.479313:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c782f7f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.479319:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c782f7f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518308.480681:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.536352:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617106432 00000100:00100000:3.0:1789518308.536365:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617106432 00000100:00100000:3.0:1789518308.536440:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:3.0:1789518308.536453:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+44:18278:x1876445617106432:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518308.536495:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.536521:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782f86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf47 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518308.536668:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x6:0x0]: returning size 16384 00010000:00010000:3.0:1789518308.536819:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782f86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf47 expref: 46 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.536835:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:3.0:1789518308.536839:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518308.536846:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782f86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf47 expref: 46 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.536863:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bca00, rc 0) 00000100:00100000:3.0:1789518308.537361:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+45:18278:x1876445617106432:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 908us (1104us total) trans 12884902001 rc 301/301 00000100:00100000:3.0:1789518308.537371:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:1.0:1789518308.539603:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.543576:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.543925:0:21417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617106816 00000100:00100000:3.0:1789518308.543938:0:21417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617106816 00000100:00100000:3.0:1789518308.544012:0:21417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1789518308.544024:0:21417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+45:18278:x1876445617106816:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518308.544376:0:21417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+46:18278:x1876445617106816:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 353us (820us total) trans 12884902002 rc 0/0 00000100:00100000:3.0:1789518308.544385:0:21417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1789518308.585322:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617106944 00000100:00100000:3.0:1789518308.585335:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617106944 00000100:00100000:3.0:1789518308.585435:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:3.0:1789518308.585448:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+46:18284:x1876445617106944:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518308.585481:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.585508:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf4e expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.585586:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782fb0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.585600:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782fb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.585610:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782fb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518308.585669:0:18929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x6:0x0]: returning size 16384 00000004:00200000:3.0:1789518308.585672:0:18929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518308.585689:0:18929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782fb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.585725:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf4e expref: 48 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.585741:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782fb0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf4e expref: 47 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.585762:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:3.0:1789518308.585765:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518308.585768:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd600, rc 0) 00000100:00100000:3.0:1789518308.585826:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+47:18284:x1876445617106944:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 383us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518308.585831:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:1.0:1789518308.588275:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.592278:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.592364:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617107328 00000100:00100000:3.0:1789518308.592376:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617107328 00000100:00100000:3.0:1789518308.592494:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:3.0:1789518308.592510:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+48:18284:x1876445617107328:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518308.592536:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.592560:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782fd3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf5c expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.592749:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.592767:0:18929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782fcc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf55 expref: 49 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.592778:0:18929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.592833:0:18929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782fcc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf55 expref: 49 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.592853:0:18929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782fcc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf55 expref: 49 pid: 18928 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.592880:0:18929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18929:1876445627533568:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518308.593013:0:18929:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd807a180 going to sleep for 11 seconds 00010000:00010000:3.0:1789518308.596604:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c782fcc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf55 expref: 49 pid: 18928 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.596648:0:18929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18929:1876445627533568:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518308.596679:0:18929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.596691:0:18929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.596697:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518308.596733:0:18929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789518308.596953:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c782fd3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf5c expref: 50 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.596971:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf5c expref: 49 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.596980:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:3.0:1789518308.596983:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518308.596986:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bca00, rc 0) 00000100:00100000:3.0:1789518308.597050:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+49:18284:x1876445617107328:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 4546us (4784us total) trans 12884902003 rc 0/0 00000100:00100000:3.0:1789518308.597089:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:1.0:1789518308.639178:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617107712 00000100:00100000:1.0:1789518308.639191:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617107712 00000100:00100000:1.0:1789518308.639265:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:1.0:1789518308.639277:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+49:18294:x1876445617107712:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518308.639311:0:20802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518308.639338:0:20802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782fe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf63 expref: -99 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.641325:0:20802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782fef lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.641351:0:20802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782fef lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.641365:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782fef lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518308.641404:0:20802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x6:0x0]: returning size 16384 00010000:00010000:1.0:1789518308.642513:0:20802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c782fe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf63 expref: 52 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.642543:0:20802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782fef lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf63 expref: 51 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.642552:0:20802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:1.0:1789518308.642554:0:20802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789518308.642559:0:20802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45600, rc 0) 00000100:00100000:1.0:1789518308.643285:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+51:18294:x1876445617107712:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 4003us (4308us total) trans 12884902004 rc 0/0 00000100:00100000:1.0:1789518308.643298:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:1.0:1789518308.647416:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.688043:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617107968 00000100:00100000:3.0:1789518308.688057:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617107968 00000100:00100000:3.0:1789518308.688810:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:3.0:1789518308.688826:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+51:18297:x1876445617107968:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518308.688852:0:18928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.688878:0:18928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c783012 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf6a expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.688955:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.688972:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.688986:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.689003:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.689010:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.689017:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.689136:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.689184:0:18928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf5c expref: 52 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.689193:0:18928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.689233:0:18928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf5c expref: 52 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.689247:0:18928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf5c expref: 52 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.689275:0:18928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627533696:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518308.689404:0:18928:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfdfd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518308.693486:0:18928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627533696:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518308.693523:0:18928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518308.699659:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617108352 00000100:00100000:1.0:1789518308.699715:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617108352 00010000:00010000:1.0:1789518308.699757:0:18912:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf5c expref: 54 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518308.699908:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:1.0:1789518308.699919:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+54:2343:x1876445617108352:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518308.699934:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518308.699941:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf5c expref: 54 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.699954:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf5c expref: 54 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.699990:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c782fda lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf5c expref: 54 pid: 18929 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.700013:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:1.0:1789518308.700018:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.700028:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.700035:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518308.700069:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518308.700131:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+53:2343:x1876445617108352:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 214us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518308.700138:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00010000:00010000:3.0:1789518308.700215:0:18928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700223:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518308.700277:0:18928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789518308.700281:0:18928:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518308.700300:0:18928:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700324:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700335:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700341:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700347:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700353:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.700357:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700365:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700444:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:3.0:1789518308.700448:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.700452:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700458:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783019 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700471:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700477:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700488:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700494:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518308.700497:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700504:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700512:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0xa340e02b (ffff99ffe6f98300) 00010000:00010000:3.0:1789518308.700515:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518308.700518:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700524:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783020 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700557:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c783012 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf6a expref: 53 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700567:0:18928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf6a expref: 52 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.700572:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:3.0:1789518308.700573:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518308.700575:0:18928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:3.0:1789518308.700699:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+52:18297:x1876445617107968:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 11879us (12946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518308.700718:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:3.0:1789518308.930694:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617108608 00000100:00100000:3.0:1789518308.930803:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617108608 00000100:00100000:3.0:1789518308.930923:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:3.0:1789518308.930936:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+52:18338:x1876445617108608:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518308.930970:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.930997:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c78302e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf71 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.931132:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783035 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.931162:0:18929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf6a expref: 53 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.931173:0:18929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783035 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.931223:0:18929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf6a expref: 53 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.931239:0:18929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783027 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf6a expref: 53 pid: 18928 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518308.931254:0:18929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18929:1876445627533824:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518308.931454:0:18929:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfdfd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518308.935704:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.935854:0:18929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18929:1876445627533824:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518308.936031:0:18929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783035 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.936641:0:18929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783035 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.936650:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783035 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518308.936674:0:18929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789518308.938475:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c78302e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf71 expref: 54 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.938533:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783035 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf71 expref: 53 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.938543:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:3.0:1789518308.938546:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518308.938555:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:3.0:1789518308.938659:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+53:18338:x1876445617108608:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 7723us (8540us total) trans 12884902006 rc 0/0 00000100:00100000:3.0:1789518308.938669:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:1.0:1789518308.948277:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518308.965927:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518308.966290:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617109376 00000100:00100000:3.0:1789518308.966306:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617109376 00000100:00100000:3.0:1789518308.966393:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:3.0:1789518308.966404:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+53:18338:x1876445617109376:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:3.0:1789518308.966889:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c783058 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.966931:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c783058 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.966945:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c783058 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518308.967349:0:18927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].4, 136 off8736 00000100:00100000:3.0:1789518308.967466:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+53:18338:x1876445617109376:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 1061us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518308.967476:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:3.0:1789518308.971517:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617109504 00000100:00100000:3.0:1789518308.971533:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617109504 00000100:00100000:3.0:1789518308.971689:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:3.0:1789518308.971713:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+53:18338:x1876445617109504:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518308.971752:0:18928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518308.971778:0:18928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78305f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf7f expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.971850:0:18928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c783058 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.971862:0:18928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78305f lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf7f expref: 54 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.971885:0:18928:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c783058 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.971901:0:18928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78305f lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf7f expref: 54 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.971935:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:3.0:1789518308.971939:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518308.971944:0:18928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78305f lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf7f expref: 54 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518308.971953:0:18928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:3.0:1789518308.972038:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+54:18338:x1876445617109504:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 338us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518308.972046:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:3.0:1789518309.370671:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617109632 00000100:00100000:3.0:1789518309.370690:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617109632 00000100:00100000:3.0:1789518309.370798:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:3.0:1789518309.370812:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+55:18340:x1876445617109632:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518309.370866:0:18927:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518309.371006:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+55:18340:x1876445617109632:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 196us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.371014:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:1.0:1789518309.371258:0:18963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18963:1876445627533952:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518309.379132:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518309.379375:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617110016 00000100:00100000:3.0:1789518309.379383:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617110016 00000100:00100000:3.0:1789518309.379503:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:3.0:1789518309.379513:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+54:18340:x1876445617110016:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518309.379531:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518309.379550:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78307b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf86 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379681:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379696:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379707:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518309.379722:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789518309.379812:0:18927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379821:0:18927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379827:0:18927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379832:0:18927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518309.379899:0:18927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379909:0:18927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379921:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc9af7300) 00010000:00010000:3.0:1789518309.379924:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518309.379929:0:18927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379945:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783082 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379983:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78307b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf86 expref: 56 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.379993:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc9af7600) 00010000:00010000:3.0:1789518309.379996:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518309.380000:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78307b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf86 expref: 56 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.380008:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bdc00, rc 0) 00000100:00100000:3.0:1789518309.380062:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+55:18340:x1876445617110016:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 550us (938us total) trans 12884902008 rc 301/301 00000100:00100000:3.0:1789518309.380069:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:1.0:1789518309.387344:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518309.387436:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617110144 00000100:00100000:3.0:1789518309.387446:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617110144 00000100:00100000:3.0:1789518309.387542:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:3.0:1789518309.387553:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+55:18340:x1876445617110144:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518309.387610:0:18928:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518309.387758:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+55:18340:x1876445617110144:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 207us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.387766:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:3.0:1789518309.392190:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617110400 00000100:00100000:3.0:1789518309.392199:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617110400 00000100:00100000:3.0:1789518309.392253:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:3.0:1789518309.392274:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+55:18340:x1876445617110400:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518309.392295:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518309.392298:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518309.392322:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c782fb0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf4e expref: 55 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.392342:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:3.0:1789518309.392346:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518309.392365:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c783090 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf8d expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518309.392923:0:18929:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x43:0x0], index 1: 0 00010000:00010000:3.0:1789518309.393109:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783097 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.393122:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783097 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.393132:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783097 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.393191:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c783090 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf8d expref: 57 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.393208:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd800/0x631fd8698c783097 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf8d expref: 56 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.393216:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff99ffe6f98300) 00010000:00010000:3.0:1789518309.393219:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518309.393232:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd800, rc 0) 00000100:00100000:3.0:1789518309.393469:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+56:18340:x1876445617110400:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1195us (1451us total) trans 12884902009 rc 0/0 00000100:00100000:3.0:1789518309.393478:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:1.0:1789518309.399994:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518309.412472:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617111040 00000100:00100000:3.0:1789518309.412485:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617111040 00000100:00100000:3.0:1789518309.412657:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:3.0:1789518309.412670:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+56:18340:x1876445617111040:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518309.412793:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c7830c1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.412827:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c7830c1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.412843:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c7830c1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518309.413384:0:18928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].3, 88 off8432 00000004:00080000:3.0:1789518309.413397:0:18928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363409782259ns, next at 364409779586ns, rc = 0 00000004:00010000:3.0:1789518309.413498:0:18928:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ad2b1e0 reply state 000000009f927aa0 transno 12884902010 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c7830c1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518309.413509:0:18928:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518309.413679:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+58:18340:x1876445617111040:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1010us (1322us total) trans 12884902010 rc 0/0 00000100:00100000:3.0:1789518309.413688:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:3.0:1789518309.417995:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617111168 00000100:00100000:3.0:1789518309.418005:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617111168 00000100:00100000:3.0:1789518309.418062:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:3.0:1789518309.418070:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+57:18340:x1876445617111168:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518309.418116:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518309.418142:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7830c8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcf9b expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.418226:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7830c8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf9b expref: 58 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.418242:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7830c8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf9b expref: 58 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.418264:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff99ffc2ad3200) 00010000:00010000:3.0:1789518309.418267:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518309.418272:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd600, rc 0) 00000100:00100000:3.0:1789518309.418362:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+58:18340:x1876445617111168:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 291us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.418370:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:1.0:1789518309.420495:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518309.423726:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518309.426377:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617111808 00000100:00100000:1.0:1789518309.426394:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617111808 00000100:00100000:1.0:1789518309.426444:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:1.0:1789518309.426453:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+59:18340:x1876445617111808:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518309.426591:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+59:18340:x1876445617111808:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 139us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518309.426596:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:1.0:1789518309.428691:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518309.433571:0:19931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617112064 00000100:00100000:1.0:1789518309.433585:0:19931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617112064 00000100:00100000:1.0:1789518309.433816:0:19931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518309.433840:0:19931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2342:x1876445617112064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518309.433864:0:19931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518309.433889:0:19931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c7830dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcfa9 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518309.433923:0:19931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e1e6, blocks: 0x1 00010000:00010000:1.0:1789518309.433949:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1789518309.433955:0:19931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518309.433970:0:19931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c7830dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfa9 expref: 8 pid: 19931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.433991:0:19931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c7830dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfa9 expref: 8 pid: 19931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.434007:0:19931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44400, rc 0) 00000100:00100000:1.0:1789518309.434415:0:19931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2342:x1876445617112064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 578us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518309.434442:0:19931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1789518309.436495:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617112320 00000100:00100000:3.0:1789518309.436508:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617112320 00000100:00100000:3.0:1789518309.436576:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:3.0:1789518309.436587:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+60:18340:x1876445617112320:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789518309.436730:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+60:18340:x1876445617112320:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 145us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.436739:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:3.0:1789518309.438608:0:19615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617112448 00000100:00100000:3.0:1789518309.438659:0:19615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617112448 00000100:00100000:3.0:1789518309.438767:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1789518309.438776:0:19615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:18340:x1876445617112448:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518309.438812:0:19615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518309.438833:0:19615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcfb0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.438869:0:19615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c7830dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfa9 expref: 9 pid: 19931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.438880:0:19615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518309.438886:0:19615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518309.438895:0:19615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb0 expref: 9 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.438938:0:19615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c7830dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfa9 expref: 9 pid: 19931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.438958:0:19615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c7830dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfa9 expref: 9 pid: 19931 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518309.439006:0:19615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19615:1876445627534080:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518309.439105:0:19615:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd807a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789518309.441308:0:19615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19615:1876445627534080:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518309.441351:0:19615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb0 expref: 9 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.441375:0:19615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bde00, rc 0) 00000100:00100000:3.0:1789518309.441461:0:19615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+9:18340:x1876445617112448:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2684us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.441472:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518309.446534:0:19621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617112704 00000100:00100000:1.0:1789518309.446546:0:19621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617112704 00002000:00100000:1.0:1789518309.446602:0:19621:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x43:0x0] (0->1023) req@ffff99ffff667800 x1876445617112704/t0(0) o4->6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f@192.168.206.51@tcp:710/0 lens 1512/0 e 0 to 0 dl 1789518320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518309.446632:0:19621:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff667800 with x1876445617112704 ext(0->1023) 00002000:00010000:1.0:1789518309.446638:0:19621:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff667800 00000100:00100000:1.0:1789518309.446664:0:19621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518309.446675:0:19621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2343:x1876445617112704:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518309.447263:0:19621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+10:2343:x1876445617112704:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 587us (932us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789518309.447272:0:19621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00002000:00100000:1.0:1789518309.447279:0:19621:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x43:0x0] (0->1023) req@ffff99ffff667800 x1876445617112704/t12884901896(0) o4->6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f@192.168.206.51@tcp:710/0 lens 1512/448 e 0 to 0 dl 1789518320 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518309.447288:0:19621:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff667800 with x1876445617112704 ext(0->1023) 00002000:00010000:1.0:1789518309.447293:0:19621:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff667800 00000100:00100000:3.0:1789518309.451669:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617112832 00000100:00100000:3.0:1789518309.451683:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617112832 00000001:00080000:3.0:1789518309.478393:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902011 is committed 00000020:00080000:3.0:1789518309.478475:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934630 batchid updated 00000004:00080000:3.0:1789518309.478510:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789518309.478523:0:18966:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934630 00000004:00080000:3.0:1789518309.478610:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789518309.478648:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc2d02f00 refcount 2 committed 0 result 0 batchid 8589934631 00000020:00080000:3.0:1789518309.478652:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff491c600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc2d029c0 00000020:00080000:3.0:1789518309.478654:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff491c700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffe004bc00 00000020:00080000:1.0:1789518309.478791:0:18966:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934631 committed batchid 8589934630 00000020:00080000:1.0:1789518309.479258:0:18966:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934630 00000100:00100000:3.0:1789518309.479649:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627534464:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789518309.479865:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627534336 00000100:00100000:3.0:1789518309.479874:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627534336 00000100:00100000:3.0:1789518309.480122:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789518309.480136:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627534336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789518309.480365:0:19614:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1789518309.480370:0:19614:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb mtime from disk: 0 -> 1789518310 00002000:00010000:3.0:1789518309.480374:0:19614:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789518309.480377:0:19614:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb ctime from disk: 1789518310 -> 1789518310 00002000:00010000:3.0:1789518309.480383:0:19614:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789518309.480442:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627534336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 309us (698us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1789518309.480455:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789518309.480727:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518309.480797:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789518309.480893:0:21040:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518309.480905:0:21040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0105f54/0x631fd8698c7830eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.480922:0:21040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518309.480928:0:21040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0105f54/0x631fd8698c7830eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.480938:0:21040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0105f54/0x631fd8698c7830eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.480961:0:21040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0105f54/0x631fd8698c7830eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.480975:0:21040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0105f54/0x631fd8698c7830eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.481009:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518309.481011:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518309.481267:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789518309.481481:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff7881180/2, rc 0, transno 12884901899 00000100:00100000:3.0:1789518309.481486:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627534464:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789518309.492813:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4b3836a-38c9-4257-b2e7-4883536aaaca:3281:1876445627534720:0@lo:400:kworker.0 00000100:00100000:1.0:1789518309.492864:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627534848:0@lo:400:kworker.0 00000100:00100000:3.0:1789518309.492903:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518309.493007:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518309.493307:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627534848:0@lo:400:kworker.0 00000100:00100000:1.0:1789518309.493339:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518309.493347:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627534976:0@lo:400:kworker.0 00000100:00100000:1.0:1789518309.493386:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518309.493567:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789518309.493580:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627534976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518309.493686:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627534720 00000100:00100000:3.0:1789518309.493693:0:18920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627534720 00000100:00100000:1.0:1789518309.493696:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627534976:12345-0@lo:400:kworker.0 Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.493742:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789518309.493751:0:18920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4b3836a-38c9-4257-b2e7-4883536aaaca+19:3281:x1876445627534720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518309.493817:0:18920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a4b3836a-38c9-4257-b2e7-4883536aaaca+19:3281:x1876445627534720:12345-0@lo:400:kworker.0 Request processed in 67us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.493825:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789518309.493942:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4b3836a-38c9-4257-b2e7-4883536aaaca:3281:1876445627534720:0@lo:400:kworker.0 00000100:00100000:1.0:1789518309.494010:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789518309.494040:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789518309.494050:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627535104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518309.494136:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627535104:12345-0@lo:400:kworker.0 Request processed in 90us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518309.494141:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789518309.494244:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627534976:0@lo:400:kworker.0 00000100:00100000:1.0:1789518309.494274:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627535104:0@lo:400:kworker.0 00000001:00080000:1.0:1789518309.512306:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000100:00100000:3.0:1789518309.512657:0:19615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2343:x1876445617112960:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 29144us (29382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.512670:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518309.518251:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617113216 00000100:00100000:3.0:1789518309.518264:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617113216 00000100:00100000:3.0:1789518309.518353:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:3.0:1789518309.518366:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+20:18340:x1876445617113216:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518309.518437:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518309.518473:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c7830d6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfa2 expref: 20 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.518497:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff99ffc2ad3200) 00010000:00010000:3.0:1789518309.518503:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518309.518542:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.518560:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.518572:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518309.518981:0:18929:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053a89eb6 reply state 00000000e29213f0 transno 12884902012 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518309.519008:0:18929:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518309.519169:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+21:18340:x1876445617113216:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 795us (1361us total) trans 12884902012 rc 0/0 00000100:00100000:3.0:1789518309.519180:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00010000:00010000:1.0:1789518309.525065:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.525089:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.525099:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.525106:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518309.525204:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.525215:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.525237:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff99ffc2ad3200) 00010000:00010000:1.0:1789518309.525240:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518309.525247:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.525255:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7830f2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518309.525926:0:19931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617113344 00000100:00100000:1.0:1789518309.525937:0:19931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617113344 00000100:00100000:1.0:1789518309.526024:0:19931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:1.0:1789518309.526032:0:19931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2342:x1876445617113344:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789518309.526345:0:19931:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:1.0:1789518309.526349:0:19931:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb mtime from disk: 1789518310 -> 1789518309 00002000:00010000:1.0:1789518309.526352:0:19931:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb atime from disk: 0 -> 1789518308 00002000:00010000:1.0:1789518309.526354:0:19931:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb ctime from disk: 1789518310 -> 1789518309 00002000:00010000:1.0:1789518309.526357:0:19931:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789518309.526435:0:19931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2342:x1876445617113344:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 402us (585us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1789518309.526443:0:19931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:3.0:1789518309.535173:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518309.540765:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617113856 00000100:00100000:3.0:1789518309.540779:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617113856 00000100:00100000:3.0:1789518309.540888:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1789518309.540901:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2343:x1876445617113856:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789518309.540960:0:19614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.540996:0:19614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb0 expref: 8 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.541006:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518309.541011:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518309.541016:0:19614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.541059:0:19614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb0 expref: 8 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.541087:0:19614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb0 expref: 8 pid: 19615 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518309.541129:0:19614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:19614:1876445627535360:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518309.541246:0:19614:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518309.544194:0:19614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:19614:1876445627535360:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518309.544238:0:19614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518309.545907:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617113984 00000100:00100000:1.0:1789518309.545918:0:18914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617113984 00010000:00010000:1.0:1789518309.545967:0:18914:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb0 expref: 9 pid: 19615 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518309.546024:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1789518309.546035:0:18914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+9:2343:x1876445617113984:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518309.546057:0:18914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518309.546096:0:18914:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb0 expref: 9 pid: 19615 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.546113:0:18914:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb0 expref: 9 pid: 19615 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.546154:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005603f09/0x631fd8698c7830e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb0 expref: 9 pid: 19615 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.546177:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518309.546181:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518309.546188:0:18914:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.546199:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.546243:0:18914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518309.546308:0:18914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2343:x1876445617113984:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 274us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518309.546315:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00010000:00010000:3.0:1789518309.546534:0:19614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.546546:0:19614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.547346:0:19614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.547363:0:19614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.547373:0:19614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.547382:0:19614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518309.547387:0:19614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.547397:0:19614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.547437:0:19614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.547445:0:19614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c783100 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518309.547604:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2343:x1876445617113856:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 6702us (7093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.547636:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:1.0:1789518309.549766:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617114240 00000100:00100000:1.0:1789518309.549778:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617114240 00000100:00100000:1.0:1789518309.549857:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:1.0:1789518309.549869:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+19:18340:x1876445617114240:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518309.549965:0:20802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c783107 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.549985:0:20802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c783107 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.549998:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c783107 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.550284:0:20802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78310e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.550297:0:20802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7830c8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf9b expref: 20 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.550306:0:20802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78310e lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.550349:0:20802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7830c8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf9b expref: 20 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.550387:0:20802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7830c8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf9b expref: 20 pid: 18927 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518309.550404:0:20802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20802:1876445627535488:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518309.550715:0:20802:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aed6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789518309.555527:0:20802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd600/0x631fd8698c7830c8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf9b expref: 20 pid: 18927 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518309.555753:0:20802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20802:1876445627535488:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518309.555784:0:20802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78310e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.555794:0:20802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78310e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.555800:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78310e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518309.556008:0:20802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902013 00000001:00080000:1.0:1789518309.556202:0:20802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902014 00000001:00080000:1.0:1789518309.556248:0:20802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902015 00000100:00100000:1.0:1789518309.556326:0:20802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20802:1876445627535616:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518309.557075:0:20802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518309.557175:0:20802:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aed300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518309.560020:0:20802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20802:1876445627535744:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518309.565815:0:18930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617114496 00000100:00100000:1.0:1789518309.565824:0:18930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617114496 00000100:00100000:1.0:1789518309.565872:0:18930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:1.0:1789518309.565888:0:18930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+23:18338:x1876445617114496:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:1.0:1789518309.565994:0:18930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+23:18338:x1876445617114496:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 108us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518309.566001:0:18930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1789518309.571426:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617114880 00000100:00100000:3.0:1789518309.571434:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617114880 00000100:00100000:3.0:1789518309.571487:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:3.0:1789518309.571497:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:18338:x1876445617114880:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518309.571511:0:19616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518309.571542:0:19616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78311c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcfb7 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518309.571574:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43:0x0] initial LVB size: 1024, mtime: 0x6aa9e1e5, atime: 0x6aa9e1e4, ctime: 0x6aa9e1e5, blocks: 0xb 00010000:00010000:3.0:1789518309.571599:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1789518309.571605:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518309.571656:0:19616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78311c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb7 expref: 8 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.571693:0:19616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78311c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb7 expref: 8 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.571722:0:19616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:3.0:1789518309.571799:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:18338:x1876445617114880:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 302us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.571814:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00010000:00010000:3.0:1789518309.572082:0:18916:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518309.572088:0:18916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c783123 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.572096:0:18916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518309.572101:0:18916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c783123 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.572111:0:18916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c783123 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.572126:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff99ffc2ad3800) 00010000:00010000:3.0:1789518309.572129:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518309.572135:0:18916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c783123 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.572142:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c783123 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.572179:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518309.572182:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518309.572190:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518309.586122:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617115264 00000100:00100000:1.0:1789518309.586132:0:18914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617115264 00010000:00010000:1.0:1789518309.586189:0:18914:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78311c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb7 expref: 9 pid: 19616 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518309.586236:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:1.0:1789518309.586247:0:18914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+9:2342:x1876445617115264:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518309.586266:0:18914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518309.586294:0:18914:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78311c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb7 expref: 9 pid: 19616 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.586309:0:18914:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78311c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb7 expref: 9 pid: 19616 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.586337:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78311c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfb7 expref: 9 pid: 19616 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.586357:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518309.586362:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518309.586367:0:18914:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.586403:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.586438:0:18914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518309.586646:0:19615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.586660:0:19615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.586692:0:19615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.586702:0:19615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.586712:0:19615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.586721:0:19615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518309.586727:0:19615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.586739:0:19615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.586754:0:19615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.586763:0:19615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c78312a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518309.586783:0:18914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2342:x1876445617115264:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 535us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518309.586794:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1789518309.586849:0:19615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2343:x1876445617115136:12345-192.168.206.51@tcp:1:lfs.500 Request processed in 6425us (6935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518309.586859:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:3.0:1789518309.593684:0:21417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:21417:1876445627536128:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518309.593731:0:21417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c783131 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.596205:0:21417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c783131 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518309.596222:0:21417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c783131 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21417 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518309.596389:0:21417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902022 00000100:00100000:3.0:1789518309.597961:0:21417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:21417:1876445627536256:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1789518309.598849:0:21417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902024 00000100:00100000:1.0:1789518309.599449:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627536384 00000100:00100000:1.0:1789518309.599468:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627536384 00000100:00100000:1.0:1789518309.599532:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518309.599542:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21417:x1876445627536384:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789518309.600910:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:21417:x1876445627536384:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 1363us (1612us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1789518309.600923:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518309.606918:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518309.606971:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617115776 00000100:00100000:1.0:1789518309.606983:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617115776 00000100:00100000:1.0:1789518309.607055:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:1.0:1789518309.607067:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+31:18338:x1876445617115776:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518309.607100:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518309.607130:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783138 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcfbe expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.607220:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783138 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfbe expref: 32 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.607265:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783138 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfbe expref: 32 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.607291:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518309.607294:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518309.607298:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45a00, rc 0) 00000100:00100000:1.0:1789518309.607366:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+32:18338:x1876445617115776:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 301us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518309.607373:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:1.0:1789518309.611830:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617116032 00000100:00100000:1.0:1789518309.611843:0:18931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617116032 00000100:00100000:1.0:1789518309.611953:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1789518309.611965:0:18931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+32:18338:x1876445617116032:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:1.0:1789518309.612415:0:18931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+33:18338:x1876445617116032:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 451us (988us total) trans 12884902028 rc 0/0 00000100:00100000:1.0:1789518309.612424:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:3.0:1789518309.661111:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518309.662942:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666165:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666186:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518309.666275:0:18929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666330:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78313f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666338:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78313f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666346:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78313f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666352:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518309.666357:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78313f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666365:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78313f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666379:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:1.0:1789518309.666382:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518309.666387:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78313f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666399:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78313f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666419:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c783146 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666436:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c783146 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666443:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c783146 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666456:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518309.666459:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c783146 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666466:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c783146 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666475:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0xa340e02b (ffff99ffc2ad3100) 00010000:00010000:1.0:1789518309.666477:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518309.666480:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c783146 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666485:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c783146 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666518:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666528:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666534:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666540:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518309.666542:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666548:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666566:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518309.666568:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518309.666571:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.666577:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78314d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518309.667131:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+33:18350:x1876445617116160:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 5825us (6027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518309.667155:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:3.0:1789518309.711421:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518309.720784:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518309.720877:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617116672 00000100:00100000:1.0:1789518309.720889:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617116672 00000100:00100000:1.0:1789518309.721017:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:1.0:1789518309.721029:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+35:18356:x1876445617116672:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518309.721055:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518309.721081:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78317e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcfd3 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.721260:0:18927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783185 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.721276:0:18927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c783177 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfcc expref: 36 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.721286:0:18927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783185 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.721495:0:18927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c783177 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfcc expref: 36 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.721525:0:18927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c783177 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfcc expref: 36 pid: 20802 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518309.721540:0:18927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18927:1876445627536512:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518309.721758:0:18927:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aed600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518309.723929:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518309.724031:0:18927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd0791500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18927:1876445627536512:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518309.724065:0:18927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783185 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.725731:0:18927:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783185 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.725743:0:18927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783185 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518309.725777:0:18927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x7:0x0]: returning size 1024 00010000:00010000:1.0:1789518309.726381:0:18927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78317e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfd3 expref: 37 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.726405:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783185 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfd3 expref: 36 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.726415:0:18927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518309.726418:0:18927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789518309.726421:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44200, rc 0) 00000100:00100000:1.0:1789518309.726491:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+36:18356:x1876445617116672:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 5464us (5721us total) trans 12884902029 rc 0/0 00000100:00100000:1.0:1789518309.726515:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:3.0:1789518309.729058:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518309.729258:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617117056 00000100:00100000:1.0:1789518309.729270:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617117056 00000100:00100000:1.0:1789518309.729535:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518309.729548:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+36:18356:x1876445617117056:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:1.0:1789518309.729567:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518309.729595:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783138 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfbe expref: 36 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518309.729635:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518309.729641:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518309.729708:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+35:18356:x1876445617117056:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 163us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518309.729716:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518309.735351:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.003508:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518310.003673:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627536640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518310.003736:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518310.004205:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627536640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518310.585530:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.585664:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617117440 00000100:00100000:1.0:1789518310.585672:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617117440 00000100:00100000:1.0:1789518310.585729:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:1.0:1789518310.585737:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+36:18357:x1876445617117440:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518310.585781:0:18929:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518310.586415:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+36:18357:x1876445617117440:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 675us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.586442:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:3.0:1789518310.590262:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.596843:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.601078:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.606296:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.606942:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617118208 00000100:00100000:1.0:1789518310.606951:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617118208 00000100:00100000:1.0:1789518310.607175:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:1.0:1789518310.607186:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+37:18357:x1876445617118208:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518310.607204:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518310.607207:0:18929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518310.607233:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78315b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfc5 expref: 37 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.607251:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:1.0:1789518310.607256:0:18929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518310.607269:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c7831cb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcfe8 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518310.608925:0:18929:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x44:0x0], index 0: 0 00010000:00010000:1.0:1789518310.609235:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c7831d2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.609250:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c7831d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.609262:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c7831d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.609333:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c7831cb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfe8 expref: 39 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.609370:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c7831d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfe8 expref: 38 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.609379:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xc:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:1.0:1789518310.609382:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518310.609386:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45400, rc 0) 00000100:00100000:1.0:1789518310.609455:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+38:18357:x1876445617118208:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2269us (3165us total) trans 12884902031 rc 0/0 00000100:00100000:1.0:1789518310.609463:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:3.0:1789518310.613551:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.626920:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.629936:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.630010:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617118976 00000100:00100000:3.0:1789518310.630018:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617118976 00000100:00100000:3.0:1789518310.630078:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:3.0:1789518310.630088:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+39:18357:x1876445617118976:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518310.630108:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518310.630123:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783203 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcff6 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.630186:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783203 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcff6 expref: 40 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.630200:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783203 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcff6 expref: 40 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.630218:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xc:0x0].0x0 (ffff99ffd1b0c900) 00010000:00010000:3.0:1789518310.630221:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518310.630224:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bcc00, rc 0) 00000100:00100000:3.0:1789518310.630278:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+40:18357:x1876445617118976:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 192us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518310.630285:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:3.0:1789518310.633028:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00080000:1.0:1789518310.633377:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518310.636181:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.638739:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.641908:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.642006:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617119744 00000100:00100000:1.0:1789518310.642015:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617119744 00000100:00100000:1.0:1789518310.642068:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:1.0:1789518310.642077:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+41:18357:x1876445617119744:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518310.642095:0:18929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518310.642113:0:18929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c78320a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfcffd expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.642187:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783211 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.642202:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783211 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.642228:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783211 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518310.642262:0:18929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518310.642278:0:18929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783211 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.642305:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c78320a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcffd expref: 43 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.642322:0:18929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783211 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcffd expref: 42 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.642329:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xc:0x0].0x0 (ffff99ffd1b0c900) 00010000:00010000:1.0:1789518310.642332:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518310.642335:0:18929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44e00, rc 0) 00000100:00100000:1.0:1789518310.642396:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+42:18357:x1876445617119744:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 320us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.642403:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:1.0:1789518310.644952:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.645124:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617119872 00000100:00100000:3.0:1789518310.645132:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617119872 00000100:00100000:3.0:1789518310.645251:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1789518310.645283:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2342:x1876445617119872:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518310.645298:0:19614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518310.645314:0:19614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783218 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd004 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518310.645338:0:19614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e1e7, blocks: 0x1 00010000:00010000:3.0:1789518310.645354:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1789518310.645358:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518310.645367:0:19614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783218 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd004 expref: 9 pid: 19614 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.645382:0:19614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783218 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd004 expref: 9 pid: 19614 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.645394:0:19614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:3.0:1789518310.645451:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+9:2342:x1876445617119872:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 181us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518310.645457:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1789518310.648515:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.655512:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.655679:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617120384 00000100:00100000:1.0:1789518310.655687:0:18914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617120384 00010000:00010000:1.0:1789518310.655725:0:18914:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783218 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd004 expref: 10 pid: 19614 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518310.655796:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518310.655805:0:18914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe00d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+10:2343:x1876445617120384:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518310.655831:0:18914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518310.655853:0:18914:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783218 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd004 expref: 10 pid: 19614 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.655866:0:18914:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783218 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd004 expref: 10 pid: 19614 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.655886:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783218 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd004 expref: 10 pid: 19614 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.655903:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518310.655907:0:18914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518310.655914:0:18914:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c78321f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd00b expref: 9 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.655924:0:18914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c78321f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd00b expref: 9 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.655956:0:18914:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c78321f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd00b expref: 9 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518310.655969:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:18914:1876445627537024:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518310.656037:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aedb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518310.658398:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:18914:1876445627537024:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518310.658419:0:18914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518310.658474:0:18914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe00d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+9:2343:x1876445617120384:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2670us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.658482:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518310.664866:0:19621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617120512 00000100:00100000:1.0:1789518310.664878:0:19621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617120512 00002000:00100000:1.0:1789518310.664934:0:19621:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x44:0x0] (0->1023) req@ffff99ffed744e00 x1876445617120512/t0(0) o4->6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f@192.168.206.51@tcp:711/0 lens 1512/0 e 0 to 0 dl 1789518321 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518310.664942:0:19621:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744e00 with x1876445617120512 ext(0->1023) 00002000:00010000:1.0:1789518310.664948:0:19621:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed744e00 00000100:00100000:1.0:1789518310.664978:0:19621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518310.664985:0:19621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+9:2342:x1876445617120512:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518310.665562:0:19621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+11:2342:x1876445617120512:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 575us (2036us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1789518310.665571:0:19621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00002000:00100000:1.0:1789518310.665579:0:19621:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x44:0x0] (0->1023) req@ffff99ffed744e00 x1876445617120512/t12884901901(0) o4->6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f@192.168.206.51@tcp:711/0 lens 1512/448 e 0 to 0 dl 1789518321 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518310.665587:0:19621:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744e00 with x1876445617120512 ext(0->1023) 00002000:00010000:1.0:1789518310.665592:0:19621:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed744e00 00000100:00100000:3.0:1789518310.668100:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.668232:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617120640 00000100:00100000:1.0:1789518310.668240:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617120640 00000100:00100000:1.0:1789518310.668296:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 183 00000100:00100000:1.0:1789518310.668306:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+42:18357:x1876445617120640:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789518310.699181:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902022 is committed 00000001:00080000:3.0:1789518310.699206:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902031 is committed 00000020:00080000:3.0:1789518310.699241:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934631 batchid updated 00000001:00080000:3.0:1789518310.699265:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902033 is committed 00000004:00080000:3.0:1789518310.699272:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789518310.699328:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc638e240 refcount 2 committed 0 result 0 batchid 8589934632 00000020:00080000:3.0:1789518310.699334:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff420ac00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd8a993c0 00000020:00080000:3.0:1789518310.699337:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff420a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec380d000 00000020:00080000:3.0:1789518310.699353:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff7ac06c0 refcount 2 committed 0 result 0 batchid 8589934633 00000020:00080000:3.0:1789518310.699356:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff491c800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7ac0b40 00000020:00080000:3.0:1789518310.699358:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff491c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffe0005000 00000100:00100000:1.0:1789518310.699999:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+20:18357:x1876445617120640:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 31684us (31895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.700013:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 183 00000004:00080000:1.0:1789518310.700661:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffed745500/2, rc 0, transno 12884901902 00000100:00100000:1.0:1789518310.700667:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627537152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789518310.704535:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617120768 00000100:00100000:3.0:1789518310.704545:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617120768 00000100:00100000:3.0:1789518310.704606:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1789518310.704653:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+11:2343:x1876445617120768:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789518310.730184:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+6:2343:x1876445617120768:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 25563us (26168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518310.730195:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1789518310.734499:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.738702:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.746691:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.747748:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617121536 00000100:00100000:1.0:1789518310.747762:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617121536 00010000:00010000:1.0:1789518310.747803:0:18912:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c7831f5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfef expref: 21 pid: 20802 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518310.747846:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518310.747856:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+21:2342:x1876445617121536:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518310.747869:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518310.747876:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c7831f5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfef expref: 21 pid: 20802 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.747888:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c7831f5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfef expref: 21 pid: 20802 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.747910:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c7831f5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfef expref: 21 pid: 20802 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.747926:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xc:0x0].0x0 (ffff99ffd1b0c900) 00010000:00010000:1.0:1789518310.747931:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c78322d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.747940:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c78322d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.747948:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c78322d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0xc:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.747997:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518310.748057:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+20:2342:x1876445617121536:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 203us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.748064:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:3.0:1789518310.755136:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.759419:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.759543:0:18913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617121792 00000100:00100000:1.0:1789518310.759555:0:18913:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617121792 00010000:00010000:1.0:1789518310.759653:0:18913:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c78321f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd00b expref: 8 pid: 19931 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518310.759706:0:18913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1789518310.759726:0:18913:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2342:x1876445617121792:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518310.759749:0:18913:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518310.759779:0:18913:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c78321f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd00b expref: 8 pid: 19931 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.759795:0:18913:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008fd1f417/0x631fd8698c78321f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd00b expref: 8 pid: 19931 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.759826:0:18913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518310.759831:0:18913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518310.759839:0:18913:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c783234 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.759851:0:18913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c783234 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.759901:0:18913:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518310.760039:0:18913:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+8:2342:x1876445617121792:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 313us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.760055:0:18913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1789518310.762955:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.765868:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.765959:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617122176 00000100:00100000:1.0:1789518310.765968:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617122176 00010000:00010000:1.0:1789518310.766010:0:18912:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783203 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcff6 expref: 21 pid: 18929 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518310.766057:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1789518310.766068:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+21:2342:x1876445617122176:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518310.766085:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518310.766093:0:18912:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783203 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcff6 expref: 21 pid: 18929 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.766107:0:18912:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783203 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcff6 expref: 21 pid: 18929 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.766133:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783203 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcff6 expref: 21 pid: 18929 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.766193:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xc:0x0].0x0 (ffff99ffd1b0c900) 00010000:00010000:1.0:1789518310.766199:0:18912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.766209:0:18912:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.766227:0:18912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.766258:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518310.766289:0:18928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.766299:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518310.766325:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+20:2342:x1876445617122176:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 258us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.766334:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000001:00080000:3.0:1789518310.766533:0:18928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902035 00000001:00080000:3.0:1789518310.766770:0:18928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902036 00000001:00080000:3.0:1789518310.766820:0:18928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902037 00000100:00100000:3.0:1789518310.766911:0:18928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18928:1876445627537664:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518310.766960:0:18928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518310.766990:0:18928:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518310.767321:0:18928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901902 gen 2 00000004:00080000:1.0:1789518310.767329:0:18928:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec2974700, transno 12884901896 00000004:00080000:1.0:1789518310.767393:0:18928:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901898 committed transno 12884901902 00000004:00080000:1.0:1789518310.767413:0:18928:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff7881180, transno 12884901899 00000004:00080000:1.0:1789518310.768106:0:18928:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffed745500, transno 12884901902 00000100:00100000:1.0:1789518310.768120:0:18928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18928:1876445627537664:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789518310.768994:0:18928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902038 00000100:00100000:1.0:1789518310.769073:0:18928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18928:1876445627537792:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789518310.769133:0:18928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518310.769186:0:18928:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518310.769849:0:18928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18928:1876445627537792:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789518310.769943:0:18928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902039 00010000:00010000:1.0:1789518310.769977:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.769989:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.769998:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770016:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518310.770021:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770031:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770048:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xc:0x0].0x0 (ffff99ffd1b0c900) 00010000:00010000:1.0:1789518310.770052:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518310.770058:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770064:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c783242 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770101:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c783193 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770108:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c783193 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770115:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c783193 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770120:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518310.770123:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c783193 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770129:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c783193 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770159:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518310.770161:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518310.770169:0:18928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78319a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfda expref: 24 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770182:0:18928:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78319a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfda expref: 24 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770192:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78319a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfda expref: 24 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.770223:0:18928:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78319a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfda expref: 24 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518310.770236:0:18928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627537920:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518310.770328:0:18928:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518310.772383:0:18928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627537920:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518310.772387:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518310.772416:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c783193 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772428:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c783193 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772465:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772478:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772508:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772520:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772526:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772533:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772539:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518310.772544:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772551:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772563:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518310.772566:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518310.772571:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772577:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783249 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772588:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78323b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772594:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78323b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.772607:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78323b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.773122:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518310.773128:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78323b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.773136:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78323b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.773159:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518310.773161:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518310.773165:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78323b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.773171:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c78323b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518310.773454:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+24:18357:x1876445617122048:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 10188us (10510us total) trans 12884902040 rc 0/0 00000100:00100000:1.0:1789518310.773464:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 186 00000020:00080000:1.0:1789518310.773468:0:18928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1789518310.774858:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.774931:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617122560 00000100:00100000:1.0:1789518310.774941:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617122560 00000100:00100000:1.0:1789518310.775010:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:1.0:1789518310.775020:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+24:18356:x1876445617122560:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:1.0:1789518310.775474:0:18929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].6, 136 off9008 00000100:00100000:1.0:1789518310.775567:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+24:18356:x1876445617122560:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 546us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.775585:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:3.0:1789518310.776002:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518310.777905:0:21040:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518310.777913:0:21040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c783250 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.777922:0:21040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518310.777926:0:21040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c783250 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 21417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.777984:0:21040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c783250 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 21417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.778000:0:21040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xc:0x0].0x0 (ffff99ffc2ad3600) 00010000:00010000:3.0:1789518310.778003:0:21040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518310.778009:0:21040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c783250 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.778015:0:21040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c783250 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 21417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.778033:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518310.778035:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518310.778037:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518310.797781:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.797849:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.797923:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.797959:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.797980:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.798015:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518310.798399:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617123456 00000100:00100000:1.0:1789518310.798404:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617123456 00000100:00100000:1.0:1789518310.798454:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617123072 00000100:00100000:1.0:1789518310.798456:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617123072 00000100:00100000:1.0:1789518310.798467:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617123328 00000100:00100000:1.0:1789518310.798470:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617123328 00000100:00100000:1.0:1789518310.798485:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518310.798492:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2343:x1876445617123456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518310.798523:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2343:x1876445617123456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.798530:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518310.798541:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518310.798547:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2343:x1876445617123072:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518310.798567:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+7:2343:x1876445617123072:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 20us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.798572:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518310.798584:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518310.798589:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2343:x1876445617123328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518310.798643:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2343:x1876445617123328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.798649:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518310.799329:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617123584 00000100:00100000:1.0:1789518310.799334:0:18928:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617123584 00000100:00100000:1.0:1789518310.799373:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518310.799397:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2343:x1876445617123200:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518310.799453:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2343:x1876445617123200:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 58us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518310.799460:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518310.799476:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 188 00000100:00100000:1.0:1789518310.799483:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+26:18359:x1876445617123584:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518310.799500:0:18928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518310.799525:0:18928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783257 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd012 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.799600:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.799642:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.799658:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.799676:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.799683:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.799689:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.799953:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78326c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.799972:0:18928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783185 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfd3 expref: 27 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.799982:0:18928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78326c lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.800018:0:18928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783185 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfd3 expref: 27 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518310.800033:0:18928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783185 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfd3 expref: 27 pid: 18927 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518310.800049:0:18928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627538048:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518310.800110:0:18928:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6aed780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518310.804065:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518310.805170:0:18928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18928:1876445627538048:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518310.805207:0:18928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78326c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808451:0:18928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78326c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808460:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78326c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518310.808519:0:18928:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x7:0x0]: returning size 1024 00000004:00200000:3.0:1789518310.808524:0:18928:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518310.808547:0:18928:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78326c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808562:0:18928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78326c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808586:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808593:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808601:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808639:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518310.808644:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808653:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808664:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:3.0:1789518310.808667:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518310.808671:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808678:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c78325e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808690:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808696:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808702:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808707:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518310.808710:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808716:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808734:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0xa340e02b (ffff99ffc2fdc100) 00010000:00010000:3.0:1789518310.808737:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518310.808740:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808747:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44e00/0x631fd8698c783265 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808788:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783257 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd012 expref: 28 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808803:0:18928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78326c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd012 expref: 27 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518310.808810:0:18928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518310.808813:0:18928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518310.808815:0:18928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45e00, rc 0) 00000100:00100000:3.0:1789518310.808847:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+27:18359:x1876445617123584:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 9364us (10832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518310.808854:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 188 00010000:00010000:3.0:1789518310.898784:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518311.293309:0:21457:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789518311.293317:0:21457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518311.294286:0:21457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:3.0:1789518311.294294:0:21457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789518311.802200:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617124096 00000100:00100000:3.0:1789518311.802210:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617124096 00000100:00100000:3.0:1789518311.802332:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:3.0:1789518311.802371:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+27:18371:x1876445617124096:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518311.802416:0:18929:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518311.802551:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+27:18371:x1876445617124096:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 194us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518311.802560:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:3.0:1789518311.805569:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518311.805827:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617124352 00000100:00100000:1.0:1789518311.805839:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617124352 00000100:00100000:1.0:1789518311.805913:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:1.0:1789518311.805923:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+27:18371:x1876445617124352:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518311.805949:0:20802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518311.805975:0:20802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c783273 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd019 expref: -99 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518311.806113:0:20802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78327a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518311.806143:0:20802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78327a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518311.806176:0:20802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78327a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518311.806190:0:20802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x7:0x0]: returning size 1024 00010000:00010000:1.0:1789518311.806353:0:20802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45400/0x631fd8698c783273 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd019 expref: 30 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518311.806662:0:20802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78327a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd019 expref: 29 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518311.806672:0:20802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518311.806676:0:20802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518311.806680:0:20802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44200, rc 0) 00000100:00100000:1.0:1789518311.806765:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+29:18371:x1876445617124352:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 843us (1210us total) trans 12884902044 rc 0/0 00000100:00100000:1.0:1789518311.806773:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:1.0:1789518311.810667:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518311.811496:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617124480 00000100:00100000:3.0:1789518311.811511:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617124480 00000100:00100000:3.0:1789518311.811601:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518311.811661:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+29:2343:x1876445617124480:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518311.811682:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518311.811712:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78327a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd019 expref: 29 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.811735:0:18912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518311.811741:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518311.811818:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+28:2343:x1876445617124480:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 206us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518311.811825:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518311.813444:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617124736 00000100:00100000:3.0:1789518311.813453:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617124736 00000100:00100000:3.0:1789518311.813508:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00100000:3.0:1789518311.813519:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+28:18371:x1876445617124736:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518311.813637:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.813678:0:18929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.813702:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.813943:0:18929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.813952:0:18929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.813960:0:18929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.813967:0:18929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518311.813972:0:18929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.813981:0:18929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.816026:0:18929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518311.816036:0:18929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518311.816044:0:18929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518311.816054:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c783288 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518311.816586:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+29:18371:x1876445617124736:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 3062us (3229us total) trans 12884902045 rc 0/0 00000100:00100000:3.0:1789518311.816629:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00100000:1.0:1789518311.819240:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617124992 00000100:00100000:1.0:1789518311.819253:0:18931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617124992 00000100:00100000:1.0:1789518311.819378:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:1.0:1789518311.819390:0:18931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+29:18371:x1876445617124992:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518311.819830:0:18931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+30:18371:x1876445617124992:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 439us (704us total) trans 12884902046 rc 0/0 00000100:00100000:1.0:1789518311.819837:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000040:00080000:1.0:1789518312.838169:0:21508:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789518312.838176:0:21508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518312.838241:0:21508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:1.0:1789518312.838248:0:21508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1789518312.947246:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518313.970777:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518314.612762:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518314.612779:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627538560:0@lo:400:kworker.0 00000100:00100000:3.0:1789518314.612824:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518314.612865:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4b3836a-38c9-4257-b2e7-4883536aaaca:3281:1876445627538432:0@lo:400:kworker.0 00000100:00100000:3.0:1789518314.612894:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518314.612922:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518314.612927:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627538944:0@lo:400:kworker.0 00000100:00100000:3.0:1789518314.612953:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518314.612976:0:18922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627538432 00000100:00100000:3.0:1789518314.612980:0:18922:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627538432 00000100:00100000:3.0:1789518314.613009:0:18922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789518314.613018:0:18922:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4b3836a-38c9-4257-b2e7-4883536aaaca+19:3281:x1876445627538432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518314.613060:0:18922:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4b3836a-38c9-4257-b2e7-4883536aaaca+19:3281:x1876445627538432:12345-0@lo:400:kworker.0 Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518314.613066:0:18922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789518314.613099:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a4b3836a-38c9-4257-b2e7-4883536aaaca:3281:1876445627538432:0@lo:400:kworker.0 00000100:00100000:3.0:1789518314.613423:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627538560 00000100:00100000:3.0:1789518314.613427:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627538560 00000100:00100000:3.0:1789518314.613466:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518314.613473:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627538560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518314.613641:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627538944 00000100:00100000:3.0:1789518314.613645:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627538560:12345-0@lo:400:kworker.0 Request processed in 170us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518314.613647:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627538944 00000100:00100000:3.0:1789518314.613667:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789518314.614030:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627538816 00000100:00100000:1.0:1789518314.614035:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627538816 00000100:00100000:3.0:1789518314.614074:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627538560:0@lo:400:kworker.0 00000100:00100000:3.0:1789518314.614108:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518314.614117:0:18928:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627538816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518314.614179:0:18928:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627538816:12345-0@lo:400:kworker.0 Request processed in 62us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518314.614193:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518314.614233:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627538944:0@lo:400:kworker.0 00000100:00100000:3.0:1789518314.614266:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627538688 00000100:00100000:3.0:1789518314.614271:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627538688 00000100:00100000:3.0:1789518314.614300:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518314.614309:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627538688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518314.614345:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627538688:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518314.614352:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000001:00080000:1.0:1789518314.634511:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901899 is committed 00000001:00080000:1.0:1789518314.634529:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901900 is committed 00000001:00080000:1.0:1789518314.634535:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00000100:00100000:1.0:1789518315.126973:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627539072 00000100:00100000:1.0:1789518315.126984:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627539072 00000100:00100000:1.0:1789518315.127046:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518315.127056:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627539072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518315.127095:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518315.127334:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627539072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 279us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518315.127341:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518315.384254:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518315.384338:0:18929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617125120 00000100:00100000:3.0:1789518315.384348:0:18929:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617125120 00000100:00100000:3.0:1789518315.384489:0:18929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 192 00000100:00100000:3.0:1789518315.384500:0:18929:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+30:18211:x1876445617125120:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789518315.384608:0:18929:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+30:18211:x1876445617125120:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 110us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518315.384654:0:18929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 192 00000100:00100000:3.0:1789518315.918800:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518315.918869:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518315.918918:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518315.918957:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518315.918989:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518315.919018:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617126016 00000100:00100000:3.0:1789518315.919023:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617126016 00000100:00100000:3.0:1789518315.919067:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617125632 00000100:00100000:3.0:1789518315.919071:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617125632 00000100:00100000:3.0:1789518315.919094:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518315.919103:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2342:x1876445617126016:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518315.919153:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2342:x1876445617126016:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 50us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518315.919161:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518315.919180:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1789518315.919188:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+31:2342:x1876445617125632:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518315.919221:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+31:2342:x1876445617125632:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518315.919228:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1789518315.919264:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617125760 00000100:00100000:3.0:1789518315.919268:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617125760 00000100:00100000:3.0:1789518315.919297:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617125888 00000100:00100000:3.0:1789518315.919301:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617125888 00000100:00100000:3.0:1789518315.919327:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518315.919337:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+6:2342:x1876445617125760:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518315.919381:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+6:2342:x1876445617125760:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518315.919389:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518315.922471:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518315.922527:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617126144 00000100:00100000:1.0:1789518315.922537:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617126144 00000100:00100000:3.0:1789518315.922547:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518315.922640:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617126272 00000100:00100000:1.0:1789518315.922644:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617126272 00000100:00100000:1.0:1789518315.922672:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518315.922681:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+5:2341:x1876445617126144:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:1.0:1789518315.922707:0:19616:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78278a 00000100:00080000:1.0:1789518315.922721:0:19616:0:(import.c:65:import_set_state_nolock()) ffff99ffdf98d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518315.922756:0:19616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901904 00010000:00010000:3.0:1789518315.922938:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518315.922964:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518315.922999:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+2:2341:x1876445617126144:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 317us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518315.923317:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00010000:00010000:1.0:1789518316.018779:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518316.174870:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf7800/09aecfa0-ca89-4fa7-a2e1-a288af9edd22 for lustre-OST0000 00000020:00000080:1.0:1789518316.174936:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffdf98d800 for lustre-OST0000 00000001:00080000:3.0:1789518316.176578:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902047 is committed 00000020:00080000:3.0:1789518316.176606:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934633 batchid updated 00000020:00080000:3.0:1789518316.176741:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc6aed600 refcount 2 committed 0 result 0 batchid 8589934634 00000020:00080000:3.0:1789518316.176746:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff73d8500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc6aed3c0 00000020:00080000:3.0:1789518316.176750:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff73d8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffe004b000 00000004:00080000:3.0:1789518316.176763:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1789518316.177953:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627539200 00000100:00100000:3.0:1789518316.177962:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627539200 00000100:00100000:3.0:1789518316.178024:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518316.178035:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627539200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789518316.178067:0:19614:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:67 count 1 00002000:00010000:3.0:1789518316.178110:0:19614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x43:0x0] initial LVB size: 1024, mtime: 0x6aa9e1e5, atime: 0x6aa9e1e4, ctime: 0x6aa9e1e5, blocks: 0xb 00010000:00010000:3.0:1789518316.178170:0:19614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78328f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518316.178188:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1789518316.178193:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518316.178198:0:19614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78328f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518316.178213:0:19614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78328f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518316.178236:0:19614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78328f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518316.178245:0:19614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78328f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518316.178270:0:19614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518316.179050:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627539200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1013us (1130us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1789518316.179059:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789518316.179092:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518316.179147:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901900 gen 2 00000004:00080000:3.0:1789518316.179154:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901899 committed transno 12884901900 00000004:00080000:3.0:1789518316.179176:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901900 committed transno 12884901900 00000100:00100000:3.0:1789518316.179197:0:3283:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fff7880380 x1876445627539200/t12884901901(12884901901) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518332 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789518316.179213:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff7880380/2, rc 0, transno 12884901901 00000100:00100000:3.0:1789518316.179220:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627539200:0@lo:6:osp-syn-1-0.0 00000040:00080000:1.0:1789518316.914774:0:18963:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789518316.914781:0:18963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518316.914818:0:18963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:1.0:1789518316.914824:0:18963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1789518317.042732:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518317.414261:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00080000:3.0:1789518317.417724:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518317.964142:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518317.964897:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617126656 00000100:00100000:1.0:1789518317.964912:0:18931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617126656 00000100:00100000:1.0:1789518317.965064:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518317.965076:0:18931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+17:19022:x1876445617126656:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:1.0:1789518317.965547:0:18931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+18:19022:x1876445617126656:12345-192.168.206.51@tcp:35:umount.0 Request processed in 472us (1416us total) trans 12884902048 rc 0/0 00000100:00100000:1.0:1789518317.965556:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00080000:3.0:1789518317.965830:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518317.969407:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518317.973880:0:18931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617127168 00000100:00100000:1.0:1789518317.973893:0:18931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617127168 00000100:00100000:1.0:1789518317.974037:0:18931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1789518317.974050:0:18931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+19:19022:x1876445617127168:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:1.0:1789518317.974925:0:18931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+20:19022:x1876445617127168:12345-192.168.206.51@tcp:35:umount.0 Request processed in 873us (1708us total) trans 12884902050 rc 0/0 00000100:00100000:1.0:1789518317.974935:0:18931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:3.0:1789518317.978377:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518317.978424:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518317.978478:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518317.978571:0:18913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617127552 00000100:00100000:1.0:1789518317.978578:0:18913:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617127552 00000100:00100000:3.0:1789518317.978716:0:21041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518317.978853:0:21041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1cc4376-8c56-40fc-9ce9-2273f67511c3+15:2343:x1876445617127296:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518317.978871:0:21041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518317.978894:0:21041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a00021c7000/0x631fd8698c78264f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc68 expref: 15 pid: 18921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518317.979122:0:21041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518317.979263:0:21041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1cc4376-8c56-40fc-9ce9-2273f67511c3+14:2343:x1876445617127296:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 413us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518317.979274:0:21041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518317.980264:0:18913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518317.980304:0:18913:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe00d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1cc4376-8c56-40fc-9ce9-2273f67511c3+14:2343:x1876445617127552:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518317.980317:0:18913:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518317.980334:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0696c00/0x631fd8698c782982 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcdaa expref: 14 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518317.980349:0:18913:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518317.980388:0:18913:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe00d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1cc4376-8c56-40fc-9ce9-2273f67511c3+13:2343:x1876445617127552:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 101us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518317.980396:0:18913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000020:00010000:1.0:1789518317.980489:0:18915:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fec3868000: total 0 00010000:00010000:1.0:1789518317.980494:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518317.980541:0:18915:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fec3868000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789518317.980596:0:18915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c782dcd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfced0 expref: 4 pid: 19616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518317.980643:0:18915:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fec3868000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789518317.980656:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518317.980658:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518317.980660:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518317.980668:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518317.981489:0:18913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518317.982027:0:18913:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1cc4376-8c56-40fc-9ce9-2273f67511c3+11:2343:x1876445617127424:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518317.982041:0:18913:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518317.982056:0:18913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17600/0x631fd8698c782656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc92 expref: 11 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518317.982066:0:18913:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518317.982144:0:18913:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b1cc4376-8c56-40fc-9ce9-2273f67511c3+10:2343:x1876445617127424:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 647us (3664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518317.982152:0:18913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518317.991863:0:19615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617127936 00000100:00100000:1.0:1789518317.991877:0:19615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617127936 00000100:00100000:1.0:1789518317.992409:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:1.0:1789518317.992423:0:19615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+5:2341:x1876445617127936:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:1.0:1789518317.992475:0:19615:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78266b 00000100:00080000:1.0:1789518317.992488:0:19615:0:(import.c:65:import_set_state_nolock()) ffff99fec183e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518317.992538:0:19615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901904 00000100:00100000:1.0:1789518317.992938:0:19615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f+2:2341:x1876445617127936:12345-192.168.206.51@tcp:9:umount.0 Request processed in 507us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518317.992947:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00080000:3.0:1789518317.993264:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518318.003019:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000020:00010000:3.0:1789518318.003497:0:18916:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fec114e000: total 0 00010000:00010000:3.0:1789518318.004573:0:18916:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fec114e000, canceled 0 locks, left on hash table 12. 00010000:00010000:3.0:1789518318.004629:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:3.0:1789518318.004634:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518318.004645:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c782db8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcec9 expref: 18 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004670:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc9af7700) 00010000:00010000:3.0:1789518318.004673:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518318.004678:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c7827bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcd2c expref: 17 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004699:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99ffc9af7c00) 00010000:00010000:3.0:1789518318.004701:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789518318.004705:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c782894 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcd6b expref: 16 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004753:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99ffc9af7c00) 00010000:00010000:3.0:1789518318.004756:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518318.004760:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c782b73 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce36 expref: 15 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004779:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:3.0:1789518318.004783:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789518318.004787:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697e00/0x631fd8698c782e67 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcef3 expref: 14 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004802:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518318.004805:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518318.004809:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78326c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd012 expref: 13 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004821:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2ad3000) 00010000:00010000:3.0:1789518318.004823:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518318.004827:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c782e28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcee5 expref: 12 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004838:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x6:0x0].0x0 (ffff99ffc2ad3400) 00010000:00010000:3.0:1789518318.004841:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518318.004844:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c782fef lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcf63 expref: 11 pid: 20802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004860:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc9af7600) 00010000:00010000:3.0:1789518318.004867:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518318.004871:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c7827d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcd33 expref: 10 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004884:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:3.0:1789518318.004886:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518318.004889:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c782cbc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfce83 expref: 9 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004898:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x7:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:3.0:1789518318.004899:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518318.004901:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78319a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcfda expref: 8 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004912:0:18916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff99ffc9af7b00) 00010000:00010000:3.0:1789518318.004914:0:18916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518318.004917:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c782d8e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcebb expref: 7 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.004928:0:18916:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fec114e000, canceled 12 locks, left on hash table 0. 00010000:00010000:3.0:1789518318.004940:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518318.004941:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518318.004943:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518318.630377:0:18914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617129216 00000100:00100000:1.0:1789518318.630387:0:18914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617129216 00000100:00100000:3.0:1789518318.630466:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617129344 00000100:00100000:3.0:1789518318.630472:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617129344 00000100:00100000:1.0:1789518318.631865:0:18914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518318.631879:0:18914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1cc4376-8c56-40fc-9ce9-2273f67511c3+11:2343:x1876445617129216:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518318.631891:0:18914:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518318.631906:0:18914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc14da00/0x631fd8698c78276e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfccf4 expref: 11 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518318.631973:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518318.631983:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1cc4376-8c56-40fc-9ce9-2273f67511c3+11:2345:x1876445617129344:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518318.631993:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518318.632018:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697600/0x631fd8698c78297b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcda3 expref: 10 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518318.632034:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518318.632111:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1cc4376-8c56-40fc-9ce9-2273f67511c3+9:2345:x1876445617129344:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 119us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518318.632120:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00010000:00010000:1.0:1789518318.632191:0:18914:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518318.632217:0:18914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b1cc4376-8c56-40fc-9ce9-2273f67511c3+7:2343:x1876445617129216:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 342us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518318.632225:0:18914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518318.634493:0:20802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617129600 00000100:00100000:1.0:1789518318.634520:0:20802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617129600 00000100:00100000:1.0:1789518318.634593:0:20802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:1.0:1789518318.634603:0:20802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+6:2341:x1876445617129600:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:1.0:1789518318.634795:0:20802:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78277c 00000020:00010000:1.0:1789518318.634809:0:20802:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fec1834000: total 0 00000100:00080000:1.0:1789518318.634814:0:20802:0:(import.c:65:import_set_state_nolock()) ffff99fec1834800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518318.634849:0:20802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884902051 00000100:00100000:1.0:1789518318.635259:0:20802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:09aecfa0-ca89-4fa7-a2e1-a288af9edd22+3:2341:x1876445617129600:12345-192.168.206.51@tcp:39:umount.0 Request processed in 654us (830us total) trans 12884902052 rc 0/0 00000100:00100000:1.0:1789518318.635269:0:20802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:3.0:1789518318.648218:0:18921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617129856 00000100:00100000:3.0:1789518318.648231:0:18921:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617129856 00000100:00100000:3.0:1789518318.648352:0:18921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:3.0:1789518318.648364:0:18921:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1cc4376-8c56-40fc-9ce9-2273f67511c3+7:2341:x1876445617129856:12345-192.168.206.51@tcp:251:umount.0 00000020:00000080:3.0:1789518318.648420:0:18921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c782641 00000020:00010000:3.0:1789518318.648430:0:18921:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fec386a800: total 0 00000100:00080000:3.0:1789518318.648435:0:18921:0:(import.c:65:import_set_state_nolock()) ffff99fec386d000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789518318.648535:0:18921:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1cc4376-8c56-40fc-9ce9-2273f67511c3+3:2341:x1876445617129856:12345-192.168.206.51@tcp:251:umount.0 Request processed in 173us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518318.648543:0:18921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000020:00010000:1.0:1789518318.648565:0:18916:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fec386a800: total 0 00010000:00010000:1.0:1789518318.648572:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518318.648654:0:18916:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fec386a800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789518318.648706:0:18916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a00021c6c00/0x631fd8698c782648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfcc61 expref: 2 pid: 18921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518318.648725:0:18916:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fec386a800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789518318.648738:0:18916:0:(genops.c:885:class_export_put()) final put ffff99fec386a800/b1cc4376-8c56-40fc-9ce9-2273f67511c3 00010000:00010000:1.0:1789518318.648751:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518318.648753:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518318.648756:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518318.648767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec386a800/b1cc4376-8c56-40fc-9ce9-2273f67511c3 for MGS 00000020:00000080:1.0:1789518318.648806:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec386d000 for MGS 00000100:00100000:1.0:1789518319.575209:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627539328:0@lo:39:umount.0 00000100:00100000:1.0:1789518319.575277:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.575334:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4b3836a-38c9-4257-b2e7-4883536aaaca:3283:1876445627539456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518319.575370:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518319.575844:0:21041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627539456 00000100:00100000:1.0:1789518319.575849:0:21041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627539456 00010000:00010000:3.0:1789518319.575893:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518319.575902:0:21041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789518319.575911:0:21041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4b3836a-38c9-4257-b2e7-4883536aaaca+19:3283:x1876445627539456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518319.575930:0:21041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518319.575943:0:21041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16400/0x631fd8698c78241f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c782418 expref: 19 pid: 18921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.575955:0:21041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518319.575992:0:21041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4b3836a-38c9-4257-b2e7-4883536aaaca+18:3283:x1876445627539456:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518319.575998:0:21041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518319.576168:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4b3836a-38c9-4257-b2e7-4883536aaaca:3283:1876445627539456:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789518319.576172:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec11e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789518319.576192:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627539328:0@lo:39:umount.0 00010000:00010000:1.0:1789518319.579319:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17200/0x631fd8698c78237e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c782385 expref: -99 pid: 18909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579337:0:21903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17200/0x631fd8698c78237e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c782385 expref: -99 pid: 18909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579344:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17200/0x631fd8698c78237e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c782385 expref: -99 pid: 18909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579350:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17200/0x631fd8698c78237e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c782385 expref: -99 pid: 18909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579374:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518319.579380:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c782633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78263a expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579386:0:21903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c782633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78263a expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579408:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c782633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78263a expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579414:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c782633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78263a expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579432:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789518319.579439:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696800/0x631fd8698c78294a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c782951 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579445:0:21903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696800/0x631fd8698c78294a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c782951 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579451:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696800/0x631fd8698c78294a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c782951 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579458:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffd0696800/0x631fd8698c78294a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c782951 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579472:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789518319.579482:0:21903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c782370 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c782377 expref: -99 pid: 18909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579504:0:21903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c782370 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c782377 expref: -99 pid: 18909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579526:0:21903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c782370 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c782377 expref: -99 pid: 18909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579560:0:21903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c782370 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c782377 expref: -99 pid: 18909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518319.579574:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789518319.579583:0:21903:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789518319.579588:0:21903:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789518319.579635:0:21903:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789518319.579641:0:21903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789518319.579649:0:21903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518319.579655:0:21903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1789518319.579666:0:21903:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99fec386f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518319.579682:0:21903:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99ffee447800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518319.579697:0:21903:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99fec1834000 09aecfa0-ca89-4fa7-a2e1-a288af9edd22 192.168.206.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 12884901895 stale:0 00000020:00080000:1.0:1789518319.579713:0:21903:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99fec114e000 6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f 192.168.206.51@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 12884902047 stale:0 00000020:00080000:1.0:1789518319.579723:0:21903:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff99ffc6513380) has exports, disconnecting them 00000020:00080000:1.0:1789518319.579730:0:21903:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99fec386f000), last request at 1789518314 00000020:00000080:1.0:1789518319.579740:0:21903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c782625 00000100:00080000:1.0:1789518319.579759:0:21903:0:(import.c:65:import_set_state_nolock()) ffff99fec3869800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789518319.579813:0:21903:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fec386f000): rc 0 00000020:00000080:1.0:1789518319.579819:0:21903:0:(genops.c:885:class_export_put()) final put ffff99fec386f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789518319.579833:0:21903:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ffee447800), last request at 1789518314 00000020:00000080:1.0:1789518319.579838:0:21903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7824ce 00000100:00080000:1.0:1789518319.579845:0:21903:0:(import.c:65:import_set_state_nolock()) ffff99ffee440800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789518319.579861:0:21903:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffee447800): rc 0 00000020:00000080:1.0:1789518319.579864:0:21903:0:(genops.c:885:class_export_put()) final put ffff99ffee447800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789518319.579877:0:21903:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa50840d1fae0 00000100:00080000:1.0:1789518319.579900:0:21903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789518319.579904:0:21903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901902 gen 3 00000100:00100000:1.0:1789518319.579913:0:21903:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99fffc5f3b80 x1876445627537792/t12884901904(12884901904) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1789518326 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt00_001.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789518319.579923:0:21903:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901904 committed transno 12884901902 00000004:00080000:1.0:1789518319.579950:0:21903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789518319.580013:0:21903:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789518319.580026:0:21903:0:(import.c:65:import_set_state_nolock()) ffff99fff415e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789518319.580040:0:21903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789518319.580044:0:21903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901900 gen 3 00000100:00100000:1.0:1789518319.580054:0:21903:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99fff7880380 x1876445627539200/t12884901901(12884901901) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518332 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789518319.580066:0:21903:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff7880380, transno 12884901901 00000004:00080000:1.0:1789518319.580078:0:21903:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789518319.580162:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627540096:0@lo:9:umount.0 00000020:00000080:3.0:1789518319.580226:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec386f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789518319.580277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffee447800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789518319.580310:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec3869800 for lustre-MDT0000 00000020:00000080:3.0:1789518319.580328:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffee440800 for lustre-MDT0000 00010000:00010000:3.0:1789518319.580344:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518319.580358:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4b3836a-38c9-4257-b2e7-4883536aaaca:3283:1876445627539968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518319.580437:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518319.580438:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518319.580461:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518319.580471:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4b3836a-38c9-4257-b2e7-4883536aaaca:3283:1876445627539840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518319.580502:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518319.580557:0:19931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627540096 00000100:00100000:1.0:1789518319.580564:0:19931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627540096 00000100:00100000:3.0:1789518319.580582:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518319.580593:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4b3836a-38c9-4257-b2e7-4883536aaaca+17:3283:x1876445627539840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518319.580609:0:18912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518319.580644:0:18912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bc600/0x631fd8698c782951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c78294a expref: 16 pid: 18922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518319.580644:0:19931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789518319.580653:0:19931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1876445627540096:12345-0@lo:9:umount.0 00010000:00010000:3.0:1789518319.580655:0:18912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1789518319.580672:0:19931:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7824ea 00000100:00080000:1.0:1789518319.580682:0:19931:0:(import.c:65:import_set_state_nolock()) ffff99ffee446800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789518319.580696:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4b3836a-38c9-4257-b2e7-4883536aaaca+15:3283:x1876445627539840:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.580709:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000001:00000004:1.0:1789518319.580711:0:19931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901904 00000100:00080000:3.0:1789518319.580732:0:18923:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518319.580780:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4b3836a-38c9-4257-b2e7-4883536aaaca:3283:1876445627539840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518319.580792:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4b3836a-38c9-4257-b2e7-4883536aaaca:3283:1876445627539968:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789518319.580823:0:21903:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789518319.580833:0:21903:0:(import.c:65:import_set_state_nolock()) ffff99ffed5a1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789518319.580869:0:21903:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99ffc6513380) has no exports 00000100:00100000:1.0:1789518319.580869:0:19931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3279:x1876445627540096:12345-0@lo:9:umount.0 Request processed in 217us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518319.580876:0:19931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789518319.582837:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627540224 00000100:00100000:3.0:1789518319.582850:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627540224 00000100:00100000:3.0:1789518319.582920:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518319.582929:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627540224:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789518319.582953:0:19614:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c782687 00000100:00080000:3.0:1789518319.582961:0:19614:0:(import.c:65:import_set_state_nolock()) ffff99fec386f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518319.583010:0:19614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901901 00000100:00100000:3.0:1789518319.583215:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+3:3279:x1876445627540224:12345-0@lo:9:umount.0 Request processed in 287us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518319.583222:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518319.730849:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627540352:0@lo:400:kworker.0 00000100:00100000:3.0:1789518319.730955:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518319.731167:0:3281:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789518319.731173:0:3281:0:(import.c:65:import_set_state_nolock()) ffff99fec386c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789518319.731177:0:3281:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789518319.747562:0:3281:0:(import.c:65:import_set_state_nolock()) ffff99fec386c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518319.747574:0:3281:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 342 00000100:00080000:3.0:1789518319.747589:0:3281:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fec386c000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518319.747680:0:3281:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd1009880 x1876445627540736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518319.747707:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627540480:0@lo:400:kworker.0 00000100:00100000:3.0:1789518319.747744:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627540736:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789518319.747803:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518319.748031:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec386c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518319.748035:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789518319.748038:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627540736:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:1.0:1789518319.753748:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 09aecfa0-ca89-4fa7-a2e1-a288af9edd22 00000020:00000080:1.0:1789518319.753756:0:7607:0:(genops.c:885:class_export_put()) final put ffff99ffd925b000/09aecfa0-ca89-4fa7-a2e1-a288af9edd22 00000001:00100000:1.0:1789518319.753822:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f 00000020:00000080:1.0:1789518319.753825:0:7607:0:(genops.c:885:class_export_put()) final put ffff99fec3868000/6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f 00000020:00000080:3.0:1789518319.753848:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd925b000/09aecfa0-ca89-4fa7-a2e1-a288af9edd22 for lustre-OST0001 00000020:00000080:3.0:1789518319.753933:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffffbf3000 for lustre-OST0001 00000001:00100000:1.0:1789518319.754042:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789518319.754051:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00000020:00000080:1.0:1789518319.754055:0:7607:0:(genops.c:885:class_export_put()) final put ffff99fec114a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789518319.754164:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec3868000/6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f for lustre-OST0001 00000020:00000080:3.0:1789518319.754188:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec114a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789518319.754213:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec386b000 for lustre-OST0001 00000020:00000080:3.0:1789518319.754217:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec386f800 for lustre-OST0001 00000001:00100000:3.0:1789518321.295398:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f 00000001:00080000:3.0:1789518321.295421:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902051 is committed 00000020:00080000:3.0:1789518321.295430:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934634 batchid updated 00000001:00100000:3.0:1789518321.295446:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 09aecfa0-ca89-4fa7-a2e1-a288af9edd22 00000001:00080000:3.0:1789518321.295452:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902052 is committed 00000020:00080000:1.0:1789518321.295454:0:18966:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc6aed600 refcount 1 committed 1 result 0 batchid 8589934634 00000020:00000080:3.0:1789518321.295455:0:5833:0:(genops.c:885:class_export_put()) final put ffff99fec1834000/09aecfa0-ca89-4fa7-a2e1-a288af9edd22 00000020:00080000:1.0:1789518321.295461:0:18966:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff73d8500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc6aed3c0 00000020:00080000:1.0:1789518321.295465:0:18966:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff73d8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffe004b000 00000020:00000080:3.0:1789518321.295478:0:5833:0:(genops.c:885:class_export_put()) final put ffff99fec114e000/6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f 00000020:00000080:3.0:1789518321.295498:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec1834000/09aecfa0-ca89-4fa7-a2e1-a288af9edd22 for lustre-MDT0000 00000020:00000080:3.0:1789518321.295559:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec114e000/6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f for lustre-MDT0000 00000020:00000080:3.0:1789518321.295592:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec1834800 for lustre-MDT0000 00000020:00000080:3.0:1789518321.295597:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec1149800 for lustre-MDT0000 00000020:00000080:1.0:1789518321.305529:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffee447000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789518321.305596:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec183f000/6e5dcb5e-a57e-45aa-9e4e-c74b173b7d7f for lustre-OST0000 00000020:00000080:1.0:1789518321.305775:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffee446800 for lustre-OST0000 00000020:00000080:1.0:1789518321.305782:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec183e800 for lustre-OST0000 00000020:00000080:3.0:1789518321.349895:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd925f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789518321.349930:0:21903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518321.349942:0:21903:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789518321.349948:0:21903:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff99ffc6514d40) has no exports 00000020:00000080:3.0:1789518321.350319:0:21903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7823c4 00000020:00000080:3.0:1789518321.350325:0:21903:0:(genops.c:885:class_export_put()) final put ffff99ffd8b25800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789518321.350389:0:21903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518321.350398:0:21903:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789518321.350401:0:21903:0:(genops.c:885:class_export_put()) final put ffff99ffd8b24800/lustre-QMT0000_UUID 00000020:00000080:3.0:1789518321.350404:0:21903:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd8b24800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789518321.350410:0:21903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1789518321.350652:0:21903:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffdfda01e0 - data ffff9a0000981e58/ffff99fff7212c00 00000004:00080000:3.0:1789518321.408234:0:18951:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789518321.408240:0:18951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 4 count 2 00000040:00080000:3.0:1789518321.408254:0:18951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 3 count 2 00000020:00000080:3.0:1789518321.448302:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff415a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518321.448331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff415e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1789518321.448342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff415b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789518321.448354:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed5a5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518321.448365:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffed5a1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789518321.448372:0:36:0:(genops.c:885:class_export_put()) final put ffff99ffed4a1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789518321.448375:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed4a1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789518321.448382:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518321.448474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed4a0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789518321.448479:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed4a5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518321.449673:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fff415e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789518321.449682:0:36:0:(genops.c:885:class_export_put()) final put ffff99ffed4a7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789518321.449685:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed4a7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789518321.449689:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518321.450116:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff415c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789518321.450125:0:36:0:(genops.c:885:class_export_put()) final put ffff99fff415f800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789518321.450127:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff415f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789518321.450131:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789518321.450575:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4159800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518321.452315:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff790800/a4b3836a-38c9-4257-b2e7-4883536aaaca for MGS 00000020:00000080:3.0:1789518321.452350:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffff797000 for MGS 00000100:00100000:3.0:1789518321.452387:0:18921:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff99fec11b4c00:18921] 1 exiting: rc = 0 00000020:00000080:3.0:1789518321.458348:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc2c1c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518321.460701:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec271c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789518321.461710:0:21903:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789518321.461718:0:21903:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789518321.461724:0:21903:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789518321.461745:0:21903:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518321.462163:0:21903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518321.462176:0:21903:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789518321.462183:0:21903:0:(genops.c:885:class_export_put()) final put ffff99fec11e0800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789518321.462188:0:21903:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec11e0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789518321.462198:0:21903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789518321.462280:0:21903:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fffd267800 1 00000020:00000080:3.0:1789518321.462287:0:21903:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c782331 00000020:00000080:3.0:1789518321.462297:0:21903:0:(genops.c:885:class_export_put()) final put ffff99fffd261000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789518321.462314:0:21903:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789518321.462319:0:21903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518321.462324:0:21903:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789518321.462329:0:21903:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff99fff7838000) has no exports 00000100:00100000:3.0:1789518321.478835:0:20802:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff99ffff24f400:20802] 3 exiting: rc = 0 00000100:00100000:1.0:1789518321.489761:0:18931:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99ffc8698200:18931] 1 exiting: rc = 0 00000100:00100000:1.0:1789518321.493826:0:18933:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff99ffff79d800:18933] 1 exiting: rc = 0 00000100:00100000:3.0:1789518321.495025:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495033:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495039:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495044:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495051:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495056:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495061:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495067:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495084:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495101:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495106:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495112:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495117:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495124:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495129:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495135:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495141:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495148:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495154:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495172:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495192:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495199:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495204:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495216:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495222:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495228:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495233:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495239:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495245:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495252:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495259:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495265:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495286:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495293:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495298:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495304:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495310:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495315:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495320:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495326:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495331:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495337:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495343:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495349:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495367:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495384:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495392:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495398:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495404:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495409:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495414:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495420:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495500:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495506:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495518:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495524:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495552:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495560:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495565:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495575:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495581:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495586:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495591:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518321.495596:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.502668:0:18934:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99ffff79d600:18934] 0 exiting: rc = 1 00000100:00100000:3.0:1789518321.502669:0:18935:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99ffd802cc00:18935] 1 exiting: rc = 0 00000100:00100000:3.0:1789518321.507153:0:18936:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99ffc80f3400:18936] 0 exiting: rc = 1 00000100:00100000:1.0:1789518321.507174:0:18937:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99ffc80f3800:18937] 1 exiting: rc = 0 00000100:00100000:1.0:1789518321.508375:0:18938:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff99ffd802d000:18938] 0 exiting: rc = 1 00000100:00100000:1.0:1789518321.509027:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509034:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509038:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509043:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509048:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509053:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509058:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509063:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509069:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509074:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509079:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509084:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509180:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509186:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509191:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509196:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509201:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509206:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509211:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509216:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509220:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509226:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509231:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509236:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509241:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509246:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509252:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509258:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509263:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509268:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509273:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509278:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509283:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509288:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509294:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509299:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509304:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509308:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509313:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509319:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509325:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509329:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509335:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509339:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509345:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509350:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509355:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509368:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509372:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509378:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509383:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509388:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509393:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509398:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509402:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509407:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509411:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509416:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509421:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509425:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509430:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509435:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509439:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.509442:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517850:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517886:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517902:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517911:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517916:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517922:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517927:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517933:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517944:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517952:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517960:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517965:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517971:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517977:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517982:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517987:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517992:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.517998:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518028:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518034:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518039:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518044:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518050:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518055:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518060:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518065:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518070:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518074:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518079:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518084:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518101:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518106:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518111:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518118:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518123:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518128:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518132:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518137:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518143:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518148:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518153:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518159:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518179:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518186:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518191:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518196:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518202:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518208:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518215:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518220:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518227:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518232:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518237:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518248:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518254:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518259:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518265:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518271:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518277:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518283:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518289:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518294:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518299:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518321.518305:0:21903:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789518321.522255:0:21903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518321.522267:0:21903:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789518321.522273:0:21903:0:(genops.c:885:class_export_put()) final put ffff99fff7b5b800/MDS_uuid 00000020:00000080:1.0:1789518321.522277:0:21903:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff7b5b800/MDS_uuid for MDS 00000020:01000000:1.0:1789518321.522286:0:21903:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789518321.522401:0:21903:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789518322.162773:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518323.142985:0:21040:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518323.142998:0:21040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c7824b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7824b9 expref: -99 pid: 19612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.143006:0:21040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518323.143010:0:21040:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c7824b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7824b9 expref: -99 pid: 19612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.143019:0:21040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c7824b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7824b9 expref: -99 pid: 19612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518323.143027:0:21040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c7824b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7824b9 expref: -99 pid: 19612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518323.143033:0:21040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518323.143035:0:21040:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789518323.143038:0:21040:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789518323.143324:0:21040:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c7824b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7824b9 expref: -99 pid: 19612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.143333:0:21040:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518323.143379:0:21040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c7824b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7824b9 expref: -99 pid: 19612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.143386:0:21040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1000/0x631fd8698c7824b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7824b9 expref: -99 pid: 19612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.143403:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518323.143407:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518323.143411:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518323.143433:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a4b3836a-38c9-4257-b2e7-4883536aaaca:3282:1876445627540864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518323.143523:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518323.143667:0:21041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627540864 00000100:00100000:1.0:1789518323.143676:0:21041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627540864 00000100:00100000:1.0:1789518323.143729:0:21041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789518323.143739:0:21041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3282:x1876445627540864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789518323.143745:0:21041:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518323 with bad export cookie 7142665481872745300 00010000:00010000:3.0:1789518323.145111:0:18915:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518323.145124:0:18915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c78293c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c782943 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.145142:0:18915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518323.145147:0:18915:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c78293c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c782943 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.145304:0:18915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c78293c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c782943 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518323.145317:0:18915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c78293c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c782943 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518323.145325:0:18915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789518323.145328:0:18915:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789518323.145331:0:18915:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789518323.145363:0:18915:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c78293c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c782943 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.145385:0:18915:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518323.145414:0:18915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c78293c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c782943 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.145424:0:18915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c78293c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c782943 expref: -99 pid: 18924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518323.145459:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518323.145465:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518323.145467:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518323.145491:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a4b3836a-38c9-4257-b2e7-4883536aaaca:3280:1876445627541120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518323.145556:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518323.145649:0:18914:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789518323.145659:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00080000:3.0:1789518323.146098:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789518323.161437:0:3283:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99ffff6cb800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789518323.161464:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a4b3836a-38c9-4257-b2e7-4883536aaaca:3283:1876445627540992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518323.162100:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a4b3836a-38c9-4257-b2e7-4883536aaaca:3279:1876445627541248:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789518323.162138:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627541248 offset 0 length 520: 4 00000400:00000100:1.0:1789518323.166120:0:21041:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876445627540864 offset 224 length 224: 4 00000100:00100000:1.0:1789518323.166156:0:21041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3282:x1876445627540864:12345-0@lo:103:ldlm_bl.0 Request processed in 22415us (22630us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789518323.166171:0:21041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789518323.187766:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518323.203310:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec114f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789518323.203319:0:36:0:(genops.c:885:class_export_put()) final put ffff99ffdf98a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789518323.203323:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffdf98a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789518323.203342:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789518323.203404:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789518323.222334:0:22057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518323.222352:0:22057:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789518323.222358:0:22057:0:(genops.c:885:class_export_put()) final put ffff99ffffbf1000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789518323.222362:0:22057:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789518323.222370:0:22057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789518323.222521:0:22057:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffffbf2800 00000020:02000400:1.0:1789518323.222581:0:22057:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789518324.210958:0:18916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518324.584045:0:18915:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518324.584053:0:18915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c782609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c782610 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518324.584062:0:18915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518324.584081:0:18915:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c782609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c782610 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518324.584091:0:18915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c782609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c782610 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518324.584098:0:18915:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c782609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c782610 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518324.584104:0:18915:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518324.584107:0:18915:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789518324.584109:0:18915:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789518324.584121:0:18915:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffff6cb800 00010000:00010000:3.0:1789518324.584125:0:18915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c782609 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c782610 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518324.584132:0:18915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff9a00021c7800/0x631fd8698c782609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c782610 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518324.584144:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518324.584146:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518324.584148:0:18915:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518324.585106:0:21040:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518324.585114:0:21040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7825df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7825e6 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518324.585125:0:21040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518324.585130:0:21040:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7825df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7825e6 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518324.585142:0:21040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7825df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7825e6 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518324.585160:0:21040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7825df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7825e6 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518324.585170:0:21040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518324.585176:0:21040:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789518324.585179:0:21040:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789518324.585189:0:21040:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffff6cb800 00010000:00010000:3.0:1789518324.585194:0:21040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7825df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7825e6 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518324.585202:0:21040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7825df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7825e6 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518324.585217:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518324.585221:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518324.585224:0:21040:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518324.616565:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec369b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1789518324.616936:0:22208:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789518324.616944:0:22208:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78234d 00000020:00000080:1.0:1789518324.616949:0:22208:0:(genops.c:885:class_export_put()) final put ffff99fff7b5c800/a4b3836a-38c9-4257-b2e7-4883536aaaca 00000020:01000000:1.0:1789518324.616956:0:22208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.151@tcp (flags='') 00000020:00000080:1.0:1789518324.616961:0:22208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518324.616965:0:22208:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789518324.616969:0:22208:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff99ffc64a0000) has no exports 10000000:01000000:1.0:1789518324.617062:0:22208:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.151@tcp: client import never connected 00000100:00080000:1.0:1789518324.617065:0:22208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789518324.617067:0:22208:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789518324.617079:0:22208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789518324.617081:0:22208:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789518324.617121:0:22208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518324.617125:0:22208:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.151@tcp (uuid a4b3836a-38c9-4257-b2e7-4883536aaaca) 00000020:01000000:1.0:1789518324.617130:0:22208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789518324.617133:0:22208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518324.617136:0:22208:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789518324.617140:0:22208:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99fec3868800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518324.617149:0:22208:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff99fec18c99c0) has exports, disconnecting them 00000020:00080000:1.0:1789518324.617154:0:22208:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99fec3868800), last request at 1789518288 00000020:00000080:1.0:1789518324.617157:0:22208:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78261e 00000020:00080000:1.0:1789518324.617167:0:22208:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fec3868800): rc 0 00000020:00000080:1.0:1789518324.617177:0:22208:0:(genops.c:885:class_export_put()) final put ffff99fec3868800/lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789518324.617787:0:22208:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789518324.617791:0:22208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518324.617794:0:22208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789518324.617798:0:22208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789518324.640749:0:22208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518324.640763:0:22208:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789518324.640769:0:22208:0:(genops.c:885:class_export_put()) final put ffff99ffc6490800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789518324.640773:0:22208:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6490800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789518324.640781:0:22208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789518324.640966:0:22208:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffc6491800 00000020:01000000:1.0:1789518324.640985:0:22208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789518324.640989:0:22208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518324.640994:0:22208:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789518324.640997:0:22208:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff99fec2aa0000) has no exports 00000020:00000080:1.0:1789518324.641023:0:22208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518324.641028:0:22208:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789518324.641031:0:22208:0:(genops.c:885:class_export_put()) final put ffff99ffffbf1800/OSS_uuid 00000020:00000080:1.0:1789518324.641033:0:22208:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf1800/OSS_uuid for OSS 00000020:01000000:1.0:1789518324.641037:0:22208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789518324.641059:0:18923:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789518324.641220:0:19931:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff99fff723f200:19931] 3 exiting: rc = 0 00000100:00100000:1.0:1789518324.641324:0:19615:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff99ffd1113c00:19615] 1 exiting: rc = 0 00000100:00100000:3.0:1789518324.643127:0:19614:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff99ffd844c800:19614] 0 exiting: rc = 1 00000100:00100000:3.0:1789518324.644692:0:19616:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff99ffd1113400:19616] 2 exiting: rc = 0 00000100:00100000:1.0:1789518324.644819:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644829:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644835:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644853:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644858:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644863:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644869:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644875:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644882:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644887:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644903:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644908:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644914:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644920:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644925:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644931:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644942:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644948:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644953:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644959:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644964:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644969:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644974:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644979:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644984:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644990:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.644995:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645000:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645005:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645011:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645016:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645022:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645027:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645033:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645039:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645044:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645049:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645055:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645060:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645066:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645082:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645088:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645092:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645096:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645100:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645111:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645117:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645121:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645126:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645130:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645135:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645139:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645143:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645148:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645152:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645157:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645162:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645168:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645173:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645178:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645182:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645187:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645191:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.645195:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518324.646115:0:19617:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99ffd32c4800:19617] 0 exiting: rc = 1 00000100:00100000:1.0:1789518324.646426:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646434:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646439:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646445:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646450:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646456:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646462:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646467:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646472:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646477:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646483:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646488:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646494:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646499:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646505:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646510:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646525:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646530:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646535:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646540:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646545:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646551:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646556:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646561:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646566:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646571:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646576:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646581:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646587:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646592:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646598:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646604:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646609:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646657:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646665:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646674:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646681:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646687:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646691:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646696:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646700:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646705:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646711:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646717:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646722:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646726:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646731:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646737:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646744:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646752:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646757:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646772:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646781:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646787:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646792:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646797:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646801:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646807:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646812:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646817:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646822:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646827:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646832:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.646837:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518324.648234:0:19620:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99fff46b9e00:19620] 1 exiting: rc = 0 00000100:00100000:1.0:1789518324.648554:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648562:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648568:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648574:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648579:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648584:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648589:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648595:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648600:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648605:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648610:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648732:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648738:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648743:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648748:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648753:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648758:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648776:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648783:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648788:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648793:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648799:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648815:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648821:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648826:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648831:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648838:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648843:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648849:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648855:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648860:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648866:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648872:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648877:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648883:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648889:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648894:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648901:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648906:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648912:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648917:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648938:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648945:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648951:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648956:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648962:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648968:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648973:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648979:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648985:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648990:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.648996:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649002:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649007:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649013:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649018:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649024:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649036:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649042:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649047:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649052:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649058:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649064:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.649080:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.652995:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653002:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653008:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653013:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653019:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653024:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653029:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653035:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653040:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653045:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653051:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653056:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653061:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653067:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653085:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653091:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653096:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653102:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653106:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653111:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653116:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653121:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653130:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653135:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653140:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653145:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653150:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653155:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653172:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653177:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653182:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653188:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653192:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653197:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653202:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653207:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653212:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653217:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653229:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653237:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653242:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653248:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653253:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653259:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653264:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653269:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653274:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653279:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653284:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653289:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653293:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653298:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653310:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653318:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653324:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653329:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653334:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653339:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653344:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653348:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653353:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653357:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653362:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518324.653375:0:22208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518324.655811:0:19625:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99ffc6ad2600:19625] 1 exiting: rc = 0 00000020:02000400:1.0:1789518324.663129:0:22208:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000100:00100000:1.0:1789518337.252869:0:23282:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789518337.252878:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789518337.254292:0:23282:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:1.0:1789518337.262552:0:23282:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789518337.262569:0:23282:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789518337.262572:0:23282:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789518337.264103:0:23282:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789518337.264177:0:23282:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789518337.264572:0:23282:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789518337.265108:0:23282:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518337.265276:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789518337.265281:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789518337.270458:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789518337.270471:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789518337.271113:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789518337.271120:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789518337.271726:0:23282:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789518337.271746:0:23282:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.151@tcp' 00000020:01000004:1.0:1789518337.271748:0:23282:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789518337.271776:0:23282:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.151@tcp (typ=mgc) 00000020:00000080:1.0:1789518337.271788:0:23282:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.151@tcp (ffff99fec18c8000) 00000020:00000080:1.0:1789518337.271803:0:23282:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789518337.271870:0:23282:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fec13e1000@MGC192.168.206.151@tcp: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1789518337.272003:0:23282:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.151@tcp-0 is initialized 00000040:01000000:1.0:1789518337.272023:0:23282:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 1 is initialized 00000020:00000080:1.0:1789518337.272565:0:23282:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.151@tcp (uuid 7c8a322e-2788-4faf-9195-ae294b8818bd) 00000020:00000080:1.0:1789518337.272580:0:23282:0:(genops.c:1384:class_connect()) connect: client 7c8a322e-2788-4faf-9195-ae294b8818bd, cookie 0x631fd8698c7832c7 00000100:00080000:1.0:1789518337.272590:0:23282:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518337.272598:0:23282:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99fec13e1000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518337.272783:0:23282:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fffc5f1c00 x1876445627541376/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518337.272847:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c8a322e-2788-4faf-9195-ae294b8818bd:3279:1876445627541376:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789518337.272908:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518337.273299:0:23282:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS 00000020:01000004:1.0:1789518337.273316:0:23282:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789518337.273321:0:23282:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789518337.273332:0:23282:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99fec18ccd40) 00000020:00000080:1.0:1789518337.273341:0:23282:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789518337.279302:0:3279:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789518337.279316:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:3.0:1789518337.279324:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789518337.279329:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789518337.279339:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec13e1000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789518337.279342:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789518337.279365:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789518337.279373:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c8a322e-2788-4faf-9195-ae294b8818bd:3279:1876445627541376:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789518337.280253:0:23282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518337.280508:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789518337.280514:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789518337.281092:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789518337.281097:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789518337.281748:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789518337.281754:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789518337.283527:0:23282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518337.283872:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789518337.283877:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789518337.284487:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789518337.284493:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789518337.307458:0:23282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518337.307734:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789518337.307741:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789518337.309555:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789518337.309567:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789518337.311321:0:23282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518337.311539:0:23282:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518337.311545:0:23282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 10000000:01000000:3.0:1789518337.334185:0:23316:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789518337.337584:0:23317:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789518337.337593:0:23317:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789518337.337596:0:23317:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789518337.337662:0:23317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:1.0:1789518337.345592:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627541504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518337.345652:0:23282:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789518337.345657:0:23282:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518337.345659:0:23282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518337.345661:0:23282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518337.345662:0:23282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518337.345681:0:23282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518337.345683:0:23282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518337.345685:0:23282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518337.345687:0:23282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518337.345689:0:23282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518337.345691:0:23282:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789518337.345716:0:23282:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffc5e32800 from lustre-MDT0000 10000000:01000000:1.0:1789518337.345821:0:23282:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789518337.345825:0:23282:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789518337.345831:0:23282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99fec18c8000 10000000:01000000:1.0:1789518337.345836:0:23282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518337.345846:0:23282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99fec18c8000 from 1 10000000:01000000:1.0:1789518337.345850:0:23282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789518337.345903:0:23282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.345916:0:23282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.345927:0:23282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518337.345950:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627541632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518337.346024:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518337.346069:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3ea6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518337.346652:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627541632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518337.346674:0:23282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832e3 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.346687:0:23282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7832e3 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518337.346781:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627541760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518337.346814:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518337.346842:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3ea6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518337.347403:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627541760:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789518337.347446:0:23282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789518337.347469:0:23282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832e3 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.347479:0:23282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832e3 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518337.347488:0:23282:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffc5e32800 10000000:01000000:1.0:1789518337.347495:0:23282:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789518337.347501:0:23282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ffc5e32800 10000000:01000000:1.0:1789518337.347504:0:23282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789518337.347508:0:23282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99ffc5e32800 from 1 10000000:01000000:1.0:1789518337.347511:0:23282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789518337.347531:0:23282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.347539:0:23282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.347547:0:23282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518337.347560:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627541888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518337.347599:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518337.347671:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3ea6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518337.348186:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627541888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518337.348259:0:23282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.348267:0:23282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518337.348280:0:23282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789518337.348291:0:23282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.348296:0:23282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518337.348300:0:23282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789518337.348303:0:23282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518337.348307:0:23282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ffc5e32800 10000000:01000000:1.0:1789518337.348308:0:23282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789518337.348310:0:23282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789518337.348312:0:23282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789518337.348325:0:23282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.348330:0:23282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.348335:0:23282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518337.348349:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627542016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518337.348373:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518337.348389:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3ea6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.348727:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627542016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518337.348746:0:23282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.348755:0:23282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518337.348819:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627542144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518337.348851:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.349525:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.349537:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627542144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518337.349561:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627542272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518337.349595:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.349649:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.350146:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627542272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518337.350521:0:23319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23319:1876445627542400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518337.350554:0:23319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.350581:0:23319:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518337.350640:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627542400 00000100:00100000:1.0:1789518337.350645:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627542400 00000100:00100000:1.0:1789518337.350681:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518337.350688:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+9:23319:x1876445627542400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518337.350901:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+9:23319:x1876445627542400:12345-0@lo:502:llog_process_th.0 Request processed in 214us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518337.350908:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518337.351046:0:23319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23319:1876445627542400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518337.351070:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518337.351080:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.351082:0:23319:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789518337.351087:0:23319:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789518337.351089:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518337.351103:0:23319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99ffc64a0000) 00000020:00000080:3.0:1789518337.351119:0:23319:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789518337.351125:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789518337.351182:0:23319:0:(osd_handler.c:1614:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789518337.351190:0:23319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c78330d 00000020:00000080:3.0:1789518337.351376:0:23319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789518337.351380:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518337.351385:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.351386:0:23319:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789518337.351388:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518337.351392:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.351394:0:23319:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789518337.351397:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518337.351404:0:23319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99ffc64a19c0) 00000020:00000080:3.0:1789518337.351419:0:23319:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789518337.351423:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789518337.351425:0:23319:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789518337.351428:0:23319:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789518337.351433:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789518337.351472:0:23319:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc5e32800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789518337.351483:0:23319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99ffc64a4d40) 00000020:00000080:3.0:1789518337.351491:0:23319:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789518337.351533:0:23319:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789518337.351541:0:23319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c783322 00000020:00000080:3.0:1789518337.351732:0:23319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789518337.351745:0:23319:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789518337.351750:0:23319:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x631fd8698c783329 00080000:01000000:3.0:1789518337.351755:0:23319:0:(osd_handler.c:1614:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789518337.351758:0:23319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c783330 00010000:00010000:3.0:1789518337.393520:0:23319:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789518337.394051:0:23319:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 12884902052 00000001:00080000:3.0:1789518337.394218:0:23319:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789518337.394718:0:23319:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99ffc64a3380) 00000020:00000080:3.0:1789518337.394735:0:23319:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789518337.394804:0:23319:0:(osd_handler.c:1614:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789518337.394812:0:23319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c78333e 00000020:00000080:3.0:1789518337.395287:0:23319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789518337.399446:0:23319:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x631fd8698c783345 00000020:00000080:3.0:1789518337.400141:0:23319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789518337.400152:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518337.400157:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.400159:0:23319:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789518337.400162:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518337.400167:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.400168:0:23319:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789518337.400172:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789518337.400202:0:23319:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789518337.400214:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518337.400217:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.400218:0:23319:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789518337.400221:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789518337.400222:0:23319:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1789518337.400224:0:23319:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518337.400225:0:23319:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518337.400227:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789518337.400229:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.400231:0:23319:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789518337.400233:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518337.400243:0:23319:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789518337.400247:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.400248:0:23319:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789518337.400252:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789518337.400258:0:23319:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:3.0:1789518337.400281:0:23319:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789518337.400284:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518337.400297:0:23319:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99fec2aa0000) 00000020:00000080:3.0:1789518337.400310:0:23319:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789518337.400315:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789518337.400364:0:23319:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789518337.400369:0:23319:0:(osd_handler.c:1614:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789518337.400375:0:23319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c783353 00010000:00080000:3.0:1789518337.400403:0:23319:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fec271e000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518337.400638:0:23319:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789518337.400971:0:23319:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789518337.401027:0:23319:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789518337.402018:0:23319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518337.402082:0:23319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].4, 64 off8448 00000040:00080000:3.0:1789518337.402156:0:23319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].1, 64 off8256 00000100:00100000:3.0:1789518337.403191:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627542528:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789518337.403245:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627542528 offset 0 length 520: 4 00000020:00000080:1.0:1789518337.405686:0:23319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789518337.405696:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789518337.405722:0:23319:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789518337.405736:0:23319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c78336f 00000100:00080000:1.0:1789518337.405744:0:23319:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518337.405753:0:23319:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffc5de1800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518337.405780:0:23319:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fffc5f3b80 x1876445627542656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518337.405829:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627542656:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789518337.405870:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627542656 offset 0 length 520: 4 00000100:00080000:1.0:1789518337.405918:0:23319:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789518337.405968:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518337.405972:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518337.405974:0:23319:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789518337.405977:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518337.405980:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518337.405982:0:23319:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789518337.405984:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789518337.405986:0:23319:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789518337.405995:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518337.405997:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518337.405999:0:23319:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789518337.406001:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518337.406003:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518337.406005:0:23319:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789518337.406020:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789518337.406044:0:23319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23319:1876445627542784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518337.406085:0:23319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518337.406175:0:23319:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518337.408001:0:23319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23319:1876445627542784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518337.408046:0:23319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518337.408052:0:23319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518337.408055:0:23319:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789518337.408061:0:23319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789518337.408244:0:23282:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789518337.408261:0:23282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789518337.408319:0:23282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.408346:0:23282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518337.408353:0:23282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffc5e32800 from 1 10000000:01000000:3.0:1789518337.408356:0:23282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518337.408388:0:23282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.408396:0:23282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.408406:0:23282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518337.408423:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627542912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518337.408466:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.408502:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.408852:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627542912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518337.408867:0:23282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783376 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78337d expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.408876:0:23282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783376 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78337d expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518337.409386:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543040:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789518337.409419:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.409463:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.409814:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543040:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789518337.410370:0:23282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518337.410390:0:23282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783376 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78337d expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.410399:0:23282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78337d expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518337.410407:0:23282:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc5e32800 from 1 10000000:01000000:3.0:1789518337.410410:0:23282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518337.410431:0:23282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.410438:0:23282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.410445:0:23282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518337.410458:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518337.410485:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.410511:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.411574:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518337.411589:0:23282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.411600:0:23282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518337.411701:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518337.411740:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.411771:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518337.411839:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627543296 00000100:00100000:1.0:1789518337.411845:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627543296 00000100:00100000:1.0:1789518337.411887:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518337.411896:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+11:23282:x1876445627543296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518337.412273:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+11:23282:x1876445627543296:12345-0@lo:501:mount.lustre.0 Request processed in 378us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518337.412281:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518337.412537:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518337.412566:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518337.412603:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.412665:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.413058:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518337.414702:0:23327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23327:1876445627543552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518337.414758:0:23327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.414806:0:23327:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518337.414812:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627543552 00000100:00100000:1.0:1789518337.414819:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627543552 00000100:00100000:1.0:1789518337.414858:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789518337.414866:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+11:23327:x1876445627543552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518337.415101:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+11:23327:x1876445627543552:12345-0@lo:502:llog_process_th.0 Request processed in 235us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518337.415119:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518337.415125:0:23327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23327:1876445627543552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518337.415152:0:23327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518337.415161:0:23327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.415164:0:23327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789518337.415171:0:23327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc5e32800 00000020:00000080:3.0:1789518337.415174:0:23327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518337.415181:0:23327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518337.415183:0:23327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.415185:0:23327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789518337.415187:0:23327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518337.415189:0:23327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.415191:0:23327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789518337.415194:0:23327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc5e32800 00000020:00000080:3.0:1789518337.415196:0:23327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518337.415314:0:23327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518337.415319:0:23327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.415320:0:23327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789518337.415323:0:23327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518337.415325:0:23327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518337.415327:0:23327:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518337.415330:0:23327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffc5e32800 00000020:00000080:3.0:1789518337.415332:0:23327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518337.415364:0:23327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23327:1876445627543680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518337.415396:0:23327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.415421:0:23327:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3e40 going to sleep for 11 seconds 00000020:01000000:3.0:1789518337.415787:0:23282:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789518337.415811:0:23282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518337.415838:0:23282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.415850:0:23282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518337.415889:0:23282:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789518337.415892:0:23282:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffc5e32800 10000000:01000000:3.0:1789518337.415895:0:23282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffc5e32800 10000000:01000000:3.0:1789518337.415899:0:23282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518337.415904:0:23282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc5e32800 from 1 10000000:01000000:3.0:1789518337.415908:0:23282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518337.415929:0:23282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.415938:0:23282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.415957:0:23282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518337.415971:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518337.415998:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.416041:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.416495:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518337.416509:0:23282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.416517:0:23282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518337.416562:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518337.416586:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.416606:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.416961:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627543936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518337.416990:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627544064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518337.417045:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.417072:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.417399:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627544064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518337.417809:0:23329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23329:1876445627544192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518337.417847:0:23329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.417874:0:23329:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.418279:0:23329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23329:1876445627544192:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789518337.418346:0:23329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789518337.418359:0:23329:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99fec2aa19c0) 00000020:00000080:3.0:1789518337.418382:0:23329:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789518337.418475:0:23329:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc5e32800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789518337.418480:0:23329:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc5e32800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789518337.418482:0:23329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc5e32800 4 00010000:00080000:3.0:1789518337.418513:0:23329:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffc84da000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518337.420353:0:23329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789518337.420569:0:23329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789518337.420600:0:23329:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518337.420631:0:23329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x631fd8698c7833a7 00000100:00080000:3.0:1789518337.420639:0:23329:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518337.420649:0:23329:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ffc84da000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518337.420678:0:23329:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd1008000 x1876445627544320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518337.420712:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627544320:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518337.420766:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518337.420816:0:23329:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518337.421046:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627544320 00000100:00100000:1.0:1789518337.421054:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627544320 00000100:00100000:1.0:1789518337.421093:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518337.421207:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627544320:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518337.421280:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627544320:12345-0@lo:38:llog_process_th.0 Request processed in 178us (512us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789518337.421289:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518337.421310:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518337.421319:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc84da000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518337.421324:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789518337.421328:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627544320:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518337.423877:0:23329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23329:1876445627544448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518337.423948:0:23329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.423987:0:23329:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518337.424000:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627544448 00000100:00100000:1.0:1789518337.424021:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627544448 00000100:00100000:1.0:1789518337.424071:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789518337.424083:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23329:x1876445627544448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518337.424375:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23329:x1876445627544448:12345-0@lo:502:llog_process_th.0 Request processed in 295us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518337.424385:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789518337.424447:0:23329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c8a322e-2788-4faf-9195-ae294b8818bd:23329:1876445627544448:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789518337.424476:0:23329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789518337.425690:0:23282:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789518337.425714:0:23282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518337.425737:0:23282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.425746:0:23282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518337.425791:0:23282:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518337.425797:0:23282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518337.425798:0:23282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518337.425799:0:23282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518337.425800:0:23282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518337.425801:0:23282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518337.425802:0:23282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518337.425803:0:23282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518337.425805:0:23282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518337.425806:0:23282:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518337.425809:0:23282:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789518337.425811:0:23282:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518337.425812:0:23282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518337.425812:0:23282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518337.425813:0:23282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518337.425814:0:23282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518337.425815:0:23282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518337.425815:0:23282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518337.425816:0:23282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518337.425817:0:23282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518337.425817:0:23282:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518337.425833:0:23282:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789518337.425847:0:23282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627544576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518337.425913:0:23282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518337.425947:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627544576 00000100:00100000:3.0:1789518337.425954:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627544576 00000100:00100000:1.0:1789518337.425955:0:23282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.425993:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518337.426001:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23282:x1876445627544576:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518337.426039:0:23294:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789518337.426051:0:23294:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789518337.451429:0:23294:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789518337.451441:0:23294:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789518337.451515:0:23316:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789518337.451519:0:23316:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789518337.451541:0:23316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.451722:0:23316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffd0697600/0x631fd8698c78337d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783376 expref: 12 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.451732:0:23316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.451767:0:23316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffd0697600/0x631fd8698c78337d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c783376 expref: 12 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518337.451780:0:23316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffd0697600/0x631fd8698c78337d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c783376 expref: 12 pid: 23292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518337.452298:0:23316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23316:1876445627544704:0@lo:104: 00000100:00100000:3.0:1789518337.452357:0:23316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518337.452706:0:23283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627544704 00000100:00100000:1.0:1789518337.452714:0:23283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627544704 00000100:00100000:1.0:1789518337.452755:0:23283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518337.452764:0:23283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+3:23316:x1876445627544704:12345-0@lo:104: 00010000:00010000:1.0:1789518337.452777:0:23283:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78337d expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.452843:0:23283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518337.452850:0:23283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+3:23316:x1876445627544704:12345-0@lo:104: Request processed in 87us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518337.452870:0:23283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518337.453148:0:23316:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518337.453166:0:23316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23316:1876445627544704:0@lo:104: 00010000:00010000:3.0:1789518337.453183:0:23316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518337.453315:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627544832 00000100:00100000:1.0:1789518337.453320:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627544832 00010000:00010000:1.0:1789518337.453336:0:23285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffd0697600/0x631fd8698c78337d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783376 expref: 13 pid: 23292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518337.453369:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518337.453375:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+13:3280:x1876445627544832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518337.453386:0:23285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518337.453391:0:23285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffd0697600/0x631fd8698c78337d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783376 expref: 13 pid: 23292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453401:0:23285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffd0697600/0x631fd8698c78337d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c783376 expref: 13 pid: 23292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453414:0:23285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697600/0x631fd8698c78337d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c783376 expref: 13 pid: 23292 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453426:0:23285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453434:0:23285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789518337.453446:0:23285:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001927118s 00010000:00010000:1.0:1789518337.453451:0:23285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453458:0:23285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453475:0:23285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453481:0:23285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453486:0:23285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518337.453496:0:23285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453504:0:23285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453521:0:23285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffed5bde00/0x631fd8698c7833ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518337.453530:0:23285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518337.453606:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+12:3280:x1876445627544832:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518337.453637:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518337.458762:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+11:23282:x1876445627544576:12345-0@lo:253:mount.lustre.0 Request processed in 32753us (32842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518337.458777:0:23282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23282:1876445627544576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789518337.458787:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 10000000:01000000:1.0:1789518337.458791:0:23282:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789518337.458805:0:23282:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518337.458807:0:23282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518337.458809:0:23282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518337.458810:0:23282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518337.458811:0:23282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518337.458812:0:23282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518337.458813:0:23282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518337.458815:0:23282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518337.458816:0:23282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518337.458822:0:23282:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789518337.458836:0:23282:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789518337.464145:0:23282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518337.464277:0:23282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518337.464512:0:23282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518337.464672:0:23282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518337.464962:0:23282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518337.465147:0:23282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000040:01000000:1.0:1789518337.490165:0:23282:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789518337.490512:0:23340:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789518337.490580:0:23340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518337.493118:0:23340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789518337.493229:0:23340:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789518337.493234:0:23340:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1789518337.522159:0:23282:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789518337.522203:0:23282:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa508418e3988 00100000:10000000:3.0:1789518337.522211:0:23282:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:1.0:1789518338.357296:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627544960 00000100:00100000:1.0:1789518338.357303:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627544960 00000100:00100000:1.0:1789518338.357357:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518338.357367:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+11:23297:x1876445627544960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518338.357380:0:23292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518338.357392:0:23292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b45600/0x631fd8698c7833bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7833b5 expref: -99 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518338.357412:0:23292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b45600/0x631fd8698c7833bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7833b5 expref: 12 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518338.357421:0:23292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b45600/0x631fd8698c7833bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7833b5 expref: 12 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518338.357429:0:23292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45600, rc 0) 00000100:00100000:1.0:1789518338.357485:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23297:x1876445627544960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518338.357499:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518338.357720:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627544960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518338.357735:0:23297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518338.357744:0:23297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518338.357793:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627545088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518338.357824:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518338.357959:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518338.357991:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627545088 00000100:00100000:1.0:1789518338.357996:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627545088 00000100:00100000:1.0:1789518338.358040:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518338.358048:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23297:x1876445627545088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789518338.358061:0:23294:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789518338.358075:0:23294:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789518338.358078:0:23294:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789518338.358248:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23297:x1876445627545088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518338.358256:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518338.358307:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627545088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518338.358346:0:23297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518338.358353:0:23297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518338.358362:0:23297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518338.482863:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789518338.482871:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518338.483239:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:3.0:1789518338.483247:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789518340.997418:0:23283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627545216 00000100:00100000:1.0:1789518340.997424:0:23283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627545216 00000100:00100000:1.0:1789518340.997504:0:23283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518340.997513:0:23283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+3:23732:x1876445627545216:12345-0@lo:104: 00010000:00010000:1.0:1789518340.997524:0:23283:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518340.997594:0:23283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518340.997600:0:23283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+3:23732:x1876445627545216:12345-0@lo:104: Request processed in 89us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518340.997607:0:23283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789518340.997676:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518340.997683:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.997691:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518340.997695:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.997703:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518340.997709:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518340.997714:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518340.997740:0:23289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.997746:0:23289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518340.997763:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.997771:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783384 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78338b expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.997787:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518340.997789:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518340.997791:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518340.997814:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c8a322e-2788-4faf-9195-ae294b8818bd:3282:1876445627545344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518340.997842:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518340.997956:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627545344 00000100:00100000:3.0:1789518340.997961:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627545344 00010000:00010000:3.0:1789518340.997979:0:23287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffd0696a00/0x631fd8698c78338b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783384 expref: 12 pid: 23292 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518340.998013:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518340.998022:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8a322e-2788-4faf-9195-ae294b8818bd+12:3282:x1876445627545344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518340.998037:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518340.998042:0:23287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffd0696a00/0x631fd8698c78338b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783384 expref: 12 pid: 23292 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998053:0:23287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffd0696a00/0x631fd8698c78338b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c783384 expref: 12 pid: 23292 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998348:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0696a00/0x631fd8698c78338b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c783384 expref: 12 pid: 23292 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998361:0:23287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffd0696800/0x631fd8698c7833c3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998368:0:23287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0696800/0x631fd8698c7833c3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998381:0:23287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffd0696800/0x631fd8698c7833c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998387:0:23287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffd0696800/0x631fd8698c7833c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998394:0:23287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffd0696800/0x631fd8698c7833c3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998409:0:23287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffd0696800/0x631fd8698c7833c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998414:0:23287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518340.998418:0:23287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffd0696800/0x631fd8698c7833c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998425:0:23287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffd0696800/0x631fd8698c7833c3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998446:0:23287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffd0696800/0x631fd8698c7833c3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518340.998455:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518340.998496:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c8a322e-2788-4faf-9195-ae294b8818bd+11:3282:x1876445627545344:12345-0@lo:103:ldlm_bl.0 Request processed in 476us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518340.998503:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518340.998566:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c8a322e-2788-4faf-9195-ae294b8818bd:3282:1876445627545344:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789518342.130868:0:23297:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518342.130873:0:23297:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc5e32800 from 10 10000000:01000000:3.0:1789518342.130878:0:23297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518342.130916:0:23297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518342.130929:0:23297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518342.130941:0:23297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518342.130964:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627545472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518342.131051:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518342.131108:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518342.131557:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627545472 00000100:00100000:1.0:1789518342.131565:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627545472 00000100:00100000:1.0:1789518342.132139:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627545600 00000100:00100000:1.0:1789518342.132144:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627545600 00000100:00100000:1.0:1789518342.132207:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518342.132214:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23297:x1876445627545600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518342.132436:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23297:x1876445627545600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518342.132443:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789518342.389664:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518342.774969:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627545856:0@lo:38:kworker.0 00000100:00100000:1.0:1789518342.775050:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789518342.775961:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99fff4002a00 x1876445627545856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518342.775976:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 4 00000100:00080000:1.0:1789518342.775992:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789518342.775997:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518342.775999:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc84da000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518342.776005:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627545856:0@lo:38:kworker.0 00000100:00100000:3.0:1789518343.785155:0:23982:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789518343.785161:0:23982:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789518343.840427:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627545984 00000100:00100000:1.0:1789518343.840435:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627545984 00000100:00100000:1.0:1789518343.840532:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518343.840542:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23982:x1876445627545984:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518343.840571:0:23294:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789518343.840575:0:23294:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789518343.840579:0:23294:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789518343.848440:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627546112 00000100:00100000:3.0:1789518343.848449:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627546112 00000100:00100000:3.0:1789518343.848538:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518343.848548:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23982:x1876445627546112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518343.848746:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+12:23982:x1876445627546112:12345-0@lo:501:mount.lustre.0 Request processed in 199us (369us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518343.848753:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518343.849483:0:23982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518343.849492:0:23982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc14c000/0x631fd8698c7833f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7833fb expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.849506:0:23982:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc14c000/0x631fd8698c7833f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7833fb expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518343.849518:0:23982:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789518343.849528:0:23982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc14c000/0x631fd8698c7833f4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7833fb expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.849535:0:23982:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc14c000/0x631fd8698c7833f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7833fb expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518343.849541:0:23982:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789518343.849545:0:23982:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518343.849554:0:23982:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789518343.849556:0:23982:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789518343.849570:0:23982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.849577:0:23982:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.849585:0:23982:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518343.849596:0:23982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518343.849642:0:23982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518343.849673:0:23982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518343.849806:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627546368 00000100:00100000:1.0:1789518343.849813:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627546368 00000100:00100000:1.0:1789518343.849846:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518343.849855:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+13:23982:x1876445627546368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518343.849863:0:23292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518343.849881:0:23292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b45800/0x631fd8698c783409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783402 expref: -99 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.849899:0:23292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b45800/0x631fd8698c783409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783402 expref: 14 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.849908:0:23292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b45800/0x631fd8698c783409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783402 expref: 14 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.849915:0:23292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45800, rc 0) 00000100:00100000:1.0:1789518343.849949:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+14:23982:x1876445627546368:12345-0@lo:101:mount.lustre.0 Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.849956:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789518343.849996:0:23982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518343.850008:0:23982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.850015:0:23982:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518343.850647:0:23982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:3.0:1789518343.851381:0:23982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518343.851591:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789518343.851679:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:3.0:1789518343.851718:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:3.0:1789518343.851766:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:3.0:1789518343.851806:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:3.0:1789518343.851842:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:3.0:1789518343.851892:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:3.0:1789518343.851938:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:3.0:1789518343.851973:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 80 off9712 00000040:00080000:3.0:1789518343.852052:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9936 00000040:00080000:3.0:1789518343.852083:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10160 00000040:00080000:3.0:1789518343.852138:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 120 off10280 00000040:00080000:3.0:1789518343.852198:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 224 off10504 00000040:00080000:3.0:1789518343.852205:0:23982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:3.0:1789518343.852274:0:23982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518343.852326:0:23982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518343.852366:0:23982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518343.853754:0:23982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518343.854495:0:23982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518343.854540:0:23982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518343.855519:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627546624 00000100:00100000:1.0:1789518343.855527:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627546624 00000100:00100000:3.0:1789518343.855542:0:23982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518343.855719:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789518343.855730:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+14:23982:x1876445627546624:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518343.856505:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+14:23982:x1876445627546624:12345-0@lo:503:mount.lustre.0 Request processed in 775us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.856514:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518343.856544:0:23982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546624:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518343.857695:0:23982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518343.857857:0:23982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518343.858277:0:23982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518343.858363:0:23982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518343.859143:0:23982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518343.859388:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1789518343.859438:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:3.0:1789518343.859473:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:3.0:1789518343.859521:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:3.0:1789518343.859560:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:3.0:1789518343.859595:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:3.0:1789518343.859745:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:3.0:1789518343.859911:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:3.0:1789518343.859950:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 80 off9712 00000040:00080000:3.0:1789518343.860034:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9936 00000040:00080000:3.0:1789518343.860151:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10160 00000040:00080000:3.0:1789518343.860216:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 120 off10280 00000100:00100000:3.0:1789518343.860253:0:23982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546880:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518343.860307:0:23982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518343.860397:0:23982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518343.860542:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627546880 00000100:00100000:1.0:1789518343.860549:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627546880 00000100:00100000:1.0:1789518343.860697:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518343.860710:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+14:23982:x1876445627546880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518343.860987:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+14:23982:x1876445627546880:12345-0@lo:502:mount.lustre.0 Request processed in 268us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.860995:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518343.861060:0:23982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627546880:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518343.861131:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 224 off10504 00000040:00080000:3.0:1789518343.861141:0:23982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789518343.862381:0:23996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518343.862388:0:23996:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789518343.862393:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518343.862395:0:23996:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789518343.862398:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518343.862410:0:23996:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99fec2aa4d40) 00000020:00000080:3.0:1789518343.862427:0:23996:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789518343.862430:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789518343.862487:0:23996:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc5112000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789518343.862492:0:23996:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789518343.862496:0:23996:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c783417 00010000:00010000:3.0:1789518343.865822:0:23996:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789518343.867432:0:23996:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901904 00080000:10000000:3.0:1789518343.868848:0:23996:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:00000080:3.0:1789518343.870458:0:23996:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789518343.870469:0:23996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518343.870475:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518343.870478:0:23996:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789518343.870481:0:23996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789518343.870490:0:23996:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789518343.870492:0:23996:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518343.870495:0:23996:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518343.870497:0:23996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789518343.870500:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518343.870501:0:23996:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789518343.870503:0:23996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518343.870506:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518343.870508:0:23996:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518343.870510:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518343.870512:0:23996:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789518343.870514:0:23996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518343.870517:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518343.870518:0:23996:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789518343.870520:0:23996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518343.870522:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518343.870523:0:23996:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789518343.870526:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789518343.870575:0:23996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518343.870685:0:23996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518343.870688:0:23996:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789518343.870692:0:23996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000100:00100000:1.0:1789518343.876192:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627547136 00000100:00100000:1.0:1789518343.876206:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627547136 00000100:00100000:1.0:1789518343.876257:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518343.876267:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627547136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518343.877084:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627547136:12345-0@lo:501:mount.lustre.0 Request processed in 816us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.877092:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518343.877551:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627547264 00000100:00100000:1.0:1789518343.877557:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627547264 00000100:00100000:1.0:1789518343.877596:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789518343.877604:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627547264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518343.877859:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627547264:12345-0@lo:503:mount.lustre.0 Request processed in 255us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.877866:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789518343.879609:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627547392 00000100:00100000:3.0:1789518343.879630:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627547392 00000100:00100000:3.0:1789518343.879675:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518343.879684:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627547392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518343.879865:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627547392:12345-0@lo:502:mount.lustre.0 Request processed in 181us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518343.879872:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789518343.881043:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627547520 00000100:00100000:1.0:1789518343.881048:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627547520 00000100:00100000:1.0:1789518343.881120:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789518343.881128:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0002077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627547520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518343.881277:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0002077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627547520:12345-0@lo:502:mount.lustre.0 Request processed in 148us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.881284:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518343.881369:0:23982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:23982:1876445627547520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518343.881465:0:23982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:3.0:1789518343.881476:0:23982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789518343.882378:0:24000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518343.882387:0:24000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518343.882390:0:24000:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789518343.882397:0:24000:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc5112000 00000020:00000080:1.0:1789518343.882399:0:24000:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518343.882405:0:24000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518343.882407:0:24000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518343.882409:0:24000:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789518343.882419:0:24000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518343.882421:0:24000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518343.882423:0:24000:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789518343.882426:0:24000:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc5112000 00000020:00000080:1.0:1789518343.882428:0:24000:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518343.882486:0:24000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518343.882490:0:24000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518343.882491:0:24000:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789518343.882494:0:24000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518343.882496:0:24000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518343.882497:0:24000:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789518343.882500:0:24000:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffc5112000 00000020:00000080:1.0:1789518343.882502:0:24000:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518343.882539:0:24000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518343.882542:0:24000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518343.882543:0:24000:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789518343.882546:0:24000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000100:00100000:1.0:1789518343.883968:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627547648 00000100:00100000:1.0:1789518343.883985:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627547648 00000100:00100000:1.0:1789518343.884087:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518343.884098:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0002075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627547648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518343.884110:0:23292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518343.884123:0:23292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b44800/0x631fd8698c783433 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78342c expref: -99 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.884145:0:23292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b44800/0x631fd8698c783433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78342c expref: 16 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.884155:0:23292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b44800/0x631fd8698c783433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78342c expref: 16 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.884163:0:23292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44800, rc 0) 00000100:00100000:1.0:1789518343.884228:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0002075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+16:23982:x1876445627547648:12345-0@lo:101:mount.lustre.0 Request processed in 133us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.884235:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518343.890604:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627547776 00000100:00100000:1.0:1789518343.890611:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627547776 00000100:00100000:1.0:1789518343.890683:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518343.890692:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0002074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+16:23982:x1876445627547776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518343.890939:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0002074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+16:23982:x1876445627547776:12345-0@lo:501:mount.lustre.0 Request processed in 247us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.890947:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518343.891104:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627547904 00000100:00100000:1.0:1789518343.891109:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627547904 00000100:00100000:1.0:1789518343.891136:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789518343.891145:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0002076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+16:23982:x1876445627547904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518343.891284:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0002076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+16:23982:x1876445627547904:12345-0@lo:503:mount.lustre.0 Request processed in 140us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.891291:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789518343.901335:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627548288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518343.901399:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518343.901467:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518343.901472:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789518343.901475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518343.901480:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518343.901529:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627548288 00000100:00100000:1.0:1789518343.901535:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627548288 00000100:00100000:1.0:1789518343.901571:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518343.901578:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3279:x1876445627548288:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789518343.901599:0:23301:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:1.0:1789518343.901644:0:23301:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x631fd8698c783448 00000004:00100000:1.0:1789518343.901658:0:23301:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789518343.901683:0:23301:0:(import.c:65:import_set_state_nolock()) ffff99ffc6494000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518343.901726:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876445627548288:12345-0@lo:38:llog_process_th.0 Request processed in 147us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.901734:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518343.901755:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518343.901764:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627548416:0@lo:400:kworker.0 00000100:00100000:1.0:1789518343.901792:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518343.901825:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627548416 00000100:00100000:1.0:1789518343.901829:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627548416 00000100:00100000:1.0:1789518343.901859:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518343.901866:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627548416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518343.901906:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627548416:12345-0@lo:400:kworker.0 Request processed in 41us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.901912:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789518343.901950:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffed744380 x1876445627548288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518343.901972:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518343.901988:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 4 00000100:00080000:1.0:1789518343.901999:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789518343.902004:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518343.902007:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec11e1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518343.902020:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627548288:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1789518343.926038:0:23294:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518343.926061:0:23294:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789518343.926684:0:23284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627548672 00000100:00100000:1.0:1789518343.926692:0:23284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627548672 00000100:00100000:1.0:1789518343.926738:0:23284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518343.926747:0:23284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+3:23316:x1876445627548672:12345-0@lo:104: 00010000:00010000:1.0:1789518343.926759:0:23284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.926832:0:23284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789518343.926838:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789518343.926845:0:23284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+3:23316:x1876445627548672:12345-0@lo:104: Request processed in 94us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.926857:0:23284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789518343.926911:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.926921:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518343.926925:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.926934:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518343.926940:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518343.926946:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518343.926995:0:23289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.927003:0:23289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518343.927041:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.927050:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c7833b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7833bc expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.927067:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518343.927075:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518343.927078:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518343.927094:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c8a322e-2788-4faf-9195-ae294b8818bd:3280:1876445627548800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518343.927141:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518343.927182:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627548800 00000100:00100000:1.0:1789518343.927188:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627548800 00010000:00010000:1.0:1789518343.927209:0:23285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fff5b45600/0x631fd8698c7833bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7833b5 expref: 17 pid: 23292 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518343.927210:0:23316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23316:1876445627548672:0@lo:104: 00000100:00100000:1.0:1789518343.927246:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518343.927253:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+17:3280:x1876445627548800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518343.927263:0:23285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518343.927268:0:23285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fff5b45600/0x631fd8698c7833bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7833b5 expref: 17 pid: 23292 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927280:0:23285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fff5b45600/0x631fd8698c7833bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7833b5 expref: 17 pid: 23292 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.927294:0:23316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927304:0:23285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b45600/0x631fd8698c7833bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7833b5 expref: 17 pid: 23292 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927328:0:23285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927336:0:23285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789518343.927348:0:23285:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001927118s 00010000:00010000:1.0:1789518343.927352:0:23285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927359:0:23285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927366:0:23285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927372:0:23285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927377:0:23285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14ce00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518343.927381:0:23285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927388:0:23285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927412:0:23285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518343.927422:0:23285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518343.927458:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+16:3280:x1876445627548800:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518343.927467:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518343.927536:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c8a322e-2788-4faf-9195-ae294b8818bd:3280:1876445627548800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518343.927557:0:23316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.927565:0:23316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518343.927571:0:23316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc14ce00/0x631fd8698c78344f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518343.935265:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23982:x1876445627548544:12345-0@lo:253:mount.lustre.0 Request processed in 32523us (32892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518343.935278:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000001:00000004:1.0:1789518343.942739:0:23982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869184 10000000:01000000:1.0:1789518345.074726:0:23297:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789518345.074734:0:23297:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffc5e32800 from 13 10000000:01000000:1.0:1789518345.074739:0:23297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789518345.074791:0:23297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518345.074803:0:23297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518345.074814:0:23297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518345.074839:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627548928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518345.074902:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518345.074965:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627548928 00000100:00100000:1.0:1789518345.074985:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518345.074989:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627548928 00000100:00100000:3.0:1789518345.075058:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789518345.075073:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+15:23297:x1876445627548928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518345.075093:0:23292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518345.076255:0:23292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bce00/0x631fd8698c78345d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783456 expref: -99 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518345.076289:0:23292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bce00/0x631fd8698c78345d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783456 expref: 16 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518345.076370:0:23292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bce00/0x631fd8698c78345d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783456 expref: 16 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518345.076381:0:23292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:3.0:1789518345.076445:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+16:23297:x1876445627548928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1377us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518345.076454:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518345.076650:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627548928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518345.076668:0:23297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518345.076678:0:23297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518345.076734:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627549056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789518345.076775:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518345.076816:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518345.076886:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627549056 00000100:00100000:3.0:1789518345.076893:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627549056 00000100:00100000:1.0:1789518345.077163:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627549056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789518345.077217:0:23297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789518345.077224:0:23297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518345.077233:0:23297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518348.021643:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518348.021657:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c8a322e-2788-4faf-9195-ae294b8818bd:3280:1876445627549184:0@lo:400:kworker.0 00000100:00100000:1.0:1789518348.021693:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518348.022793:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789518348.022837:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffed745500 x1876445627549312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518348.022851:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518348.022860:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:1.0:1789518348.022868:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789518348.022873:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789518348.022876:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec271e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789518348.022890:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789518348.022896:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627549312:0@lo:8:kworker.0 00000100:00100000:3.0:1789518348.023596:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627549184 00000100:00100000:3.0:1789518348.023604:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627549184 00000100:00100000:3.0:1789518348.023672:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518348.023681:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+16:3280:x1876445627549184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518348.023754:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+16:3280:x1876445627549184:12345-0@lo:400:kworker.0 Request processed in 73us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518348.023762:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518348.023811:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c8a322e-2788-4faf-9195-ae294b8818bd:3280:1876445627549184:0@lo:400:kworker.0 00000100:00100000:1.0:1789518348.024655:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518348.024665:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627549824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518348.024696:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518348.024736:0:23987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627549824 00000100:00100000:1.0:1789518348.024741:0:23987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627549824 00000100:00100000:1.0:1789518348.024785:0:23987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518348.024801:0:23987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627549824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518348.024829:0:23987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518348.024876:0:23987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627549824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518348.024882:0:23987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789518348.024898:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789518348.024986:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fff4002680 x1876445627549824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518348.025000:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627549824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789518348.047243:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.047252:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c78346b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.047263:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.047267:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c78346b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.047278:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c78346b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.047308:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c78346b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.047316:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c78346b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.047349:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.047352:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.047355:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.048887:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.048895:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c783472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.048904:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14ca00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.048915:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c783472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.048924:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c783472 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.048942:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c783472 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.048950:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c783472 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.048997:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.049000:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.049003:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.049630:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.049637:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c783479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049645:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.049650:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c783479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049659:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c783479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049672:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c783479 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049679:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c783479 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049694:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.049696:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.049698:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.049880:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.049886:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c783480 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049904:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.049908:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c783480 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049917:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c783480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049930:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c783480 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049938:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c783480 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.049952:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.049968:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.049971:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.050266:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.050271:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c783487 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050279:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.050282:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c783487 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050290:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c783487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050308:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c783487 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050316:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c783487 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050332:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.050333:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.050335:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.050734:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.050739:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78348e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050747:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14dc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.050751:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78348e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050759:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78348e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050771:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78348e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050779:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78348e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.050863:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.050866:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.050868:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.051270:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.051276:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ab54810/0x631fd8698c783495 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.051284:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14ce00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.051287:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ab54810/0x631fd8698c783495 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.051295:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ab54810/0x631fd8698c783495 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.051308:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ab54810/0x631fd8698c783495 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.051314:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ab54810/0x631fd8698c783495 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.051328:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.051330:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.051331:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.055466:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.061520:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.061528:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c7834b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.061544:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.061548:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c7834b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.061558:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c7834b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.061575:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c7834b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.061582:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c7834b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.061602:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.061605:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.061607:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518348.063401:0:24439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518348.063412:0:24439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.063427:0:24439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x55:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1789518348.063432:0:24439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518348.063436:0:24439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.063449:0:24439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.063465:0:24439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.063473:0:24439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.063490:0:24439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518348.064031:0:24439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518348.064037:0:24439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064046:0:24439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x54:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1789518348.064049:0:24439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518348.064052:0:24439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064062:0:24439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064069:0:24439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064077:0:24439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064103:0:24439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789518348.064114:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518348.064119:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064126:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.064131:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064140:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064155:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064162:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9de4e7/0x631fd8698c7834bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064183:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.064186:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064192:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.064196:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064217:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064232:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064239:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c7834c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.064257:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.064259:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.064261:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.066002:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518348.066009:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c7834cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066018:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.066023:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c7834cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066033:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c7834cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066049:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c7834cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066069:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c00b65d5/0x631fd8698c7834cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066090:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.066094:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034f91c82/0x631fd8698c7834d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066101:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.066105:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f91c82/0x631fd8698c7834d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066113:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f91c82/0x631fd8698c7834d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066126:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034f91c82/0x631fd8698c7834d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066133:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034f91c82/0x631fd8698c7834d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066147:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.066149:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.066152:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.066784:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.066791:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4565f2f/0x631fd8698c7834db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066805:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.066809:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4565f2f/0x631fd8698c7834db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066818:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4565f2f/0x631fd8698c7834db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066832:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4565f2f/0x631fd8698c7834db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066839:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4565f2f/0x631fd8698c7834db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.066857:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.066860:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.066862:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.068145:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518348.068152:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008db14de8/0x631fd8698c7834e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068161:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.068165:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008db14de8/0x631fd8698c7834e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068174:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008db14de8/0x631fd8698c7834e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068195:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008db14de8/0x631fd8698c7834e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068203:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008db14de8/0x631fd8698c7834e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068218:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.068221:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c7834e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068227:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.068230:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c7834e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068238:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c7834e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068247:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c7834e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068259:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c7834e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.068270:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.068272:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.068279:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.070822:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.070830:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c7834f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.070839:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.070844:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c7834f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.070853:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c7834f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.070870:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c7834f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.070877:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c7834f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.070895:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.070897:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.070898:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.072588:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.072596:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1a882a1/0x631fd8698c7834f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.072603:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.072608:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1a882a1/0x631fd8698c7834f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.072645:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1a882a1/0x631fd8698c7834f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.072661:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1a882a1/0x631fd8698c7834f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.072669:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1a882a1/0x631fd8698c7834f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.072687:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.072689:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.072691:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.074825:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518348.074832:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c7834fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075033:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.075038:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c7834fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075047:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c7834fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075061:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c7834fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075079:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c7834fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075093:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.075096:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002379b8dd/0x631fd8698c783505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075103:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.075106:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002379b8dd/0x631fd8698c783505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075114:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002379b8dd/0x631fd8698c783505 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075123:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002379b8dd/0x631fd8698c783505 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075131:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.075133:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.075135:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.075922:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.075928:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4aa88f4/0x631fd8698c78350c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075936:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.075944:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aa88f4/0x631fd8698c78350c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075961:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4aa88f4/0x631fd8698c78350c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075974:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4aa88f4/0x631fd8698c78350c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075981:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4aa88f4/0x631fd8698c78350c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.075996:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.075999:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.076000:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.077658:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518348.077666:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c78351a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.077673:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.077677:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c78351a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.077686:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c78351a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.077700:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c78351a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.077715:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c78351a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.077731:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.077734:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044e0d026/0x631fd8698c783521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.077741:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.077745:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044e0d026/0x631fd8698c783521 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.077752:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044e0d026/0x631fd8698c783521 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.077761:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044e0d026/0x631fd8698c783521 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.077769:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.077770:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.077772:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.079365:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518348.079372:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c783528 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.079380:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.079391:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c783528 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.079401:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c783528 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.079416:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c783528 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.079423:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c783528 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.079441:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518348.079444:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006012991/0x631fd8698c78352f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.079450:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518348.079452:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006012991/0x631fd8698c78352f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.079459:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006012991/0x631fd8698c78352f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.079469:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006012991/0x631fd8698c78352f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518348.079477:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.079484:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518348.079487:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789518349.465713:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869185 is committed 00000001:00100000:3.0:1789518349.465762:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1789518349.747083:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789518349.747094:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518349.747199:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:3.0:1789518349.747208:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000020:01000004:3.0:1789518350.949597:0:24698:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789518350.949601:0:24698:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789518350.949722:0:24698:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99fec26f0800 00000020:01000004:3.0:1789518350.949738:0:24698:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789518350.949750:0:24698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789518350.949763:0:24698:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99fec2aa3380) 00000020:00000080:3.0:1789518350.949777:0:24698:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789518350.962095:0:24698:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789518350.963124:0:24698:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789518350.963975:0:24698:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789518350.964205:0:24698:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789518350.964463:0:24698:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xc:0x0] (8/32) 00100000:10000000:3.0:1789518350.964827:0:24698:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 495: rc = 0 00100000:10000000:3.0:1789518350.964926:0:24698:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 495: rc = 0 00100000:10000000:3.0:1789518350.965035:0:24698:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 495: rc = 0 00100000:10000000:3.0:1789518350.965502:0:24698:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1789518350.970957:0:24698:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:3.0:1789518350.971255:0:24698:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:3.0:1789518350.972730:0:24698:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1789518350.973031:0:24698:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:3.0:1789518350.973304:0:24698:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 770: rc = 0 00000020:00000080:3.0:1789518350.975118:0:24698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789518350.975129:0:24698:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789518350.975138:0:24698:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c78353d 00000020:01000004:3.0:1789518350.975146:0:24698:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789518350.975165:0:24698:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789518350.975168:0:24698:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789518350.975173:0:24698:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789518350.975193:0:24698:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789518350.975197:0:24698:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:3.0:1789518350.996689:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+16:24698:x1876445627550208:12345-0@lo:253:mount.lustre.0 Request processed in 6109us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518350.996702:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518350.997349:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627550336 00000100:00100000:3.0:1789518350.997355:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627550336 00000100:00100000:3.0:1789518350.997398:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789518350.997407:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+16:24698:x1876445627550336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518350.997561:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+16:24698:x1876445627550336:12345-0@lo:501:mount.lustre.0 Request processed in 155us (403us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518350.997568:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789518350.998122:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627550464 00000100:00100000:3.0:1789518350.998127:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627550464 00000100:00100000:3.0:1789518350.998161:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789518350.998168:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+16:24698:x1876445627550464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518350.998176:0:23295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518350.998188:0:23295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd800/0x631fd8698c78354b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783544 expref: -99 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518350.998209:0:23295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd800/0x631fd8698c78354b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783544 expref: 17 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518350.998227:0:23295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd800/0x631fd8698c78354b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783544 expref: 17 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518350.998235:0:23295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd800, rc 0) 00000100:00100000:3.0:1789518350.998273:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+17:24698:x1876445627550464:12345-0@lo:101:mount.lustre.0 Request processed in 105us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518350.998280:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000040:00080000:3.0:1789518351.001967:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789518351.002015:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:3.0:1789518351.002049:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:3.0:1789518351.002097:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:3.0:1789518351.002134:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:3.0:1789518351.002172:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:3.0:1789518351.002224:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:3.0:1789518351.002262:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:3.0:1789518351.002309:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 120 off9752 00000040:00080000:3.0:1789518351.002364:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9976 00000040:00080000:3.0:1789518351.002372:0:24698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 10 count 11 00000100:00100000:3.0:1789518351.002463:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627550592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518351.002609:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.002737:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518351.005311:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627550592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518351.005360:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627550720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518351.005404:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.006672:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627550720 00000100:00100000:3.0:1789518351.006682:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627550720 00000100:00100000:1.0:1789518351.006690:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518351.007193:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627550720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518351.007764:0:24698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518351.007832:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627550848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518351.007877:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518351.007905:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518351.008592:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627550848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518351.008849:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1789518351.008901:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:1.0:1789518351.008937:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:1.0:1789518351.009002:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:1.0:1789518351.009039:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:1.0:1789518351.009090:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:1.0:1789518351.009154:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:1.0:1789518351.009191:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:1.0:1789518351.009247:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 120 off9752 00000100:00100000:1.0:1789518351.009277:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627550976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518351.009317:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518351.009354:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518351.010045:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627550976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518351.010508:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9976 00000040:00080000:1.0:1789518351.010521:0:24698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789518351.012127:0:24699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789518351.012136:0:24699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789518351.012143:0:24699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518351.012145:0:24699:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789518351.012151:0:24699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518351.012166:0:24699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99fec18c99c0) 00000020:00000080:1.0:1789518351.012190:0:24699:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789518351.012196:0:24699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789518351.012274:0:24699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fec26f0800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789518351.012282:0:24699:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789518351.012290:0:24699:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c783559 00010000:00010000:1.0:1789518351.017047:0:24699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789518351.017774:0:24699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 12884901901 00080000:10000000:1.0:1789518351.019917:0:24699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:01000000:3.0:1789518351.021953:0:24698:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789518351.021982:0:24698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789518351.022040:0:24698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.022053:0:24698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518351.022070:0:24698:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fec26f0800 from 1 10000000:01000000:3.0:1789518351.022074:0:24698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518351.022107:0:24698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.022113:0:24698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.022121:0:24698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518351.022139:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518351.022200:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.022259:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518351.022538:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518351.022567:0:24698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783567 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.022576:0:24698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783567 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518351.029557:0:24698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000040:00080000:1.0:1789518351.030839:0:24698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518351.031401:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:1.0:1789518351.031460:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:1.0:1789518351.031522:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:1.0:1789518351.031555:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:1.0:1789518351.031582:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:1.0:1789518351.031727:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:1.0:1789518351.031775:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9536 00000040:00080000:1.0:1789518351.031810:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 128 off9664 00000040:00080000:1.0:1789518351.031952:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:1.0:1789518351.031961:0:24698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 9 count 10 00000100:00100000:1.0:1789518351.032116:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518351.032178:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518351.032226:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518351.032670:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518351.032701:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518351.032743:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518351.032763:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518351.033199:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518351.034170:0:24698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518351.034244:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518351.034294:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.034331:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518351.034758:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518351.034977:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:3.0:1789518351.035022:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:3.0:1789518351.035145:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:3.0:1789518351.035188:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:3.0:1789518351.035216:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000040:00080000:3.0:1789518351.035258:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:3.0:1789518351.035308:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9536 00000040:00080000:3.0:1789518351.035340:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 128 off9664 00000100:00100000:3.0:1789518351.035366:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518351.035405:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.035490:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518351.036059:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518351.036210:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:3.0:1789518351.036220:0:24698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789518351.037348:0:24703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518351.037358:0:24703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518351.037360:0:24703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789518351.037368:0:24703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fec26f0800 00000020:00000080:1.0:1789518351.037371:0:24703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518351.037377:0:24703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518351.037380:0:24703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518351.037381:0:24703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789518351.037384:0:24703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518351.037386:0:24703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518351.037387:0:24703:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789518351.037391:0:24703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fec26f0800 00000020:00000080:1.0:1789518351.037393:0:24703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518351.037448:0:24703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518351.037452:0:24703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518351.037454:0:24703:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789518351.037456:0:24703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518351.037459:0:24703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518351.037460:0:24703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789518351.037463:0:24703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99fec26f0800 00000020:00000080:1.0:1789518351.037474:0:24703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518351.037509:0:24703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518351.037512:0:24703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518351.037514:0:24703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789518351.037517:0:24703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000020:01000000:3.0:1789518351.037774:0:24698:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789518351.037798:0:24698:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518351.037855:0:24698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783567 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.037868:0:24698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783567 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518351.037913:0:24698:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789518351.037916:0:24698:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99fec26f0800 10000000:01000000:3.0:1789518351.037919:0:24698:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99fec26f0800 10000000:01000000:3.0:1789518351.037923:0:24698:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518351.037929:0:24698:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99fec26f0800 from 1 10000000:01000000:3.0:1789518351.037931:0:24698:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518351.037977:0:24698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.037986:0:24698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.037997:0:24698:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518351.038021:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518351.038090:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.038136:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518351.038199:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627551744 00000100:00100000:1.0:1789518351.038206:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627551744 00000100:00100000:1.0:1789518351.038254:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518351.038265:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+18:24698:x1876445627551744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518351.038278:0:23294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518351.038292:0:23294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b45000/0x631fd8698c783575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78356e expref: -99 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518351.038314:0:23294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b45000/0x631fd8698c783575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78356e expref: 19 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518351.038325:0:23294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b45000/0x631fd8698c783575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78356e expref: 19 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518351.038334:0:23294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45000, rc 0) 00000100:00100000:1.0:1789518351.038372:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+19:24698:x1876445627551744:12345-0@lo:101:mount.lustre.0 Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518351.038379:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789518351.038466:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518351.038481:0:24698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.038491:0:24698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518351.039207:0:24698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000040:00080000:3.0:1789518351.039738:0:24698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518351.040121:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:3.0:1789518351.040169:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:3.0:1789518351.040205:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:3.0:1789518351.040276:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:3.0:1789518351.040323:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:3.0:1789518351.040376:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:3.0:1789518351.040417:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:3.0:1789518351.040455:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:3.0:1789518351.040503:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:3.0:1789518351.040552:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:3.0:1789518351.040604:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:3.0:1789518351.040684:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:3.0:1789518351.040722:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:3.0:1789518351.040753:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:3.0:1789518351.040795:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:3.0:1789518351.040829:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:3.0:1789518351.040863:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:3.0:1789518351.040910:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:3.0:1789518351.040960:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:3.0:1789518351.040997:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:3.0:1789518351.041043:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:3.0:1789518351.041079:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:3.0:1789518351.041112:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:3.0:1789518351.041171:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:3.0:1789518351.041208:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 128 off12440 00000040:00080000:3.0:1789518351.041241:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12664 00000040:00080000:3.0:1789518351.041745:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12888 00000040:00080000:3.0:1789518351.041790:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off12968 00000040:00080000:3.0:1789518351.041824:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13192 00000040:00080000:3.0:1789518351.041965:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13416 00000040:00080000:3.0:1789518351.042006:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13504 00000040:00080000:3.0:1789518351.042042:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13632 00000040:00080000:3.0:1789518351.042079:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13776 00000040:00080000:3.0:1789518351.042136:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13904 00000040:00080000:3.0:1789518351.042186:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14128 00000040:00080000:3.0:1789518351.042316:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14352 00000040:00080000:3.0:1789518351.042358:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14432 00000040:00080000:3.0:1789518351.042392:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14656 00000040:00080000:3.0:1789518351.042444:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14880 00000040:00080000:3.0:1789518351.042484:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 120 off15000 00000040:00080000:3.0:1789518351.042596:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 224 off15224 00000040:00080000:3.0:1789518351.042604:0:24698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 41 count 42 00000100:00100000:3.0:1789518351.042729:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518351.042793:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.042901:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518351.043304:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627551872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518351.043340:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627552000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518351.043380:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.043407:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518351.044572:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627552000:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518351.045271:0:24698:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518351.045357:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627552128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518351.045413:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.045470:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518351.045494:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627552128 00000100:00100000:1.0:1789518351.045501:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627552128 00000100:00100000:1.0:1789518351.045546:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789518351.045554:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+19:24698:x1876445627552128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518351.045799:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+19:24698:x1876445627552128:12345-0@lo:502:mount.lustre.0 Request processed in 245us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518351.045827:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518351.046535:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627552128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518351.050053:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:3.0:1789518351.050165:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:3.0:1789518351.050210:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:3.0:1789518351.050263:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:3.0:1789518351.050300:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:3.0:1789518351.050344:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:3.0:1789518351.050387:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:3.0:1789518351.050428:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:3.0:1789518351.050485:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:3.0:1789518351.050534:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:3.0:1789518351.050576:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:3.0:1789518351.050686:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:3.0:1789518351.050758:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:3.0:1789518351.050816:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:3.0:1789518351.050895:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:3.0:1789518351.050969:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:3.0:1789518351.051025:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:3.0:1789518351.051096:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:3.0:1789518351.051146:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:3.0:1789518351.051191:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:3.0:1789518351.051241:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:3.0:1789518351.051281:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:3.0:1789518351.051312:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:3.0:1789518351.051357:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:3.0:1789518351.051394:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 128 off12440 00000040:00080000:3.0:1789518351.051727:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12664 00000040:00080000:3.0:1789518351.051870:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12888 00000040:00080000:3.0:1789518351.051925:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off12968 00000040:00080000:3.0:1789518351.052002:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13192 00000040:00080000:3.0:1789518351.052069:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13416 00000040:00080000:3.0:1789518351.052140:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13504 00000040:00080000:3.0:1789518351.052184:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13632 00000040:00080000:3.0:1789518351.052219:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13776 00000040:00080000:3.0:1789518351.052269:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13904 00000040:00080000:3.0:1789518351.052307:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14128 00000040:00080000:3.0:1789518351.052357:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14352 00000040:00080000:3.0:1789518351.052394:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14432 00000040:00080000:3.0:1789518351.052440:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14656 00000040:00080000:3.0:1789518351.052522:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14880 00000040:00080000:3.0:1789518351.052571:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 120 off15000 00000100:00100000:3.0:1789518351.054289:0:24698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627552256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518351.054385:0:24698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.054429:0:24698:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518351.054976:0:24698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c8a322e-2788-4faf-9195-ae294b8818bd:24698:1876445627552256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518351.055075:0:24698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 224 off15224 00000040:00080000:3.0:1789518351.055097:0:24698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:00000080:1.0:1789518351.062132:0:24708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789518351.062244:0:24708:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789518351.062257:0:24708:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x631fd8698c783583 00000100:00080000:1.0:1789518351.062267:0:24708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518351.062278:0:24708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99ffc76f6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518351.062310:0:24708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fffc5f0380 x1876445627552384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518351.062340:0:24708:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518351.062663:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627552768:0@lo:400:kworker.0 00000100:00100000:1.0:1789518351.062720:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518351.062837:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627552896 00000100:00100000:1.0:1789518351.062843:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627552896 00000100:00100000:1.0:1789518351.062875:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627552768 00000100:00100000:1.0:1789518351.062880:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627552768 00000100:00100000:1.0:1789518351.062900:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518351.062908:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627552896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518351.062968:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627552896:12345-0@lo:400:kworker.0 Request processed in 59us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518351.062979:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518351.062998:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518351.063008:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627552768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518351.063047:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627552768:12345-0@lo:400:kworker.0 Request processed in 41us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518351.063058:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789518351.063097:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fff4003b80 x1876445627552896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518351.063115:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627552896:0@lo:400:kworker.0 00010000:00080000:1.0:1789518351.063148:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fff4001f80 x1876445627552768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518351.063157:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627552768:0@lo:400:kworker.0 00000100:00100000:3.0:1789518351.063198:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627552384:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518351.063237:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.063273:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627552640:0@lo:8:kworker.0 00000040:00080000:1.0:1789518351.063297:0:24708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000100:00100000:3.0:1789518351.063298:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518351.063345:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627552640 00000100:00100000:3.0:1789518351.063350:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627552640 00000100:00100000:3.0:1789518351.063377:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518351.063383:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627552640:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789518351.063430:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627552640:12345-0@lo:8:kworker.0 Request processed in 46us (131us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789518351.063437:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518351.063466:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518351.063471:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc5de1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518351.063474:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789518351.063478:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627552640:0@lo:8:kworker.0 00000100:00100000:3.0:1789518351.063500:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627552384 00000100:00100000:3.0:1789518351.063503:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627552384 00000100:00100000:3.0:1789518351.063703:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518351.063708:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627552384:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789518351.063725:0:23302:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:3.0:1789518351.063756:0:23302:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x631fd8698c78358a 00000004:00100000:3.0:1789518351.063769:0:23302:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789518351.063791:0:23302:0:(import.c:65:import_set_state_nolock()) ffff99ffed5a7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518351.063874:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876445627552384:12345-0@lo:38:llog_process_th.0 Request processed in 165us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518351.063892:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518351.065810:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627553024 00000100:00100000:3.0:1789518351.065816:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627553024 00000100:00100000:3.0:1789518351.065857:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789518351.065867:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+19:24698:x1876445627553024:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518351.065894:0:23292:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789518351.065907:0:23292:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789518351.083330:0:23292:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518351.083383:0:23292:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789518351.084025:0:23284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627553152 00000100:00100000:1.0:1789518351.084034:0:23284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627553152 00000100:00100000:1.0:1789518351.084126:0:23284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518351.084136:0:23284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+3:23316:x1876445627553152:12345-0@lo:104: 00010000:00010000:1.0:1789518351.084148:0:23284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518351.084209:0:23284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518351.084216:0:23284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+3:23316:x1876445627553152:12345-0@lo:104: Request processed in 82us (426us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518351.084219:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789518351.084225:0:23284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789518351.084228:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.084237:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518351.084241:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.084250:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518351.084257:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518351.084263:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789518351.084269:0:23316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23316:1876445627553152:0@lo:104: 00010000:00010000:1.0:1789518351.084288:0:23316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc6b16600/0x631fd8698c783591 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.084302:0:23289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.084310:0:23289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518351.084338:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.084358:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c783456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78345d expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518351.084374:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518351.084376:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518351.084378:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518351.084743:0:23316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc6b16600/0x631fd8698c783591 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518351.084777:0:23316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16600/0x631fd8698c783591 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518351.084805:0:23316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16600/0x631fd8698c783591 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518351.090841:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+18:24698:x1876445627553024:12345-0@lo:253:mount.lustre.0 Request processed in 24969us (25787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518351.090855:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789518352.499459:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627553408 00000100:00100000:3.0:1789518352.499467:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627553408 00000100:00100000:3.0:1789518352.499646:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789518352.499657:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+18:23297:x1876445627553408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518352.499671:0:23295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518352.499685:0:23295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc200/0x631fd8698c78359f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783598 expref: -99 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518352.499708:0:23295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc200/0x631fd8698c78359f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783598 expref: 19 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518352.499718:0:23295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bc200/0x631fd8698c78359f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783598 expref: 19 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518352.499727:0:23295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc200, rc 0) 00000100:00100000:3.0:1789518352.499776:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+19:23297:x1876445627553408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518352.499782:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789518352.500112:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627553536 00000100:00100000:3.0:1789518352.500117:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627553536 00000100:00100000:3.0:1789518352.500151:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518352.500159:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+19:23297:x1876445627553536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789518352.500217:0:23292:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00100000:3.0:1789518352.500499:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627553536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518352.500558:0:23297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518352.500567:0:23297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518352.500577:0:23297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518352.627286:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518353.522950:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627553664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518353.523012:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518353.523486:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789518354.623655:0:25051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789518354.678214:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518355.884289:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518355.901309:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1789518355.901322:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+7:20442:x1876445617130496:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789518355.901609:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+8:20442:x1876445617130496:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 290us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518355.901646:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1789518355.907546:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518355.912472:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617130752 00000100:00100000:3.0:1789518355.912484:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617130752 00000100:00100000:3.0:1789518355.912709:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518355.912784:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+8:20460:x1876445617130752:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518355.913448:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+8:20460:x1876445617130752:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 664us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518355.913458:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:1.0:1789518355.928835:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518355.931200:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617131008 00000100:00100000:3.0:1789518355.931224:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617131008 00000100:00100000:3.0:1789518355.931429:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1789518355.931442:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+8:20442:x1876445617131008:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518355.931463:0:23295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518355.931486:0:23295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc400/0x631fd8698c7835bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd066 expref: -99 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518355.931522:0:23295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc400/0x631fd8698c7835bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd066 expref: 9 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518355.931536:0:23295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bc400/0x631fd8698c7835bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd066 expref: 9 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518355.931545:0:23295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:3.0:1789518355.931940:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+9:20442:x1876445617131008:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 490us (3109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518355.931954:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1789518355.937372:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518355.942879:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518355.942943:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617131264 00000100:00100000:3.0:1789518355.942953:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617131264 00000100:00100000:3.0:1789518355.943064:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1789518355.943074:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+9:20442:x1876445617131264:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518355.943090:0:23295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518355.943116:0:23295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bce00/0x631fd8698c7835c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd06d expref: -99 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518355.943144:0:23295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bce00/0x631fd8698c7835c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd06d expref: 10 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518355.943156:0:23295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bce00/0x631fd8698c7835c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd06d expref: 10 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518355.943164:0:23295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:3.0:1789518355.943227:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+10:20442:x1876445617131264:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 151us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518355.943234:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1789518355.945577:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518355.948049:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617131520 00000100:00100000:3.0:1789518355.948100:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617131520 00000100:00100000:3.0:1789518355.948156:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1789518355.948165:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+10:20442:x1876445617131520:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789518355.948590:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+10:20442:x1876445617131520:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 424us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518355.948599:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:1.0:1789518355.951339:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518355.954456:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617131776 00000100:00100000:3.0:1789518355.954470:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617131776 00000100:00100000:3.0:1789518355.957478:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518355.957714:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617131904 00000100:00100000:1.0:1789518355.957722:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617131904 00000100:00100000:1.0:1789518355.957764:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518355.957772:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2341:x1876445617131904:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789518355.957798:0:23301:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b6d4c95d-bde2-47cb-a27f-4c74703c2487@192.168.206.51@tcp t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:1.0:1789518355.957840:0:23301:0:(genops.c:1384:class_connect()) connect: client b6d4c95d-bde2-47cb-a27f-4c74703c2487, cookie 0x631fd8698c7835c9 00000004:00100000:1.0:1789518355.957866:0:23301:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789518355.957872:0:23301:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869184 00000100:00080000:1.0:1789518355.988164:0:23301:0:(import.c:65:import_set_state_nolock()) ffff99fec3ad9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518355.988284:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2341:x1876445617131904:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 30510us (30810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518355.988295:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518355.995811:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518355.995890:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00080000:1.0:1789518355.996069:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518355.998648:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617132288 00000100:00100000:3.0:1789518355.998657:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617132288 00000100:00100000:3.0:1789518356.000751:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518356.001685:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518356.002027:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518356.002211:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617132672 00000100:00100000:1.0:1789518356.002217:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617132672 00000100:00100000:1.0:1789518356.004946:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518356.004971:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:20442:x1876445617132672:12345-192.168.206.51@tcp:33:mount.lustre.0 00000100:00100000:1.0:1789518356.082977:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c8a322e-2788-4faf-9195-ae294b8818bd:3282:1876445627553792:0@lo:400:kworker.0 00000100:00100000:1.0:1789518356.083050:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518356.083121:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627554432:0@lo:400:kworker.0 00000100:00100000:1.0:1789518356.083166:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518356.083269:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627554048:0@lo:8:kworker.0 00000100:00100000:1.0:1789518356.083299:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627554176 00000100:00100000:3.0:1789518356.083305:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518356.083308:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627554176 00000100:00100000:3.0:1789518356.083364:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627553792 00000100:00100000:3.0:1789518356.083370:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627553792 00000100:00100000:3.0:1789518356.083404:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789518356.083414:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+19:3282:x1876445627553792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518356.083462:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+19:3282:x1876445627553792:12345-0@lo:400:kworker.0 Request processed in 50us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518356.083469:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789518356.083667:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627554048 00000100:00100000:3.0:1789518356.083674:0:24439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627554048 00010000:00080000:1.0:1789518356.088490:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4002300 x1876445627554176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518356.088504:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627554176:0@lo:400:kworker.0 00000100:00100000:1.0:1789518356.088889:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627554688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518356.088942:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518356.088986:0:23988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627554688 00000100:00100000:1.0:1789518356.088990:0:23988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627554688 00000100:00100000:1.0:1789518356.089028:0:23988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518356.089039:0:23988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627554688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518356.089056:0:23988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789518356.089109:0:23988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627554688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518356.089123:0:23988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789518356.089234:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffed746a00 x1876445627554688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518356.089262:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627554688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518356.090803:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627554560 00000100:00100000:3.0:1789518356.090814:0:24439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627554560 00000100:00100000:3.0:1789518356.090853:0:24439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518356.090862:0:24439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627554560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789518356.090884:0:24439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:67 count 1 00000100:00100000:3.0:1789518356.095889:0:24439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627554560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5025us (6773us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518356.095899:0:24439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:3.0:1789518356.095973:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff4000a80, transno 0 00000004:00080000:3.0:1789518356.095981:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff4000a80/1, rc -2, transno 0 00000100:00100000:3.0:1789518356.095992:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627554560:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1789518356.096506:0:23325:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 3, last_idx 4 00000040:00080000:3.0:1789518356.096573:0:23325:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00010000:00010000:1.0:1789518356.110489:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.110498:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7835fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.110508:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.110513:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7835fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.110522:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7835fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.110540:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7835fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.110549:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7835fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.110569:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.110572:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.110575:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.118723:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.118730:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c78362b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.118738:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.118748:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c78362b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.118757:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c78362b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.118769:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c78362b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.118776:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.118778:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.118779:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789518356.119528:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:3.0:1789518356.119545:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b6d4c95d-bde2-47cb-a27f-4c74703c2487 00010000:00010000:1.0:1789518356.119706:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.119711:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c783632 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.119720:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.119724:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c783632 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.119733:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c783632 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.119746:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c783632 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.119754:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d45c37ed/0x631fd8698c783632 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.119777:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.119779:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.119781:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.120558:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.122001:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.122008:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c78364e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.122017:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.122020:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c78364e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.122029:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c78364e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.122042:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c78364e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.122049:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c78364e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.122064:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.122066:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.122067:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.123194:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.123199:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c78365c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.123212:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.123216:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c78365c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.123224:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c78365c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.123236:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c78365c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.123243:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c78365c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.123256:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.123258:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.123260:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.124782:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.124789:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c78366a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.124796:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.124800:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c78366a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.124807:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c78366a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.124826:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c78366a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.124833:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c78366a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.124860:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.124862:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.124864:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.125985:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.127013:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518356.127019:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c78367f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127027:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.127031:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c78367f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127040:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c78367f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127052:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c78367f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127060:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c78367f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127086:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.127090:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c783686 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127096:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.127100:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c783686 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127108:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c783686 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127116:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c783686 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127123:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c783686 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127134:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.127137:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c78368d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127143:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.127146:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c78368d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127164:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c78368d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127175:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c78368d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127182:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c78368d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.127211:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.127213:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.127214:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.128211:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518356.128217:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c783694 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.128223:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.128227:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c783694 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.128234:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c783694 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.128246:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c783694 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.128264:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c783694 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.128280:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.128283:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c78369b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.128289:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28cc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.128292:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c78369b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.128299:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c78369b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.128309:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c78369b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.128317:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.128318:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.128320:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.130744:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518356.130751:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049b03855/0x631fd8698c7836a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.130759:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.130769:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049b03855/0x631fd8698c7836a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.130779:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049b03855/0x631fd8698c7836a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.130793:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049b03855/0x631fd8698c7836a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.130801:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049b03855/0x631fd8698c7836a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.130819:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518356.130822:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bd2510e/0x631fd8698c7836b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518356.130825:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518356.130828:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.130829:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518356.130832:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bd2510e/0x631fd8698c7836b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518356.130835:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.130839:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bd2510e/0x631fd8698c7836b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.130848:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bd2510e/0x631fd8698c7836b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.130856:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bd2510e/0x631fd8698c7836b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518356.130874:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.130876:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518356.130878:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518356.133578:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518356.134484:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:23326:x1876445627554944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3483us (3924us total) trans 17179869185 rc 0/0 00000100:00100000:1.0:1789518356.134493:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000001:00080000:3.0:1789518356.637086:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869185 is committed 00000001:00100000:3.0:1789518356.637137:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789518356.637143:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b6d4c95d-bde2-47cb-a27f-4c74703c2487 00010000:00010000:3.0:1789518356.722835:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518357.716535:0:23988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617132928 00000100:00100000:1.0:1789518357.716547:0:23988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617132928 00000100:00100000:1.0:1789518357.716694:0:23988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1789518357.716706:0:23988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:20537:x1876445617132928:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:1.0:1789518357.716772:0:23988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518357.716897:0:23988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:20537:x1876445617132928:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 192us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518357.716917:0:23988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1789518357.721345:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518357.747093:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518357.827955:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617133184 00000100:00100000:3.0:1789518357.827968:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617133184 00000100:00100000:3.0:1789518357.828051:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:3.0:1789518357.828063:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd4dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+10:20569:x1876445617133184:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518357.828085:0:23294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518357.828108:0:23294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc000/0x631fd8698c7836c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd09e expref: -99 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518357.828146:0:23294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc000/0x631fd8698c7836c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd09e expref: 11 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518357.828161:0:23294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bc000/0x631fd8698c7836c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd09e expref: 11 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518357.828172:0:23294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc000, rc 0) 00000100:00100000:3.0:1789518357.828247:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd4dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+11:20569:x1876445617133184:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 186us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.828255:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:3.0:1789518357.831332:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518357.836478:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.840417:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617133568 00000100:00100000:3.0:1789518357.840430:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617133568 00000100:00100000:3.0:1789518357.840524:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1789518357.840534:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+11:20576:x1876445617133568:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518357.840925:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+11:20576:x1876445617133568:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 390us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.840935:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1789518357.853662:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617133696 00000100:00100000:3.0:1789518357.853677:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617133696 00000100:00100000:3.0:1789518357.853783:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:3.0:1789518357.853795:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+11:20576:x1876445617133696:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518357.854187:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+11:20576:x1876445617133696:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 392us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.854197:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1789518357.857010:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518357.860759:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.860949:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617133952 00000100:00100000:3.0:1789518357.860961:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617133952 00000100:00100000:3.0:1789518357.861169:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518357.861184:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:20569:x1876445617133952:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789518357.861218:0:23295:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789518357.861249:0:23295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789518357.861254:0:23295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789518357.861258:0:23295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789518357.861261:0:23295:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 14 00000100:00100000:1.0:1789518357.866326:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518357.869730:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.872688:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518357.881274:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518357.884221:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.889770:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.889805:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.889834:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.889876:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.889974:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617134976 00000100:00100000:3.0:1789518357.889983:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617134976 00000100:00100000:3.0:1789518357.890055:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518357.890176:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617134720 00000100:00100000:1.0:1789518357.890181:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617134720 00000100:00100000:1.0:1789518357.890211:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617134848 00000100:00100000:1.0:1789518357.890214:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617134848 00000100:00100000:3.0:1789518357.890299:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2343:x1876445617134976:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518357.890367:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2343:x1876445617134976:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 299us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.890380:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518357.895537:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.895680:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518357.896144:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617135232 00000100:00100000:1.0:1789518357.896157:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617135232 00000100:00100000:1.0:1789518357.896371:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617135360 00000100:00100000:1.0:1789518357.896375:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617135360 00000100:00100000:1.0:1789518357.896402:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518357.896414:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+7:0:x1876445617135232:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789518357.896481:0:23300:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789518357.896566:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+7:0:x1876445617135232:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 155us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518357.896573:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518357.896591:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518357.896597:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+6:20569:x1876445617135360:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789518357.896652:0:23300:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789518357.896675:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+6:20569:x1876445617135360:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 78us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518357.896681:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518357.899508:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518357.899817:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617135488 00000100:00100000:1.0:1789518357.899828:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617135488 00000100:00100000:1.0:1789518357.899948:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518357.899959:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+6:20569:x1876445617135488:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789518357.900059:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+6:20569:x1876445617135488:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 102us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518357.900067:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518357.902161:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.902214:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.902246:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518357.902296:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617135872 00000100:00100000:3.0:1789518357.902307:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617135872 00000100:00100000:3.0:1789518357.902366:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518357.902377:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+6:20569:x1876445617135872:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789518357.902469:0:23304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789518357.902560:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+6:20569:x1876445617135872:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 183us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.902568:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518357.902712:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518357.902717:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445617135744:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789518357.902734:0:23983:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 248f1a9b-0266-4d36-9534-dab733fe88d3@192.168.206.51@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:3.0:1789518357.902751:0:23983:0:(genops.c:1384:class_connect()) connect: client 248f1a9b-0266-4d36-9534-dab733fe88d3, cookie 0x631fd8698c7836e8 00002000:00100000:3.0:1789518357.902756:0:23983:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 248f1a9b-0266-4d36-9534-dab733fe88d3/ffff99ffed5a5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518357.902777:0:23983:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789518357.903062:0:23983:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518357.903082:0:23983:0:(import.c:65:import_set_state_nolock()) ffff99ffed5a1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518357.903115:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+6:2341:x1876445617135744:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 395us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518357.903123:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518358.021200:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518358.643236:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518358.643265:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627555072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518358.643355:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518358.643812:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518358.643862:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627555072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789518358.770981:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518359.692839:0:25253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1789518359.713831:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6d4c95d-bde2-47cb-a27f-4c74703c2487 00000001:00100000:3.0:1789518359.713849:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 248f1a9b-0266-4d36-9534-dab733fe88d3 00010000:00010000:1.0:1789518359.798265:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518359.987366:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789518359.987374:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518359.987490:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:3.0:1789518359.987496:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789518361.203482:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c8a322e-2788-4faf-9195-ae294b8818bd:3282:1876445627555200:0@lo:400:kworker.0 00000100:00100000:3.0:1789518361.203559:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518361.204035:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627555328:0@lo:400:kworker.0 00000100:00100000:3.0:1789518361.204068:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518361.204290:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627555840:0@lo:400:kworker.0 00000100:00100000:3.0:1789518361.204317:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518361.204351:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627555456:0@lo:400:kworker.0 00000100:00100000:3.0:1789518361.204373:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518361.204535:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518361.204543:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627555584:0@lo:400:kworker.0 00000100:00100000:3.0:1789518361.204566:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518361.204713:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627555840 00000100:00100000:1.0:1789518361.204718:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627555584 00000100:00100000:3.0:1789518361.204719:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627555840 00000100:00100000:1.0:1789518361.204725:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627555584 00000100:00100000:1.0:1789518361.204761:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518361.204769:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627555584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518361.204775:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518361.204786:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627555840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518361.204818:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627555584:12345-0@lo:400:kworker.0 Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518361.204825:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518361.204842:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627555840:12345-0@lo:400:kworker.0 Request processed in 58us (523us total) trans 0 rc 0/0 00000100:00080000:1.0:1789518361.204846:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518361.204852:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518361.204878:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627555584:0@lo:400:kworker.0 00000100:00080000:1.0:1789518361.205758:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518361.205874:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518361.205988:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518361.205999:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627555456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518361.206044:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627555456:12345-0@lo:400:kworker.0 Request processed in 47us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518361.206052:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518361.206131:0:23987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627555968 00000100:00100000:1.0:1789518361.206136:0:23987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627555968 00000100:00100000:1.0:1789518361.206171:0:23987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518361.206182:0:23987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627555968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518361.206208:0:23987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789518361.206256:0:23987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627555968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518361.206274:0:23987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518361.206344:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c8a322e-2788-4faf-9195-ae294b8818bd:3282:1876445627555200:0@lo:400:kworker.0 00000100:00100000:3.0:1789518361.206352:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627555712:0@lo:400:kworker.0 00000100:00100000:3.0:1789518361.206448:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518361.206524:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627555328:0@lo:400:kworker.0 00000100:00100000:3.0:1789518361.206537:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627555840:0@lo:400:kworker.0 00000100:00100000:1.0:1789518361.206692:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627555712 00000100:00100000:1.0:1789518361.206697:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627555712 00000100:00100000:1.0:1789518361.206732:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518361.206740:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627555712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518361.206787:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627555712:12345-0@lo:400:kworker.0 Request processed in 48us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518361.206795:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518361.206832:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627555712:0@lo:400:kworker.0 00000100:00080000:1.0:1789518361.206855:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789518361.241193:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 248f1a9b-0266-4d36-9534-dab733fe88d3 00000020:00000080:1.0:1789518361.715724:0:25402:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddc2b6f80 20000000:00000080:1.0:1789518361.715739:0:25402:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fec25a0800 uarg=0000000000000000 20000000:01000000:1.0:1789518361.715772:0:25402:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789518361.715778:0:25402:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789518361.715783:0:25402:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000100:00100000:3.0:1789518361.723532:0:23283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627556352 00000100:00100000:3.0:1789518361.723599:0:23283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627556352 00000100:00100000:3.0:1789518361.723655:0:23283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627556480 00000100:00100000:3.0:1789518361.723659:0:23283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627556480 00000100:00100000:3.0:1789518361.723673:0:23283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518361.723683:0:23283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+4:25402:x1876445627556352:12345-0@lo:104: 00010000:00010000:3.0:1789518361.723695:0:23283:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783567 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.724246:0:23283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789518361.724254:0:23283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+4:25402:x1876445627556352:12345-0@lo:104: Request processed in 572us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518361.724261:0:23283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518361.724281:0:23283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518361.724295:0:23283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+3:25402:x1876445627556480:12345-0@lo:104: 00010000:00010000:3.0:1789518361.724304:0:23283:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc14da00/0x631fd8698c78341e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783425 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.724351:0:23283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518361.724357:0:23283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+3:25402:x1876445627556480:12345-0@lo:104: Request processed in 64us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518361.724363:0:23283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518361.724556:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c8a322e-2788-4faf-9195-ae294b8818bd:3281:1876445627556736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518361.724665:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518361.724699:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627556736 00000100:00100000:3.0:1789518361.724703:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627556736 00010000:00010000:3.0:1789518361.724720:0:23285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b17000/0x631fd8698c783567 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783560 expref: 19 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518361.724811:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518361.724818:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+19:3281:x1876445627556736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518361.724828:0:23285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518361.724833:0:23285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b17000/0x631fd8698c783567 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783560 expref: 19 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.724842:0:23285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b17000/0x631fd8698c783567 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c783560 expref: 19 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.724856:0:23285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518361.724883:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+19:3281:x1876445627556736:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518361.724905:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518361.724922:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627556864 00000100:00100000:3.0:1789518361.724925:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627556864 00010000:00010000:3.0:1789518361.724938:0:23285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffd0697600/0x631fd8698c783425 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c78341e expref: 19 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518361.724949:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518361.724954:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+19:3282:x1876445627556864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518361.724963:0:23285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518361.724967:0:23285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffd0697600/0x631fd8698c783425 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c78341e expref: 19 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.724975:0:23285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffd0697600/0x631fd8698c783425 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c78341e expref: 19 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.724983:0:23285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518361.725116:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518361.725818:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c8a322e-2788-4faf-9195-ae294b8818bd:3281:1876445627556736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518361.725876:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c8a322e-2788-4faf-9195-ae294b8818bd+19:3282:x1876445627556864:12345-0@lo:103:ldlm_bl.0 Request processed in 921us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518361.725884:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518361.727486:0:23284:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789518361.727505:0:23284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627556608 00000100:00100000:1.0:1789518361.727511:0:23284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627556608 00000100:00100000:1.0:1789518361.727558:0:23284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518361.727568:0:23284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7988c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+3:25402:x1876445627556608:12345-0@lo:104: 00010000:00010000:1.0:1789518361.727594:0:23284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7833d1 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518361.728156:0:23284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518361.728164:0:23284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7988c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+3:25402:x1876445627556608:12345-0@lo:104: Request processed in 598us (4608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518361.728179:0:23284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789518361.728243:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518361.728250:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7833d1 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.728257:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bdc00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518361.728260:0:23288:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7833d1 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.728268:0:23288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7833d1 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518361.728284:0:23288:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7833d1 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518361.728289:0:23288:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518361.728360:0:23288:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7833d1 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.728367:0:23288:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518361.728390:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7833d1 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.728398:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c7833ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7833d1 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.728415:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518361.728418:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518361.728419:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518361.728556:0:23286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627556992 00000100:00100000:3.0:1789518361.728561:0:23286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627556992 00010000:00010000:3.0:1789518361.728594:0:23286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc14c800/0x631fd8698c7833d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7833ca expref: 17 pid: 23295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518361.728645:0:23286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518361.728663:0:23286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff5625050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+17:3283:x1876445627556992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518361.728676:0:23286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518361.728682:0:23286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc14c800/0x631fd8698c7833d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7833ca expref: 17 pid: 23295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.728691:0:23286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc14c800/0x631fd8698c7833d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7833ca expref: 17 pid: 23295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.728712:0:23286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc14c800/0x631fd8698c7833d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7833ca expref: 17 pid: 23295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.728724:0:23286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518361.728764:0:23286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff5625050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+16:3283:x1876445627556992:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518361.728774:0:23286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518361.729060:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518361.729126:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518361.729146:0:23286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617136128 00000100:00100000:3.0:1789518361.729150:0:23286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617136128 00010000:00010000:3.0:1789518361.729165:0:23286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28ca00/0x631fd8698c7836d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd0cf expref: 13 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518361.729189:0:23286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617136256 00000100:00100000:3.0:1789518361.729192:0:23286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617136256 00010000:00010000:3.0:1789518361.729207:0:23286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bce00/0x631fd8698c7835c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd06d expref: 14 pid: 23295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518361.729223:0:23286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518361.729230:0:23286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83b7d112-ac86-4580-aba7-3f82c95a71b7+14:2342:x1876445617136128:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518361.729239:0:23286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518361.729243:0:23286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28ca00/0x631fd8698c7836d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd0cf expref: 14 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729252:0:23286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28ca00/0x631fd8698c7836d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd0cf expref: 14 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729321:0:23286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28ca00/0x631fd8698c7836d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd0cf expref: 14 pid: 23294 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729332:0:23286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518361.729372:0:23286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83b7d112-ac86-4580-aba7-3f82c95a71b7+13:2342:x1876445617136128:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 142us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518361.729379:0:23286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518361.729396:0:23286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518361.729405:0:23286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:2342:x1876445617136256:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518361.729413:0:23286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518361.729419:0:23286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffed5bce00/0x631fd8698c7835c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd06d expref: 12 pid: 23295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729428:0:23286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bce00/0x631fd8698c7835c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd06d expref: 12 pid: 23295 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729441:0:23286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc6b17400/0x631fd8698c7836fd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729449:0:23286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17400/0x631fd8698c7836fd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729463:0:23286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17400/0x631fd8698c7836fd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729470:0:23286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17400/0x631fd8698c7836fd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729477:0:23286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc6b17400/0x631fd8698c7836fd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729489:0:23286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc6b17400/0x631fd8698c7836fd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729494:0:23286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518361.729498:0:23286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc6b17400/0x631fd8698c7836fd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729505:0:23286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc6b17400/0x631fd8698c7836fd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729514:0:23286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc6b17400/0x631fd8698c7836fd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518361.729525:0:23286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518361.729547:0:23286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:2342:x1876445617136256:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 144us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518361.729554:0:23286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:1.0:1789518361.843739:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518362.534082:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00080000:1.0:1789518362.534401:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518362.539770:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.539914:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518362.539930:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:21054:x1876445617136640:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518362.539950:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518362.539977:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44a00/0x631fd8698c783720 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd107 expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.540046:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.540060:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.540074:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.540087:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.540093:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.540100:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.540684:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c783735 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.540704:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c783735 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.540712:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c783735 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518362.540722:0:23301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789518362.541049:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541058:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541064:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541070:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518362.541074:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541082:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541093:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffdfff5f00) 00010000:00010000:1.0:1789518362.541095:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518362.541100:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541106:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783727 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541117:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541128:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541134:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541138:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518362.541141:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541147:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541154:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc2fdc800) 00010000:00010000:1.0:1789518362.541156:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518362.541159:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541164:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c78372e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541853:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44a00/0x631fd8698c783720 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd107 expref: 10 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541869:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c783735 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd107 expref: 9 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.541877:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518362.541880:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518362.542200:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44600, rc 0) 00000100:00100000:1.0:1789518362.542264:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+9:21054:x1876445617136640:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2339us (2501us total) trans 17179869185 rc 0/0 00000100:00100000:1.0:1789518362.542272:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1789518362.547032:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.628514:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.635399:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.637953:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.641878:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00080000:1.0:1789518362.642420:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518362.665927:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.668755:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.672593:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.694224:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.700871:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.704788:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000004:00010000:1.0:1789518362.706073:0:23302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086d5a75e reply state 00000000e74e4f82 transno 17179869189 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7837c1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518362.706090:0:23302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789518362.706101:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789518362.706203:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+14:21070:x1876445617138560:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 995us (1433us total) trans 17179869189 rc 0/0 00000100:00100000:1.0:1789518362.706212:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518362.707712:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.707844:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617138816 00000100:00100000:1.0:1789518362.707854:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617138816 00000100:00100000:1.0:1789518362.707971:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518362.707985:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+13:21070:x1876445617138816:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518362.708242:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+14:21070:x1876445617138816:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 260us (534us total) trans 17179869190 rc 0/0 00000100:00100000:1.0:1789518362.708250:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518362.710347:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.715414:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617139200 00000100:00100000:3.0:1789518362.715427:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617139200 00000100:00100000:3.0:1789518362.715892:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518362.715904:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+15:21070:x1876445617139200:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518362.715934:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518362.715964:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c7837e4 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd138 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.716071:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c7837eb lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.716088:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c7837eb lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.716104:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c7837eb lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518362.716137:0:24710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518362.716142:0:24710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518362.716164:0:24710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c7837eb lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.716189:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c7837e4 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd138 expref: 17 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.716209:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c7837eb lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd138 expref: 16 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.716218:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffe6f98500) 00010000:00010000:3.0:1789518362.716222:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518362.716239:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc600, rc 0) 00000100:00100000:3.0:1789518362.716493:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21070:x1876445617139200:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 590us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518362.716547:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518362.719678:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.725479:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21070:x1876445617139328:12345-192.168.206.51@tcp:37:lfs.0 Request processed in 5615us (5799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518362.725492:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1789518362.729111:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617139584 00000100:00100000:1.0:1789518362.729139:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617139584 00000100:00100000:1.0:1789518362.729257:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518362.729269:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21070:x1876445617139584:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518362.729555:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21070:x1876445617139584:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 287us (741us total) trans 17179869192 rc 0/0 00000100:00100000:1.0:1789518362.729564:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518362.761016:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617139712 00000100:00100000:1.0:1789518362.761026:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617139712 00000100:00100000:1.0:1789518362.761179:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1789518362.761190:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21076:x1876445617139712:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518362.761213:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518362.761246:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c7837f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd13f expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.776538:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:2.0:1789518362.776819:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518362.776825:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7837f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.776832:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7837f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.776844:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c783800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.776850:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c783800 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.776857:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c783800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.776863:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518362.776865:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c783800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.776872:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c783800 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.777058:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff99ffd8a16b00) 00010000:00010000:2.0:1789518362.777062:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518362.777066:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c783800 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.777073:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c783800 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.777111:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c7837f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd13f expref: 19 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.777139:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c783807 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd13f expref: 18 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.777146:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffe6f98500) 00010000:00010000:2.0:1789518362.777149:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789518362.777151:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518362.777217:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:21076:x1876445617139712:12345-192.168.206.51@tcp:101:dd.500 Request processed in 16029us (16318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518362.777226:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518362.779685:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518362.779862:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.779925:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617139968 00000100:00100000:1.0:1789518362.779934:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617139968 00000100:00100000:3.0:1789518362.779981:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617140096 00000100:00100000:3.0:1789518362.779986:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617140096 00000100:00100000:3.0:1789518362.780038:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518362.780048:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:2343:x1876445617140096:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518362.780063:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518362.780085:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c783807 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd13f expref: 19 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.780104:0:23287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffe6f98500) 00010000:00010000:3.0:1789518362.780109:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518362.780166:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:2343:x1876445617140096:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 118us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518362.780174:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1789518362.780179:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518362.780197:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21076:x1876445617139968:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518362.780219:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518362.780221:0:23302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518362.780234:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c7837eb lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd138 expref: 17 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.780248:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffe6f98500) 00010000:00010000:1.0:1789518362.780255:0:23302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518362.780269:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44a00/0x631fd8698c78380e lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd146 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.780774:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.780787:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.780797:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.780810:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c78381c lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.780818:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c78381c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.780825:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c78381c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783438:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783823 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783455:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783823 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783466:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783823 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518362.783477:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789518362.783505:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783512:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783525:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783585:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518362.783590:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783597:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783608:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffc2fdc800) 00010000:00010000:1.0:1789518362.783646:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518362.783652:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783658:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44c00/0x631fd8698c783815 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518362.783672:0:23302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b15a3dd reply state 00000000aaf60004 transno 17179869193 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c78381c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518362.783681:0:23302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518362.783718:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44a00/0x631fd8698c78380e lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd146 expref: 19 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783737:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783823 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd146 expref: 18 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.783744:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:1.0:1789518362.783806:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789518362.783810:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45c00, rc 0) 00000100:00100000:1.0:1789518362.783891:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:21076:x1876445617139968:12345-192.168.206.51@tcp:101:dd.500 Request processed in 3697us (4203us total) trans 17179869193 rc 0/0 00000100:00100000:1.0:1789518362.783901:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:2.0:1789518362.794189:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617140352 00000100:00100000:2.0:1789518362.794200:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617140352 00000100:00100000:2.0:1789518362.794259:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518362.794269:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:21076:x1876445617140352:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:2.0:1789518362.794600:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:21076:x1876445617140352:12345-192.168.206.51@tcp:35:dd.500 Request processed in 332us (612us total) trans 17179869194 rc 0/0 00000100:00100000:2.0:1789518362.794609:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 10000000:01000000:1.0:1789518362.802689:0:23297:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518362.802696:0:23297:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fec26f0800 from 10 10000000:01000000:1.0:1789518362.802702:0:23297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518362.802760:0:23297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.802771:0:23297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.802782:0:23297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518362.802806:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627557248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518362.802893:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518362.802946:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518362.803932:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627557248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518362.803949:0:23297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.803958:0:23297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518362.804011:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627557376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518362.804050:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518362.804095:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518362.804107:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627557376 00000100:00100000:2.0:1789518362.804114:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627557376 00000100:00100000:2.0:1789518362.804167:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789518362.804176:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdac56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+17:23297:x1876445627557376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518362.804783:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdac56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+17:23297:x1876445627557376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 607us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518362.804791:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789518362.805034:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627557376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518362.805070:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627557504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518362.805111:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518362.806122:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518362.806707:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627557504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518362.807568:0:25418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:2.0:1789518362.808084:0:23292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627557632 00000100:00100000:2.0:1789518362.808091:0:23292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627557632 00000100:00100000:2.0:1789518362.808175:0:23292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789518362.808185:0:23292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+17:23297:x1876445627557632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518362.808195:0:23292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518362.808207:0:23292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17400/0x631fd8698c783846 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78383f expref: -99 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.808230:0:23292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17400/0x631fd8698c783846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78383f expref: 18 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.808241:0:23292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17400/0x631fd8698c783846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78383f expref: 18 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.808249:0:23292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:2.0:1789518362.808294:0:23292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c8a322e-2788-4faf-9195-ae294b8818bd+18:23297:x1876445627557632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518362.808302:0:23292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789518362.808368:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627557632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518362.808383:0:23297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.808391:0:23297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518362.808439:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627557760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518362.808467:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518362.808569:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43840 going to sleep for 11 seconds 00000020:01000000:1.0:1789518362.814712:0:23297:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789518362.814740:0:23297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518362.814751:0:23297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.814763:0:23297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518362.814775:0:23297:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518362.814777:0:23297:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc5e32800 from 10 10000000:01000000:1.0:1789518362.814793:0:23297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518362.814827:0:23297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.814835:0:23297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.814847:0:23297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518362.814869:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627558016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518362.814945:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518362.814996:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518362.815075:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627558016 00000100:00100000:3.0:1789518362.815083:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627558016 00000100:00100000:3.0:1789518362.815141:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789518362.815151:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0002075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+18:23297:x1876445627558016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518362.815164:0:23294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518362.815176:0:23294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc800/0x631fd8698c783854 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78384d expref: -99 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.815200:0:23294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc800/0x631fd8698c783854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78384d expref: 19 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.815218:0:23294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bc800/0x631fd8698c783854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78384d expref: 19 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.815227:0:23294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:3.0:1789518362.815265:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0002075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+19:23297:x1876445627558016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518362.815271:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789518362.815323:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627558016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518362.815335:0:23297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.815344:0:23297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518362.815393:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627558144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518362.815416:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518362.815434:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd9167d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518362.815445:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627558144 00000100:00100000:3.0:1789518362.815448:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627558144 00000100:00100000:3.0:1789518362.815464:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789518362.815470:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0002074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+19:23297:x1876445627558144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518362.815706:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0002074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+19:23297:x1876445627558144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518362.815713:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789518362.815741:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627558144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518362.815773:0:23297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627558272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518362.815806:0:23297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518362.815822:0:23297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518362.815832:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627558272 00000100:00100000:3.0:1789518362.815835:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627558272 00000100:00100000:3.0:1789518362.815851:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789518362.815857:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0002076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+19:23297:x1876445627558272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518362.815997:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0002076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c8a322e-2788-4faf-9195-ae294b8818bd+19:23297:x1876445627558272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518362.816003:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789518362.816037:0:23297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c8a322e-2788-4faf-9195-ae294b8818bd:23297:1876445627558272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518362.816943:0:25420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:2.0:1789518362.830456:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.830596:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617140480 00000100:00100000:3.0:1789518362.830606:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617140480 00000100:00100000:3.0:1789518362.830820:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:3.0:1789518362.830830:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+11:20456:x1876445617140480:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518362.830846:0:23294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518362.830862:0:23294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c78385b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd14d expref: -99 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.830905:0:23294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c78385b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd14d expref: 12 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.830917:0:23294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c78385b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd14d expref: 12 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518362.830926:0:23294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bdc00, rc 0) 00000100:00100000:3.0:1789518362.830994:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:20456:x1876445617140480:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 166us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518362.831001:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:2.0:1789518362.834004:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617140608 00000100:00100000:2.0:1789518362.834014:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617140608 00000100:00100000:2.0:1789518362.834100:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:2.0:1789518362.834110:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:20456:x1876445617140608:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518362.834391:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:20456:x1876445617140608:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 281us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518362.834398:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1789518362.838207:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617140736 00000100:00100000:3.0:1789518362.838216:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617140736 00000100:00100000:3.0:1789518362.838267:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:3.0:1789518362.838276:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:20456:x1876445617140736:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518362.838505:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:20456:x1876445617140736:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 229us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518362.838513:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:3.0:1789518362.841770:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518362.842054:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617140864 00000100:00100000:2.0:1789518362.842064:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617140864 00000100:00100000:2.0:1789518362.842131:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:2.0:1789518362.842141:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:20456:x1876445617140864:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518362.842157:0:23295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518362.842174:0:23295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16800/0x631fd8698c783862 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd154 expref: -99 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.842201:0:23295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16800/0x631fd8698c783862 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd154 expref: 13 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.842219:0:23295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16800/0x631fd8698c783862 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd154 expref: 13 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518362.842231:0:23295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:2.0:1789518362.842289:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83b7d112-ac86-4580-aba7-3f82c95a71b7+13:20456:x1876445617140864:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 148us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518362.842297:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:1.0:1789518362.842897:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617141120 00000100:00100000:1.0:1789518362.842903:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617141120 00000100:00100000:1.0:1789518362.842977:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1789518362.842985:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:21086:x1876445617141120:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518362.843002:0:23300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518362.843016:0:23300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd15b expref: -99 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843079:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843090:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843101:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843129:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843137:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843143:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518362.843246:0:23300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789518362.843327:0:23300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843335:0:23300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843342:0:23300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843348:0:23300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518362.843353:0:23300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843361:0:23300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843372:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:1.0:1789518362.843374:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518362.843378:0:23300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843395:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843408:0:23300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843414:0:23300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843419:0:23300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843424:0:23300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518362.843427:0:23300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843432:0:23300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843440:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff99ffc2fdcf00) 00010000:00010000:1.0:1789518362.843442:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518362.843445:0:23300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843450:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783877 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843482:0:23300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783869 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd15b expref: 21 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843503:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:1.0:1789518362.843505:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518362.843510:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd15b expref: 21 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.843518:0:23300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44200, rc 0) 00000100:00100000:1.0:1789518362.843567:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+20:21086:x1876445617141120:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 583us (1053us total) trans 17179869195 rc 301/301 00000100:00100000:1.0:1789518362.843574:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1789518362.843828:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.845962:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518362.846264:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.846685:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617141632 00000100:00100000:1.0:1789518362.846693:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617141632 00000100:00100000:1.0:1789518362.846733:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518362.846742:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+20:21086:x1876445617141632:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518362.846951:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+21:21086:x1876445617141632:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 208us (685us total) trans 17179869196 rc 0/0 00000100:00100000:1.0:1789518362.846959:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518362.906583:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518362.906692:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617141760 00000100:00100000:2.0:1789518362.906711:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617141760 00000100:00100000:2.0:1789518362.912077:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.912737:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617142016 00000100:00100000:1.0:1789518362.912752:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617142016 00000100:00100000:1.0:1789518362.912817:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1789518362.912826:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+22:21094:x1876445617142016:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518362.912847:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518362.912867:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838a1 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd169 expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.912967:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838a8 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.912993:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838a8 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.913007:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838a8 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518362.913019:0:23301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789518362.913133:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838a1 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd169 expref: 25 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.913149:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838a8 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd169 expref: 24 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.913157:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:1.0:1789518362.913159:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518362.913163:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45e00, rc 0) 00000100:00100000:1.0:1789518362.913287:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+24:21094:x1876445617142016:12345-192.168.206.51@tcp:101:dd.500 Request processed in 462us (1225us total) trans 17179869197 rc 0/0 00000100:00100000:1.0:1789518362.913295:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518362.916059:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.916211:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617142272 00000100:00100000:1.0:1789518362.916220:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617142272 00000100:00100000:1.0:1789518362.916278:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518362.916288:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+24:21094:x1876445617142272:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:1.0:1789518362.916520:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:21094:x1876445617142272:12345-192.168.206.51@tcp:35:dd.500 Request processed in 232us (468us total) trans 17179869198 rc 0/0 00000100:00100000:1.0:1789518362.916528:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518362.959481:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518362.959655:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617142528 00000100:00100000:1.0:1789518362.959676:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617142528 00000100:00100000:1.0:1789518362.959835:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518362.959848:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:21100:x1876445617142528:12345-192.168.206.51@tcp:36:truncate.500 00010000:00010000:1.0:1789518362.959910:0:23302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518362.959935:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838a8 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd169 expref: 25 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.959952:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:1.0:1789518362.959956:0:23302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518362.960134:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.960147:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.960156:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518362.960199:0:23302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869199 00000004:00010000:1.0:1789518362.960221:0:23302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086eafc15 reply state 0000000081c027c3 transno 17179869200 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518362.960230:0:23302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518362.960329:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+27:21100:x1876445617142528:12345-192.168.206.51@tcp:36:truncate.500 Request processed in 483us (856us total) trans 17179869200 rc 0/0 00000100:00100000:1.0:1789518362.962513:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000020:00080000:1.0:1789518362.962522:0:23302:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518362.964445:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.964461:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.964491:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.964495:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518362.964498:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.964505:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.964520:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:1.0:1789518362.964523:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518362.964764:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518362.964771:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838b6 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518363.007813:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518363.012412:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518363.022276:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518363.022318:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518363.022350:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518363.022387:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518363.022394:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617143168 00000100:00100000:3.0:1789518363.022405:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617143168 00000100:00100000:3.0:1789518363.022474:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617143040 00000100:00100000:3.0:1789518363.022480:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617143040 00000100:00100000:2.0:1789518363.022480:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518363.022503:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617143296 00000100:00100000:3.0:1789518363.022504:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617143424 00000100:00100000:3.0:1789518363.022509:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617143424 00000100:00100000:2.0:1789518363.022509:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617143296 00000100:00100000:3.0:1789518363.022536:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617143552 00000100:00100000:3.0:1789518363.022540:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617143552 00000100:00100000:2.0:1789518363.022552:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518363.022564:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518363.022565:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2342:x1876445617143296:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518363.022576:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2343:x1876445617143168:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518363.022674:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2342:x1876445617143296:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 113us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518363.022676:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2343:x1876445617143168:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 102us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518363.022688:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518363.022692:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518363.022714:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518363.022722:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2342:x1876445617143040:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518363.022749:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2342:x1876445617143040:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518363.022762:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518363.022776:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518363.022783:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2343:x1876445617143424:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:1.0:1789518363.023130:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518363.023135:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518363.026784:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2343:x1876445617143424:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3990us (4421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518363.026923:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1789518363.052869:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518363.053354:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617143808 00000100:00100000:1.0:1789518363.053363:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617143808 00000100:00100000:1.0:1789518363.053495:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1789518363.053507:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+28:21113:x1876445617143808:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518363.053530:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518363.053549:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838e0 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd177 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053741:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053766:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053777:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053791:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053798:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053805:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053860:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c7838f5 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053867:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c7838f5 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053873:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c7838f5 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518363.053895:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 2048 00010000:00010000:1.0:1789518363.053980:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.053993:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054000:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054011:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518363.054015:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054034:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054044:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffdfff5000) 00010000:00010000:1.0:1789518363.054047:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518363.054051:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054056:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7838e7 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054067:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054079:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054084:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054089:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518363.054091:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054095:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054110:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff99ffc2fdcf00) 00010000:00010000:1.0:1789518363.054113:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518363.054115:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054120:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7838ee lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054156:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c7838e0 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd177 expref: 31 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054168:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c7838f5 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd177 expref: 30 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.054175:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:1.0:1789518363.054177:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789518363.054179:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45600, rc 0) 00000100:00100000:1.0:1789518363.054231:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+30:21113:x1876445617143808:12345-192.168.206.51@tcp:101:dd.500 Request processed in 727us (1373us total) trans 17179869203 rc 0/0 00000100:00100000:1.0:1789518363.054239:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1789518363.057176:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518363.057413:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617144064 00000100:00100000:1.0:1789518363.057422:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617144064 00000100:00100000:1.0:1789518363.057476:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1789518363.057480:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518363.057485:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+30:21113:x1876445617144064:12345-192.168.206.51@tcp:36:dd.500 00000100:00100000:3.0:1789518363.057545:0:23286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617144192 00000100:00100000:3.0:1789518363.057549:0:23286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617144192 00000100:00100000:3.0:1789518363.057590:0:23286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518363.057597:0:23286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+31:2343:x1876445617144192:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518363.057607:0:23286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518363.057647:0:23286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c7838f5 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd177 expref: 31 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518363.057665:0:23286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:3.0:1789518363.057670:0:23286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518363.057753:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.057767:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.057798:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518363.057810:0:23286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+31:2343:x1876445617144192:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 198us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518363.057828:0:23286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000001:00080000:1.0:1789518363.057857:0:23301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869204 00000004:00010000:1.0:1789518363.057895:0:23301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e61ab929 reply state 00000000f806ea1f transno 17179869205 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518363.057904:0:23301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518363.057955:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+32:21113:x1876445617144064:12345-192.168.206.51@tcp:36:dd.500 Request processed in 470us (787us total) trans 17179869205 rc 0/0 00000100:00100000:1.0:1789518363.057962:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000020:00080000:1.0:1789518363.057966:0:23301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789518363.059002:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789518363.059009:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518363.059091:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:2.0:1789518363.059097:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1789518363.062352:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.062424:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.062434:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.062441:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518363.062446:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.062454:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.062471:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:1.0:1789518363.062474:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518363.062494:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.062501:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783903 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518363.062720:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518363.063090:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617144448 00000100:00100000:1.0:1789518363.063099:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617144448 00000100:00100000:1.0:1789518363.063157:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1789518363.063165:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+31:21113:x1876445617144448:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:1.0:1789518363.063448:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+32:21113:x1876445617144448:12345-192.168.206.51@tcp:35:dd.500 Request processed in 283us (732us total) trans 17179869206 rc 0/0 00000100:00100000:1.0:1789518363.063456:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1789518363.120913:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518363.124962:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518363.125073:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617144960 00000100:00100000:1.0:1789518363.125083:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617144960 00000100:00100000:1.0:1789518363.125177:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518363.125187:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+33:21123:x1876445617144960:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518363.125407:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+34:21123:x1876445617144960:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 220us (452us total) trans 17179869208 rc 0/0 00000100:00100000:1.0:1789518363.125414:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518363.409343:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518363.409821:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617145088 00000100:00100000:1.0:1789518363.409835:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617145088 00000100:00100000:1.0:1789518363.409987:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:1.0:1789518363.410001:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+34:21160:x1876445617145088:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518363.410036:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518363.410067:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd185 expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.410200:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78391f lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.410219:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78391f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.410233:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78391f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518363.410276:0:23301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518363.410280:0:23301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518363.410327:0:23301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78391f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.410370:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd185 expref: 36 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.410393:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78391f lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd185 expref: 35 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.410401:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffdfff5000) 00010000:00010000:1.0:1789518363.410405:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518363.410409:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44200, rc 0) 00000100:00100000:1.0:1789518363.410897:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+35:21160:x1876445617145088:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 897us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518363.410907:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1789518363.415821:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518363.415979:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617145216 00000100:00100000:1.0:1789518363.415995:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617145216 00000100:00100000:1.0:1789518363.416091:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518363.416103:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+35:21160:x1876445617145216:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518363.416128:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518363.416155:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783926 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd18c expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.416236:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c78392d lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.416255:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c78392d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.416268:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c78392d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518363.416322:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789518363.416327:0:23302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518363.416350:0:23302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c78392d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.416363:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c78392d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.416390:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783926 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd18c expref: 37 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.416410:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c78392d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd18c expref: 36 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.416418:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:1.0:1789518363.416428:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518363.416594:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44400, rc 0) 00000100:00100000:1.0:1789518363.416844:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21160:x1876445617145216:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 741us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518363.416853:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:3.0:1789518363.419903:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518363.426140:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518363.426260:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617145728 00000100:00100000:2.0:1789518363.426273:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617145728 00000100:00100000:2.0:1789518363.426345:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518363.426354:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21160:x1876445617145728:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:2.0:1789518363.426370:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789518363.426396:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c78393b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd193 expref: 38 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518363.426415:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c78392d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd18c expref: 37 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518363.426423:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783823 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd146 expref: 36 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518363.426455:0:23287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffc2fdc100) 00010000:00010000:2.0:1789518363.426468:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518363.426542:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+35:21160:x1876445617145728:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 187us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518363.426550:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518363.428603:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518363.436327:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518363.437930:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617145984 00000100:00100000:1.0:1789518363.437948:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617145984 00000100:00100000:1.0:1789518363.438040:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1789518363.438053:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+35:21160:x1876445617145984:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518363.438081:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518363.438109:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783950 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd19a expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.438186:0:23301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c783949 lrc: 2/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.438198:0:23301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783950 lrc: 4/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd19a expref: 36 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.438284:0:23301:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c783949 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.438300:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783950 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd19a expref: 36 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.438315:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffdfff5100) 00010000:00010000:1.0:1789518363.438318:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518363.438323:0:23301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783950 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd19a expref: 36 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518363.438349:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45a00, rc 0) 00000100:00100000:1.0:1789518363.438431:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21160:x1876445617145984:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 381us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518363.438440:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:2.0:1789518363.762911:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627558400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518363.763009:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518363.763273:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518363.763489:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627558400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789518363.891268:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518364.082953:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:2.0:1789518364.082967:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518364.083019:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:2.0:1789518364.083037:0:23335:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1789518364.083040:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518364.083075:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 2 count 2 00000040:00080000:2.0:1789518364.083079:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000100:00100000:2.0:1789518364.083275:0:23335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23335:1876445627558528:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518364.083425:0:23335:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518364.086391:0:23335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23335:1876445627558528:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518364.088413:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.089414:0:23311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617146112 00000100:00100000:1.0:1789518364.089436:0:23311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617146112 00000100:00100000:1.0:1789518364.089598:0:23311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518364.089611:0:23311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21161:x1876445617146112:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789518364.089755:0:23311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21161:x1876445617146112:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 Request processed in 147us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.089763:0:23311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00080000:2.0:1789518364.090035:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518364.094573:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.094655:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617146240 00000100:00100000:1.0:1789518364.094668:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617146240 00000100:00100000:1.0:1789518364.094793:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:1.0:1789518364.094806:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21161:x1876445617146240:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518364.094860:0:23302:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518364.095186:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21161:x1876445617146240:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 381us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.095195:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:3.0:1789518364.100376:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.100522:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617146368 00000100:00100000:1.0:1789518364.100534:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617146368 00000100:00100000:1.0:1789518364.100607:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:1.0:1789518364.100646:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21161:x1876445617146368:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789518364.100758:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.100778:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.100795:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102436:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102458:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102471:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102504:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102513:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102520:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518364.102886:0:23301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789518364.102891:0:23301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518364.102905:0:23301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102918:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102938:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102944:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102950:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518364.102955:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102962:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102974:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518364.102977:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518364.102982:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.102988:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783957 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103015:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103022:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103027:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103032:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518364.103041:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103047:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103055:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xbe39250a (ffff99ffc2fdcf00) 00010000:00010000:1.0:1789518364.103057:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518364.103060:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103066:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c78395e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103080:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103099:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103105:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103110:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518364.103113:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103119:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103126:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffdfff5100) 00010000:00010000:1.0:1789518364.103128:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518364.103139:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.103145:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783965 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518364.103239:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21161:x1876445617146368:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 2592us (2873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.103248:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1789518364.106313:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518364.112861:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518364.116659:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.117185:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617147008 00000100:00100000:1.0:1789518364.117199:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617147008 00000100:00100000:1.0:1789518364.117338:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518364.117354:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+37:21161:x1876445617147008:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518364.117381:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518364.117385:0:23302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518364.117417:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c78391f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd185 expref: 37 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.117603:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffdfff5000) 00010000:00010000:1.0:1789518364.117649:0:23302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518364.117669:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783981 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd1a8 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518364.118766:0:23302:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x44:0x0], count =30 00000004:00080000:1.0:1789518364.118776:0:23302:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x44:0x0]+30 in llog 00000004:00080000:1.0:1789518364.118907:0:23302:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62:0x0], index 1: 0 00010000:00010000:1.0:1789518364.119345:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783988 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.119363:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783988 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.119383:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783988 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.120864:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783981 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1a8 expref: 39 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.120910:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783988 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1a8 expref: 38 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.120920:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff99ffc2fdcf00) 00010000:00010000:1.0:1789518364.120924:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518364.120928:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44000, rc 0) 00000100:00100000:1.0:1789518364.121580:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21161:x1876445617147008:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 4225us (4976us total) trans 17179869211 rc 0/0 00000100:00100000:1.0:1789518364.121591:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1789518364.124292:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.127940:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617147264 00000100:00100000:1.0:1789518364.127964:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617147264 00000100:00100000:1.0:1789518364.128061:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518364.128074:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21161:x1876445617147264:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518364.128146:0:23301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518364.128176:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783988 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1a8 expref: 38 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128192:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff99ffc2fdcf00) 00010000:00010000:1.0:1789518364.128202:0:23301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518364.128224:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128256:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128264:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128276:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128281:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128285:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128363:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128369:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128374:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128378:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518364.128381:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128387:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128392:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffdfff5000) 00010000:00010000:1.0:1789518364.128399:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518364.128403:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128407:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783996 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128414:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128422:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128426:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128432:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518364.128434:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128438:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128442:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x2a8dc722 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518364.128443:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518364.128444:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.128448:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c78399d lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x2a8dc722 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518364.128571:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+37:21161:x1876445617147264:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 499us (4291us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518364.128584:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:3.0:1789518364.130960:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518364.137849:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518364.141945:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.142211:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617147776 00000100:00100000:1.0:1789518364.142223:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617147776 00000100:00100000:1.0:1789518364.142291:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:1.0:1789518364.142301:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+39:21161:x1876445617147776:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518364.142327:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518364.142353:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7839b9 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd1b6 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.142426:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7839b9 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1b6 expref: 40 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.142442:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7839b9 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1b6 expref: 40 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.142466:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff99ffdfff5700) 00010000:00010000:1.0:1789518364.142469:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518364.142472:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45e00, rc 0) 00000100:00100000:1.0:1789518364.142546:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+40:21161:x1876445617147776:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 245us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.142554:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:3.0:1789518364.147814:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.147951:0:23984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617147904 00000100:00100000:1.0:1789518364.147963:0:23984:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617147904 00000100:00100000:1.0:1789518364.148042:0:23984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518364.148053:0:23984:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2342:x1876445617147904:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789518364.149002:0:23984:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2342:x1876445617147904:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 947us (1200us total) trans 17179869186 rc 0/0 00000100:00100000:1.0:1789518364.149025:0:23984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518364.154031:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.154437:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617148160 00000100:00100000:1.0:1789518364.154450:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617148160 00000100:00100000:1.0:1789518364.154541:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518364.154554:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+40:21161:x1876445617148160:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518364.154902:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+41:21161:x1876445617148160:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 350us (884us total) trans 17179869213 rc 0/0 00000100:00100000:1.0:1789518364.154911:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1789518364.157516:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.157737:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617148416 00000100:00100000:1.0:1789518364.157749:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617148416 00000100:00100000:1.0:1789518364.157894:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:1.0:1789518364.157905:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+41:21161:x1876445617148416:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518364.158045:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+41:21161:x1876445617148416:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 142us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.158054:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:3.0:1789518364.160430:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518364.164954:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518364.169141:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518364.173450:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.173662:0:23984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617149056 00000100:00100000:1.0:1789518364.173674:0:23984:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617149056 00000100:00100000:1.0:1789518364.173750:0:23984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518364.173761:0:23984:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:21161:x1876445617149056:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518364.173782:0:23984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518364.173812:0:23984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c7839d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd1cb expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.173851:0:23984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c7839ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1c4 expref: 8 pid: 24439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.173891:0:23984:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518364.173897:0:23984:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518364.173903:0:23984:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c7839d5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1cb expref: 8 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.173949:0:23984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c7839ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1c4 expref: 8 pid: 24439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.173965:0:23984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c7839ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1c4 expref: 8 pid: 24439 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518364.173981:0:23984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:23984:1876445627558656:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518364.174093:0:23984:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518364.176330:0:23984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:23984:1876445627558656:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518364.176379:0:23984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c7839d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1cb expref: 8 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.176405:0:23984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44200, rc 0) 00000100:00100000:1.0:1789518364.176486:0:23984:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+8:21161:x1876445617149056:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2725us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.176497:0:23984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1789518364.179489:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518364.190027:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.190275:0:23989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617149312 00000100:00100000:1.0:1789518364.190292:0:23989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617149312 00002000:00100000:1.0:1789518364.190364:0:23989:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x62:0x0] (0->255) req@ffff99fec1b9f100 x1876445617149312/t0(0) o4->b6d4c95d-bde2-47cb-a27f-4c74703c2487@192.168.206.51@tcp:10/0 lens 744/0 e 0 to 0 dl 1789518375 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789518364.190396:0:23989:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9f100 with x1876445617149312 ext(0->255) 00002000:00010000:1.0:1789518364.190404:0:23989:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9f100 00000100:00100000:1.0:1789518364.190446:0:23989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518364.190458:0:23989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:2343:x1876445617149312:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518364.194483:0:23989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+9:2343:x1876445617149312:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 4017us (4456us total) trans 17179869187 rc 0/0 00000100:00100000:1.0:1789518364.194495:0:23989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:1.0:1789518364.194505:0:23989:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x62:0x0] (0->255) req@ffff99fec1b9f100 x1876445617149312/t17179869187(0) o4->b6d4c95d-bde2-47cb-a27f-4c74703c2487@192.168.206.51@tcp:10/0 lens 744/448 e 0 to 0 dl 1789518375 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789518364.194514:0:23989:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9f100 with x1876445617149312 ext(0->255) 00002000:00010000:1.0:1789518364.194520:0:23989:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9f100 00000100:00100000:3.0:1789518364.196978:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000001:00080000:1.0:1789518364.230951:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869212 is committed 00000004:00080000:1.0:1789518364.230968:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789518364.231004:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869213 is committed 00000100:00100000:2.0:1789518364.231154:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffbb80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627558912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518364.231200:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+13:21161:x1876445617149440:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 32289us (34232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.231212:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:2.0:1789518364.231321:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518364.231421:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627558912 00000100:00100000:3.0:1789518364.231450:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627558912 00000100:00100000:3.0:1789518364.231516:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518364.231542:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627558912:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789518364.231631:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1789518364.232260:0:23985:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb size from disk: 0 -> 256 00002000:00010000:3.0:1789518364.232265:0:23985:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1789518364 00002000:00010000:3.0:1789518364.232268:0:23985:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789518364.232271:0:23985:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb ctime from disk: 1789518364 -> 1789518364 00002000:00010000:3.0:1789518364.232273:0:23985:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789518364.232331:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627558912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 805us (1008us total) trans 17179869188 rc 0/0 00000100:00100000:3.0:1789518364.232339:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1789518364.232443:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fffbb80000/2, rc 0, transno 17179869188 00000100:00100000:2.0:1789518364.232451:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffbb80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627558912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518364.235007:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518364.235161:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617149568 00000100:00100000:2.0:1789518364.235173:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617149568 00000100:00100000:2.0:1789518364.235295:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1789518364.235315:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+9:2342:x1876445617149568:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789518364.256361:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869187 is committed 00000001:00080000:3.0:1789518364.256387:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869188 is committed 00000100:00100000:1.0:1789518364.256633:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2342:x1876445617149568:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 21291us (21610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.256647:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1789518364.260163:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518364.264137:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518364.264178:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c7839dc lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.264216:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c7839dc lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.264225:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c7839dc lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.264231:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c200 already unused, calling callback (ffffffffc1f3e4f0) 00000100:00100000:3.0:1789518364.264233:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617149952 00010000:00010000:1.0:1789518364.264237:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c7839dc lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518364.264245:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617149952 00010000:00010000:1.0:1789518364.264245:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c7839dc lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.264262:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff99ffdfff5700) 00010000:00010000:1.0:1789518364.264265:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518364.264272:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c7839dc lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.264278:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c7839dc lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518364.264316:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518364.264327:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2343:x1876445617149952:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789518364.264658:0:23985:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb size from disk: 256 -> 256 00002000:00010000:3.0:1789518364.264662:0:23985:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb mtime from disk: 1789518364 -> 1789518363 00002000:00010000:3.0:1789518364.264665:0:23985:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb atime from disk: 0 -> 1789518363 00002000:00010000:3.0:1789518364.264667:0:23985:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb ctime from disk: 1789518364 -> 1789518363 00002000:00010000:3.0:1789518364.264669:0:23985:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789518364.264737:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:2343:x1876445617149952:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 410us (612us total) trans 17179869189 rc 0/0 00000100:00100000:3.0:1789518364.264746:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518364.266743:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.266887:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617150208 00000100:00100000:1.0:1789518364.266899:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617150208 00000100:00100000:1.0:1789518364.266977:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1789518364.266987:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+13:21161:x1876445617150208:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789518364.267069:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.267090:0:23302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c7839ab lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1af expref: 13 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.267114:0:23302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 4/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.267156:0:23302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c7839ab lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1af expref: 13 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.267172:0:23302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c7839ab lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1af expref: 13 pid: 24710 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518364.267189:0:23302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23302:1876445627559040:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518364.267445:0:23302:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc1370600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518364.269556:0:23302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23302:1876445627559040:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518364.269599:0:23302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518364.269690:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518364.270212:0:23302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.270221:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.270256:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.270264:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.270280:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.270286:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518364.270291:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.270308:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.270318:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff99ffdfff5700) 00010000:00010000:1.0:1789518364.270321:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789518364.270326:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.270333:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c7839e3 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518364.270378:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+12:21161:x1876445617150208:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 3392us (3649us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789518364.270388:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1789518364.272385:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518364.272465:0:23984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617150464 00000100:00100000:2.0:1789518364.272477:0:23984:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617150464 00000100:00100000:2.0:1789518364.272545:0:23984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518364.272557:0:23984:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:2343:x1876445617150464:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789518364.272645:0:23984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.272671:0:23984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c7839d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1cb expref: 7 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.272681:0:23984:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518364.272686:0:23984:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518364.272691:0:23984:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 4/1,0 mode: --/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.272733:0:23984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c7839d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1cb expref: 7 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518364.272750:0:23984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c7839d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1cb expref: 7 pid: 23984 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518364.272793:0:23984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:23984:1876445627559168:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518364.272905:0:23984:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518364.275227:0:23984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:23984:1876445627559168:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518364.275263:0:23984:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518364.275383:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518364.275795:0:23984:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.275805:0:23984:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.275834:0:23984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.275855:0:23984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.275863:0:23984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.275871:0:23984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518364.275887:0:23984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.275902:0:23984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.275916:0:23984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.275924:0:23984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f4a233/0x631fd8698c7839ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518364.275976:0:23984:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2343:x1876445617150464:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 3422us (3603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.275985:0:23984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518364.277253:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.277305:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617150848 00000100:00100000:1.0:1789518364.277315:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617150848 00000100:00100000:1.0:1789518364.277364:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:1.0:1789518364.277388:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+12:21161:x1876445617150848:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518364.277494:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c7839f1 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.277509:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c7839f1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.277517:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c7839f1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.278150:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.278165:0:23301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7839b9 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1b6 expref: 13 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.278175:0:23301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.278216:0:23301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7839b9 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1b6 expref: 13 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.278233:0:23301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c7839b9 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1b6 expref: 13 pid: 23302 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518364.278250:0:23301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627559296:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518364.278403:0:23301:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518364.280156:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627559296:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518364.280190:0:23301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518364.281648:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518364.282373:0:23301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.282382:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518364.282631:0:23301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869215 00000001:00080000:1.0:1789518364.282806:0:23301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869216 00000001:00080000:1.0:1789518364.282845:0:23301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869217 00000100:00100000:1.0:1789518364.282939:0:23301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23301:1876445627559424:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789518364.285145:0:23301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518364.285204:0:23301:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfdfdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518364.285254:0:23305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627559424 00000100:00100000:3.0:1789518364.285268:0:23305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627559424 00000100:00100000:3.0:1789518364.285354:0:23305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518364.285364:0:23305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:23301:x1876445627559424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518364.285544:0:23305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:23301:x1876445627559424:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518364.285552:0:23305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518364.285720:0:23301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869188 gen 2 00000004:00080000:1.0:1789518364.285727:0:23301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fffbb80000, transno 17179869188 00000100:00100000:1.0:1789518364.285741:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23301:1876445627559424:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789518364.286815:0:23301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869218 00000100:00100000:1.0:1789518364.286948:0:23301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23301:1876445627559552:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789518364.287007:0:23301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518364.287041:0:23301:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfdfd540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518364.288366:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23301:1876445627559552:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789518364.288421:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288433:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288443:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288463:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518364.288469:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288478:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288501:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff99ffdfff5700) 00010000:00010000:1.0:1789518364.288504:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518364.288511:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288519:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7839f8 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288571:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c783949 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288579:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c783949 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288586:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c783949 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288591:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28dc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518364.288595:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c783949 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288601:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c783949 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288646:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffdfff5100) 00010000:00010000:1.0:1789518364.288649:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518364.288657:0:23301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783950 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd19a expref: 16 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288671:0:23301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783950 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd19a expref: 16 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518364.288681:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45a00/0x631fd8698c783950 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd19a expref: 16 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518364.293479:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.294248:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617151104 00000100:00100000:1.0:1789518364.294257:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617151104 00000100:00100000:1.0:1789518364.294315:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518364.294326:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21160:x1876445617151104:12345-192.168.206.51@tcp:49:lfs.0 00000040:00080000:2.0:1789518364.294340:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:2.0:1789518364.294347:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518364.294409:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:2.0:1789518364.294428:0:23335:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1789518364.294431:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1789518364.294444:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21160:x1876445617151104:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 120us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518364.294452:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000040:00080000:2.0:1789518364.294457:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 2 count 2 00000040:00080000:2.0:1789518364.294464:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000100:00100000:2.0:1789518364.299405:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518364.299508:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518364.299582:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617151360 00000100:00100000:3.0:1789518364.299595:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617151360 00000100:00100000:3.0:1789518364.299690:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518364.299702:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21161:x1876445617151360:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789518364.300518:0:23304:0:(mdd_object.c:4014:mdd_close()) Object [0x200001b71:0x4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789518364.301381:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869220 00010000:00010000:3.0:1789518364.301443:0:23304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783a06 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.301462:0:23304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783a06 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.301476:0:23304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783a06 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.301486:0:23304:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783a06 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.301506:0:23304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783a06 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.301513:0:23304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783a06 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518364.301800:0:23304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518364.301893:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:21161:x1876445617151360:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 2193us (2503us total) trans 17179869221 rc 0/0 00000100:00100000:3.0:1789518364.301903:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000020:00080000:3.0:1789518364.301909:0:23304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789518364.303734:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518364.303780:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617151872 00000100:00100000:1.0:1789518364.303792:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617151872 00000100:00100000:1.0:1789518364.303855:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518364.303867:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:21160:x1876445617151872:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:1.0:1789518364.304416:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:21160:x1876445617151872:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 549us (692us total) trans 17179869222 rc 0/0 00000100:00100000:1.0:1789518364.304426:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518364.328730:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000040:00080000:2.0:1789518364.795075:0:25460:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:2.0:1789518364.795085:0:25460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518364.795145:0:25460:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:2.0:1789518364.795163:0:25460:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1789518364.795172:0:25460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518364.795209:0:25460:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:2.0:1789518364.795212:0:25460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00010000:00010000:1.0:1789518364.914849:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518365.298848:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:2.0:1789518365.298855:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518365.298907:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:2.0:1789518365.298942:0:23335:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1789518365.298945:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518365.298976:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:2.0:1789518365.298981:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000100:00100000:2.0:1789518365.299106:0:23335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb28380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23335:1876445627559808:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518365.299228:0:23335:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518365.303190:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518365.303348:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617152128 00000100:00100000:1.0:1789518365.303358:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617152128 00000100:00100000:1.0:1789518365.303417:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:1.0:1789518365.303434:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+21:21175:x1876445617152128:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518365.303471:0:23302:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518365.303578:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+21:21175:x1876445617152128:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 146us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518365.303584:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1789518365.305287:0:23335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb28380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23335:1876445627559808:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518365.306763:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518365.306957:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617152384 00000100:00100000:2.0:1789518365.306969:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617152384 00000100:00100000:2.0:1789518365.307086:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1789518365.307165:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+20:21175:x1876445617152384:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518365.307192:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518365.307218:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783a29 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd1d9 expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.307336:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783a30 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.307353:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783a30 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.307368:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783a30 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518365.307380:0:23301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 2048 00010000:00010000:2.0:1789518365.307533:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783a29 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1d9 expref: 23 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.307555:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783a30 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1d9 expref: 22 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.307581:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffdfff5100) 00010000:00010000:2.0:1789518365.307584:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518365.307589:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:2.0:1789518365.307880:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+22:21175:x1876445617152384:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 775us (1117us total) trans 17179869223 rc 0/0 00000100:00100000:2.0:1789518365.307888:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1789518365.311762:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000040:00080000:3.0:1789518365.314073:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:3.0:1789518365.314082:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518365.314261:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 7 00000040:00080000:3.0:1789518365.314278:0:23335:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1789518365.314280:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518365.314303:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:3.0:1789518365.314307:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000100:00100000:3.0:1789518365.315503:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518365.315553:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518365.315590:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617153024 00000100:00100000:3.0:1789518365.315601:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617153024 00000100:00100000:3.0:1789518365.315706:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518365.315717:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+23:21175:x1876445617153024:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518365.316263:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+24:21175:x1876445617153024:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 545us (706us total) trans 17179869225 rc 0/0 00000100:00100000:3.0:1789518365.316292:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518365.316948:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617152768 00000100:00100000:2.0:1789518365.316957:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617152768 00000100:00100000:2.0:1789518365.317184:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518365.317196:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+24:2345:x1876445617152768:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518365.317213:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518365.317244:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783a30 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1d9 expref: 24 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518365.317265:0:23287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff99ffdfff5100) 00010000:00010000:2.0:1789518365.317271:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518365.317316:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+23:2345:x1876445617152768:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 122us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518365.317324:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1789518366.322844:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627560064:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.322877:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffbb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c8a322e-2788-4faf-9195-ae294b8818bd:3282:1876445627559936:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.322917:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518366.322918:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518366.322965:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627560448:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.322990:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518366.323016:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518366.323022:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627560576:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323044:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518366.323070:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627560192:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323093:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518366.323110:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518366.323116:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627560320:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323135:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518366.323166:0:23295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627559936 00000100:00100000:3.0:1789518366.323173:0:23295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627559936 00000100:00100000:3.0:1789518366.323214:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789518366.323222:0:23295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+19:3282:x1876445627559936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323270:0:23295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c8a322e-2788-4faf-9195-ae294b8818bd+19:3282:x1876445627559936:12345-0@lo:400:kworker.0 Request processed in 48us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518366.323277:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789518366.323306:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627560064 00000100:00100000:3.0:1789518366.323310:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627560064 00000100:00100000:3.0:1789518366.323339:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627560192 00000100:00100000:3.0:1789518366.323342:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627560192 00000100:00100000:3.0:1789518366.323363:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518366.323368:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627560064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323407:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627560064:12345-0@lo:400:kworker.0 Request processed in 39us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518366.323414:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518366.323427:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518366.323433:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627560192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323464:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627560192:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518366.323470:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518366.323487:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627560448 00000100:00100000:3.0:1789518366.323490:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627560448 00000100:00100000:3.0:1789518366.323515:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627560576 00000100:00100000:3.0:1789518366.323518:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627560576 00000100:00100000:3.0:1789518366.323530:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627560320 00000100:00100000:3.0:1789518366.323532:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627560320 00000100:00100000:3.0:1789518366.323545:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518366.323550:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627560448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323582:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627560448:12345-0@lo:400:kworker.0 Request processed in 30us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518366.323588:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518366.323600:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518366.323606:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627560576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323659:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627560576:12345-0@lo:400:kworker.0 Request processed in 54us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518366.323665:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518366.323674:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627560064:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323681:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518366.323689:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627560320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323730:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627560320:12345-0@lo:400:kworker.0 Request processed in 43us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518366.323737:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789518366.323760:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518366.323765:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518366.323767:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518366.323791:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627560320:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323801:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627560192:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323825:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627560576:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323833:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffbb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c8a322e-2788-4faf-9195-ae294b8818bd:3282:1876445627559936:0@lo:400:kworker.0 00000100:00100000:3.0:1789518366.323841:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627560448:0@lo:400:kworker.0 00000100:00100000:2.0:1789518366.326509:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627560704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518366.345426:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518366.345566:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617153280 00000100:00100000:3.0:1789518366.345576:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617153280 00000100:00080000:2.0:1789518366.345651:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518366.345672:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:3.0:1789518366.345683:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+23:21192:x1876445617153280:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518366.345704:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518366.345723:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd1e0 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.346020:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783a4c lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.346035:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783a4c lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.346049:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783a4c lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518366.346067:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789518366.346176:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1e0 expref: 26 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.346192:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c783a4c lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1e0 expref: 25 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518366.346200:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff99ffdfff5000) 00010000:00010000:3.0:1789518366.346203:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518366.346206:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:3.0:1789518366.346267:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:21192:x1876445617153280:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 586us (849us total) trans 17179869226 rc 0/0 00000100:00100000:3.0:1789518366.346288:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:3.0:1789518368.143171:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518368.143365:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518368.143964:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518368.143996:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518368.144017:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518368.144035:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518368.144079:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518368.144104:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617153920 00000100:00100000:3.0:1789518368.144108:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617153920 00000100:00100000:3.0:1789518368.144146:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617153536 00000100:00100000:3.0:1789518368.144150:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617153536 00000100:00100000:3.0:1789518368.144173:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518368.144183:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2344:x1876445617153920:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518368.144309:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617153664 00000100:00100000:1.0:1789518368.144315:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617153664 00000100:00100000:1.0:1789518368.144338:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617153792 00000100:00100000:1.0:1789518368.144340:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617153792 00000100:00100000:1.0:1789518368.144350:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617154048 00000100:00100000:1.0:1789518368.144352:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617154048 00000100:00100000:1.0:1789518368.144361:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617154176 00000100:00100000:1.0:1789518368.144363:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617154176 00000100:00100000:1.0:1789518368.144375:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518368.144382:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2344:x1876445617153664:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518368.144444:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2344:x1876445617153664:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 62us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518368.144451:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518368.144467:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518368.144482:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2344:x1876445617153792:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518368.144508:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2344:x1876445617153792:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518368.144514:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518368.144534:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518368.144544:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2345:x1876445617154048:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518368.144572:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2345:x1876445617154048:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518368.144579:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518368.144596:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518368.144608:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2345:x1876445617154176:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518368.144658:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2345:x1876445617154176:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 54us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518368.144663:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518368.144708:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1789518368.144717:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:2344:x1876445617153536:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518368.144757:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:2344:x1876445617153536:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518368.144763:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518368.144820:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2344:x1876445617153920:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 637us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518368.144828:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00080000:3.0:1789518368.144888:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518368.144894:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518368.144896:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518368.884282:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518368.884303:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627560832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518368.884364:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518368.884565:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518368.884747:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627560832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518368.936875:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518368.937016:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617154304 00000100:00100000:1.0:1789518368.937025:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617154304 00000100:00100000:1.0:1789518368.937083:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1789518368.937093:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:21054:x1876445617154304:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789518368.937204:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:21054:x1876445617154304:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518368.937211:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:2.0:1789518368.945123:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518368.945283:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617154560 00000100:00100000:3.0:1789518368.945293:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617154560 00000100:00100000:3.0:1789518368.945410:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1789518368.945421:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:21054:x1876445617154560:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518368.945732:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+26:21054:x1876445617154560:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 312us (615us total) trans 17179869227 rc 0/0 00000100:00100000:3.0:1789518368.945740:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000040:00080000:1.0:1789518369.394861:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:1.0:1789518369.394870:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518369.395799:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 4 00000040:00080000:1.0:1789518369.395831:0:23335:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1789518369.395835:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518369.395886:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:1.0:1789518369.395892:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000001:00080000:3.0:1789518369.428187:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869190 is committed 00000001:00080000:3.0:1789518369.428201:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869189 is committed 00000001:00080000:2.0:1789518369.432958:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869224 is committed 00000020:00080000:2.0:1789518369.432981:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffdfdfd780 refcount 2 committed 0 result 0 batchid 12884902053 00000020:00080000:2.0:1789518369.432986:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff420b900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffdfdfdf00 00000020:00080000:2.0:1789518369.432990:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff420ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec483a400 00000001:00080000:2.0:1789518369.433020:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869227 is committed 00000020:00080000:3.0:1789518369.433069:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12884902053 committed batchid 8589934634 00000020:00080000:3.0:1789518369.433212:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934634 00010000:00010000:3.0:1789518370.035997:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518370.707937:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518370.708138:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617154816 00000100:00100000:3.0:1789518370.708148:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617154816 00000100:00100000:3.0:1789518370.708291:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:3.0:1789518370.708303:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+12:21882:x1876445617154816:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518370.708337:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518370.708356:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783a5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd1e7 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708418:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708432:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708445:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708458:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708465:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708471:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708797:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783a6f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708807:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708815:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518370.708824:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789518370.708949:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708957:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708978:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708984:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518370.708988:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.708996:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709008:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffdfff5f00) 00010000:00010000:3.0:1789518370.709011:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518370.709016:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709022:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783a61 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709036:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709042:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709048:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709064:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518370.709067:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709074:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709083:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffe6f98f00) 00010000:00010000:3.0:1789518370.709085:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518370.709087:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709093:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783a68 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518370.709397:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518370.709550:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783a5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1e7 expref: 15 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709567:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783a6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1e7 expref: 14 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.709574:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518370.709577:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518370.709580:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:3.0:1789518370.709678:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+14:21882:x1876445617154816:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1378us (1749us total) trans 17179869228 rc 0/0 00000100:00100000:3.0:1789518370.709686:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1789518370.712559:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518370.712661:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617154944 00000100:00100000:1.0:1789518370.712670:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617154944 00000100:00100000:1.0:1789518370.712717:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:1.0:1789518370.712727:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+14:21882:x1876445617154944:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789518370.712867:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+14:21882:x1876445617154944:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 141us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518370.712875:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:2.0:1789518370.716351:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518370.752810:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518370.760317:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518370.760425:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617155456 00000100:00100000:1.0:1789518370.760434:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617155456 00000100:00100000:1.0:1789518370.760502:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518370.760513:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:21891:x1876445617155456:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1789518370.760529:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518370.760552:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd1f5 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518370.760576:0:23985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518370.760607:0:23985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789518370.760634:0:23985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.760645:0:23985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1f5 expref: 6 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.760664:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1f5 expref: 6 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.760677:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44200, rc 0) 00000100:00100000:1.0:1789518370.760738:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:21891:x1876445617155456:12345-192.168.206.51@tcp:101:dd.0 Request processed in 227us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518370.760745:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00080000:2.0:1789518370.760799:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518370.763687:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518370.763830:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617155712 00000100:00100000:1.0:1789518370.763839:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617155712 00000100:00100000:1.0:1789518370.763938:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518370.763948:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+14:21891:x1876445617155712:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:1.0:1789518370.764286:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+15:21891:x1876445617155712:12345-192.168.206.51@tcp:35:dd.0 Request processed in 338us (604us total) trans 17179869230 rc 0/0 00000100:00100000:1.0:1789518370.764293:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518370.772089:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617155840 00000100:00100000:1.0:1789518370.772101:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617155840 00000100:00100000:1.0:1789518370.772219:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:1.0:1789518370.772231:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+15:21892:x1876445617155840:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:1.0:1789518370.772264:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518370.772286:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd1fc expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.772368:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783aae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.772382:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.772394:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518370.772427:0:24710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518370.772431:0:24710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518370.772452:0:24710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.772474:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1fc expref: 17 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.772492:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1fc expref: 16 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.772500:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:1.0:1789518370.772504:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518370.772507:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45c00, rc 0) 00000100:00100000:1.0:1789518370.772570:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21892:x1876445617155840:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 342us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518370.772577:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1789518370.775290:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518370.775391:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617156096 00000100:00100000:3.0:1789518370.775418:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617156096 00000100:00100000:3.0:1789518370.775473:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1789518370.775483:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21892:x1876445617156096:12345-192.168.206.51@tcp:36:chmod.0 00010000:00010000:3.0:1789518370.775527:0:23302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518370.775550:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783a92 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1ee expref: 16 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.775569:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffdfff5400) 00010000:00010000:3.0:1789518370.775578:0:23302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518370.775603:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.775761:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.775773:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518370.775968:0:23302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae4ed5a4 reply state 00000000ad92145d transno 17179869231 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518370.775977:0:23302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518370.776062:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21892:x1876445617156096:12345-192.168.206.51@tcp:36:chmod.0 Request processed in 580us (780us total) trans 17179869231 rc 0/0 00000100:00100000:3.0:1789518370.776070:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00010000:00010000:1.0:1789518370.777875:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.777903:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518370.777905:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518370.777915:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.777921:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518370.777925:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.777932:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.777945:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:1.0:1789518370.777948:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518370.777952:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.777957:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783ab5 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518370.778029:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617156224 00000100:00100000:3.0:1789518370.778036:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617156224 00000100:00100000:3.0:1789518370.778080:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:3.0:1789518370.778089:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21892:x1876445617156224:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:3.0:1789518370.778116:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518370.778131:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd203 expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.778485:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd203 expref: 17 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.778499:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd203 expref: 17 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.778517:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98e00) 00010000:00010000:3.0:1789518370.778520:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518370.778522:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc600, rc 0) 00000100:00100000:3.0:1789518370.778764:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21892:x1876445617156224:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 674us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518370.778771:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:1.0:1789518370.781389:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617156352 00000100:00100000:1.0:1789518370.781399:0:24439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617156352 00000100:00100000:1.0:1789518370.781520:0:24439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1789518370.781530:0:24439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2342:x1876445617156352:12345-192.168.206.51@tcp:2:chmod.0 00002000:00010000:1.0:1789518370.781839:0:24439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789518370.781854:0:24439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789518370.781856:0:24439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789518370.781858:0:24439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb ctime from disk: 0 -> 1789518371 00002000:00010000:1.0:1789518370.781871:0:24439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789518370.781968:0:24439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:2342:x1876445617156352:12345-192.168.206.51@tcp:2:chmod.0 Request processed in 439us (638us total) trans 17179869186 rc 0/0 00000100:00100000:1.0:1789518370.781976:0:24439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518370.818158:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518370.859468:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518370.859600:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617156864 00000100:00100000:1.0:1789518370.859638:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617156864 00000100:00100000:1.0:1789518370.859769:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518370.859783:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21904:x1876445617156864:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518370.859810:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518370.859836:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd211 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.859937:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.859953:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.859966:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.859982:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.859988:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.859995:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860157:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860182:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860190:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518370.860202:0:24710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:1.0:1789518370.860231:0:24710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860238:0:24710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860245:0:24710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860251:0:24710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518370.860255:0:24710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860262:0:24710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860275:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98e00) 00010000:00010000:1.0:1789518370.860278:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518370.860283:0:24710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860290:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783af4 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860320:0:24710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860326:0:24710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860331:0:24710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860335:0:24710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518370.860338:0:24710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860344:0:24710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860351:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:1.0:1789518370.860353:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518370.860356:0:24710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860361:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783ae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860368:0:24710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860374:0:24710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860379:0:24710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860391:0:24710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518370.860394:0:24710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860401:0:24710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860409:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518370.860412:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518370.860415:0:24710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860421:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783aed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860457:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783adf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd211 expref: 18 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860468:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:1.0:1789518370.860471:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518370.860474:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd211 expref: 18 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.860483:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45e00, rc 0) 00000100:00100000:1.0:1789518370.860565:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21904:x1876445617156864:12345-192.168.206.51@tcp:101:dd.500 Request processed in 784us (1112us total) trans 0 rc 301/301 00000100:00100000:1.0:1789518370.860573:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1789518370.903931:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518370.904237:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617156992 00000100:00100000:3.0:1789518370.904250:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617156992 00000100:00100000:3.0:1789518370.904375:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1789518370.904388:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21910:x1876445617156992:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518370.904416:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518370.904443:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783afb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd218 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904533:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904569:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904596:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904655:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904663:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904670:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904792:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783b10 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904800:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783b10 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904807:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783b10 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518370.904870:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00000004:00200000:3.0:1789518370.904875:0:23302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518370.904899:0:23302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783b10 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904912:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783b10 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904932:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904938:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904945:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904951:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518370.904956:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904964:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904977:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:3.0:1789518370.904979:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518370.904985:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.904991:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783b02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905009:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905015:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905020:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905142:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518370.905145:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905151:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905160:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffe6f98200) 00010000:00010000:3.0:1789518370.905162:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518370.905165:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905171:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783b09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905208:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783afb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd218 expref: 19 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905222:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783b10 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd218 expref: 18 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.905229:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98e00) 00010000:00010000:3.0:1789518370.905231:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518370.905234:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:3.0:1789518370.905320:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:21910:x1876445617156992:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 933us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518370.905329:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:2.0:1789518370.909234:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518370.909346:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617157248 00000100:00100000:3.0:1789518370.909377:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617157248 00000100:00100000:3.0:1789518370.909494:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:3.0:1789518370.909506:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:21910:x1876445617157248:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518370.909545:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518370.909667:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c783b17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd21f expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.909806:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783b1e lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.909835:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783b1e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.909861:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783b1e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518370.909875:0:23301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1789518370.910116:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c783b17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd21f expref: 21 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.910142:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783b1e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd21f expref: 20 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.910152:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98e00) 00010000:00010000:3.0:1789518370.910155:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518370.910159:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:3.0:1789518370.910291:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+20:21910:x1876445617157248:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 786us (1070us total) trans 17179869232 rc 0/0 00000100:00100000:3.0:1789518370.910299:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518370.914123:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518370.914170:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518370.914874:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617157632 00000100:00100000:3.0:1789518370.914880:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617157632 00000100:00100000:3.0:1789518370.914957:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518370.914965:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:21910:x1876445617157632:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518370.914990:0:23300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518370.915009:0:23300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783b2c lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd226 expref: -99 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.915131:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783b33 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.915147:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783b33 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.915160:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783b33 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518370.915173:0:23300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1789518370.915329:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783b2c lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd226 expref: 22 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.915347:0:23300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783b33 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd226 expref: 21 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.915355:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98e00) 00010000:00010000:3.0:1789518370.915358:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518370.915361:0:23300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:3.0:1789518370.915410:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+21:21910:x1876445617157632:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 447us (1239us total) trans 17179869233 rc 0/0 00000100:00100000:3.0:1789518370.915429:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:2.0:1789518370.921086:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518370.921241:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617157760 00000100:00100000:1.0:1789518370.921270:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617157760 00000100:00100000:1.0:1789518370.921375:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518370.921387:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:2345:x1876445617157760:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:1.0:1789518370.921457:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.921483:0:23985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1f5 expref: 7 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.921493:0:23985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518370.921499:0:23985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518370.921505:0:23985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.921564:0:23985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1f5 expref: 7 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.921579:0:23985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1f5 expref: 7 pid: 23985 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518370.921596:0:23985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:23985:1876445627560960:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518370.921746:0:23985:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd9167d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518370.924073:0:23985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:23985:1876445627560960:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518370.924107:0:23985:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518370.924463:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518370.929593:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617158016 00000100:00100000:2.0:1789518370.929608:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617158016 00010000:00010000:2.0:1789518370.929695:0:23287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1f5 expref: 10 pid: 23985 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518370.929785:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518370.929797:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff5627850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+10:2343:x1876445617158016:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518370.929835:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789518370.929879:0:23287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1789518370.929883:0:23287:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1789518371 00002000:00010000:2.0:1789518370.929886:0:23287:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb atime from disk: 0 -> 1789518371 00010000:00010000:2.0:1789518370.929898:0:23287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1f5 expref: 10 pid: 23985 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.929913:0:23287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1f5 expref: 10 pid: 23985 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.929942:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783aa0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd1f5 expref: 10 pid: 23985 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.929961:0:23287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518370.929967:0:23287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518370.929974:0:23287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.929995:0:23287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.930041:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518370.930117:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff5627850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+9:2343:x1876445617158016:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 322us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518370.930125:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00010000:00010000:1.0:1789518370.930242:0:23985:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.930255:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.930392:0:23985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.930405:0:23985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.930414:0:23985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.930422:0:23985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518370.930427:0:23985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.930439:0:23985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.930453:0:23985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518370.930475:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c783b41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518370.930538:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+8:2345:x1876445617157760:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 9153us (9466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518370.930548:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1789518370.933907:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617158272 00000100:00100000:3.0:1789518370.933925:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617158272 00000100:00100000:3.0:1789518370.934193:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518370.934207:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+21:21910:x1876445617158272:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:3.0:1789518370.934288:0:23304:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200001b71:0x5:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783b33 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd226 expref: 21 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518370.935164:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869234 00000001:00080000:2.0:1789518370.935229:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869235 00000001:00080000:2.0:1789518370.936248:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869236 00010000:00010000:2.0:1789518370.936328:0:23304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.936353:0:23304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd203 expref: 25 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.936364:0:23304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783b10 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd218 expref: 25 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.936373:0:23304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 5/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.936497:0:23304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783b10 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd218 expref: 25 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.936518:0:23304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783b10 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd218 expref: 25 pid: 23302 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518370.936539:0:23304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb29500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:23304:1876445627561088:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518370.936784:0:23304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd203 expref: 25 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.936794:0:23304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd203 expref: 25 pid: 23301 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518370.936803:0:23304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb29f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:23304:1876445627561216:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518370.936829:0:23304:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518370.939699:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518370.939966:0:23304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb29500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:23304:1876445627561088:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518370.940789:0:23304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb29f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:23304:1876445627561216:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518370.940821:0:23304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518370.941454:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518370.941575:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617158528 00000100:00100000:2.0:1789518370.941584:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617158528 00010000:00010000:2.0:1789518370.941655:0:23287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd203 expref: 25 pid: 23301 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518370.941688:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:2.0:1789518370.941697:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:2342:x1876445617158528:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518370.941712:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518370.941718:0:23287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd203 expref: 25 pid: 23301 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.941729:0:23287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd203 expref: 25 pid: 23301 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.941750:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783abc lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd203 expref: 25 pid: 23301 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.941774:0:23287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98e00) 00010000:00010000:2.0:1789518370.941778:0:23287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.941788:0:23287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.941794:0:23287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.941817:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518370.941859:0:23304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.941866:0:23304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518370.941893:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+24:2342:x1876445617158528:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 197us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518370.941901:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000001:00080000:3.0:1789518370.942021:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869237 00000001:00080000:3.0:1789518370.942296:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869238 00000100:00100000:3.0:1789518370.942477:0:23304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a26a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:23304:1876445627561344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518370.942532:0:23304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518370.942572:0:23304:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801240 going to sleep for 11 seconds 00000100:00080000:2.0:1789518370.942707:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518370.942929:0:23304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a26a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:23304:1876445627561344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518370.943412:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869239 00000100:00100000:2.0:1789518370.943468:0:23304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb28380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:23304:1876445627561472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518370.943496:0:23304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518370.943515:0:23304:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789518370.943919:0:23304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb28380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:23304:1876445627561472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518370.943969:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869240 00010000:00010000:2.0:1789518370.943998:0:23304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.944006:0:23304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.944011:0:23304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.944015:0:23304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518370.944019:0:23304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.944026:0:23304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.944039:0:23304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98e00) 00010000:00010000:2.0:1789518370.944042:0:23304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789518370.944053:0:23304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518370.944057:0:23304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b48 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518370.944245:0:23304:0:(mdd_object.c:4014:mdd_close()) Object [0x200001b71:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789518370.944460:0:23304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].2, 64 off8320 00000004:00080000:2.0:1789518370.944472:0:23304:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424940858113ns, next at 425940855034ns, rc = 0 00000001:00080000:2.0:1789518370.944479:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869241 00010000:00010000:2.0:1789518370.944513:0:23304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98e00) 00010000:00010000:2.0:1789518370.944516:0:23304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518370.944523:0:23304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783b33 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd226 expref: 28 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518370.944674:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+27:21910:x1876445617158272:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 10471us (10898us total) trans 17179869242 rc 0/0 00000100:00100000:2.0:1789518370.944683:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000020:00080000:2.0:1789518370.944688:0:23304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518370.948770:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518370.948878:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617158656 00000100:00100000:3.0:1789518370.948891:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617158656 00000100:00100000:3.0:1789518370.948960:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1789518370.948972:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+27:21910:x1876445617158656:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518370.949024:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518370.949062:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c783b4f lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd22d expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.949135:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c783b4f lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd22d expref: 28 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.949151:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c783b4f lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd22d expref: 28 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518370.949171:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518370.949175:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518370.949179:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:3.0:1789518370.949255:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+28:21910:x1876445617158656:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 285us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518370.949263:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1789518370.954836:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617158912 00000100:00100000:1.0:1789518370.954858:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617158912 00000100:00100000:1.0:1789518370.954929:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518370.954941:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+28:21910:x1876445617158912:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518370.955311:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+29:21910:x1876445617158912:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 371us (1096us total) trans 17179869243 rc 0/0 00000100:00100000:1.0:1789518370.955320:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:2.0:1789518371.013659:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617159040 00000100:00100000:2.0:1789518371.015144:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617159040 00000100:00100000:2.0:1789518371.015269:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1789518371.015281:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+29:21920:x1876445617159040:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518371.015358:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015375:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015388:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015435:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015444:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015450:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015529:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015536:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015542:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518371.015577:0:23302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015587:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015593:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015600:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015605:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.015609:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015652:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015672:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:2.0:1789518371.015675:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.015680:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015685:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015705:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015711:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015716:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015720:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.015723:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015729:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015735:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffd8a16200) 00010000:00010000:2.0:1789518371.015737:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.015740:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015753:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783b5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015766:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015772:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015777:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015781:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.015784:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015790:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015796:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.015798:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.015800:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.015805:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783b64 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.015882:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+29:21920:x1876445617159040:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 597us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.015890:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1789518371.056142:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518371.096444:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617159552 00000100:00100000:3.0:1789518371.096455:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617159552 00000100:00100000:3.0:1789518371.096587:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1789518371.096599:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+29:21932:x1876445617159552:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:3.0:1789518371.096649:0:23300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518371.096676:0:23300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd23b expref: -99 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.096770:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.096789:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.096848:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.096869:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.096877:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.096884:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097044:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097053:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097060:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518371.097071:0:23300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1789518371.097096:0:23300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097104:0:23300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097111:0:23300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097118:0:23300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.097130:0:23300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097140:0:23300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097155:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.097158:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518371.097164:0:23300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097171:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783b9c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097192:0:23300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097198:0:23300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097204:0:23300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097209:0:23300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.097213:0:23300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097219:0:23300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097227:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:3.0:1789518371.097230:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518371.097241:0:23300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097247:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097258:0:23300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097264:0:23300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097269:0:23300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097274:0:23300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.097277:0:23300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097282:0:23300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097289:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffe6f98400) 00010000:00010000:3.0:1789518371.097292:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518371.097294:0:23300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097300:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783b95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097338:0:23300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783b87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd23b expref: 30 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097361:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:3.0:1789518371.097364:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518371.097368:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd23b expref: 30 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.097378:0:23300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:3.0:1789518371.097502:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+29:21932:x1876445617159552:12345-192.168.206.51@tcp:101:dd.500 Request processed in 905us (1179us total) trans 0 rc 301/301 00000100:00100000:3.0:1789518371.097510:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1789518371.111107:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518371.111174:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617159680 00000100:00100000:3.0:1789518371.111185:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617159680 00000100:00080000:2.0:1789518371.111355:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518371.111404:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1789518371.111415:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:248f1a9b-0266-4d36-9534-dab733fe88d3+5:21933:x1876445617159680:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:3.0:1789518371.111435:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518371.111454:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783ba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd242 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.111508:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783baa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.111521:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783baa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.111533:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783baa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518371.111564:0:24710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518371.111579:0:24710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518371.111600:0:24710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783baa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.111649:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783ba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd242 expref: 7 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.111668:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783baa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd242 expref: 6 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.111676:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:3.0:1789518371.111679:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518371.111683:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:3.0:1789518371.111809:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:248f1a9b-0266-4d36-9534-dab733fe88d3+6:21933:x1876445617159680:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 396us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.111816:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:2.0:1789518371.114329:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617159808 00000100:00100000:2.0:1789518371.114354:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617159808 00000100:00100000:2.0:1789518371.114441:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:2.0:1789518371.114462:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+6:21933:x1876445617159808:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:2.0:1789518371.114488:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518371.114514:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd249 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114595:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114656:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114672:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114690:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114698:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114706:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114831:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c783bc6 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114853:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c783bc6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114879:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c783bc6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518371.114926:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00000004:00200000:2.0:1789518371.114931:0:23302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518371.114954:0:23302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c783bc6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114970:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c783bc6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114978:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114985:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.114993:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115000:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.115005:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115013:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115026:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:2.0:1789518371.115030:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.115037:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115711:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783bb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115736:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115742:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115749:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115754:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.115757:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115763:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115774:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffd8a16200) 00010000:00010000:2.0:1789518371.115776:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.115780:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115785:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c783bbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115831:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd249 expref: 8 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115876:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c783bc6 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd249 expref: 7 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.115883:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.115885:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518371.115888:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518371.115985:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+7:21933:x1876445617159808:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 1534us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.115996:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1789518371.119499:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617160064 00000100:00100000:3.0:1789518371.119512:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617160064 00000100:00100000:3.0:1789518371.119586:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:3.0:1789518371.119598:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+7:21933:x1876445617160064:12345-192.168.206.51@tcp:36:chmod.0 00010000:00010000:3.0:1789518371.119695:0:23301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518371.119728:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c783bc6 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd249 expref: 7 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.119750:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.119756:0:23301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518371.119788:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783bcd lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.119826:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783bcd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.119847:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783bcd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518371.120096:0:23301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdd536fc reply state 000000004c26960a transno 17179869244 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783bcd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.120106:0:23301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518371.120211:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+8:21933:x1876445617160064:12345-192.168.206.51@tcp:36:chmod.0 Request processed in 615us (968us total) trans 17179869244 rc 0/0 00000100:00100000:3.0:1789518371.120220:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:3.0:1789518371.124534:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617160192 00000100:00100000:3.0:1789518371.124546:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617160192 00000100:00100000:3.0:1789518371.124692:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:3.0:1789518371.124704:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+7:21933:x1876445617160192:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:3.0:1789518371.124730:0:23300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518371.124753:0:23300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd250 expref: -99 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.124828:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd250 expref: 8 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.124858:0:23300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd250 expref: 8 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.124934:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.124958:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518371.124962:0:23300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7000, rc 0) 00000100:00100000:3.0:1789518371.125105:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+8:21933:x1876445617160192:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 402us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.125114:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1789518371.171466:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518371.171736:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617160448 00000100:00100000:3.0:1789518371.171746:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617160448 00000100:00100000:3.0:1789518371.171836:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:3.0:1789518371.171859:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+29:21939:x1876445617160448:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:3.0:1789518371.171878:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518371.171898:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783bdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd257 expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.171961:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.171974:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.171985:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.171998:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172005:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172012:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172175:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783bf0 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172184:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783bf0 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172191:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783bf0 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518371.172200:0:23301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1789518371.172290:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172298:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172305:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172311:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.172316:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172323:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172334:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:3.0:1789518371.172337:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518371.172342:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172358:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172371:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172378:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172384:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172389:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.172392:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172409:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172418:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffe6f98400) 00010000:00010000:3.0:1789518371.172420:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518371.172423:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172429:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783be9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172469:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783bdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd257 expref: 32 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172494:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783bf0 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd257 expref: 31 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.172502:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.172504:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518371.172506:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:3.0:1789518371.172563:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+31:21939:x1876445617160448:12345-192.168.206.51@tcp:101:dd.500 Request processed in 707us (1105us total) trans 17179869245 rc 0/0 00000100:00100000:3.0:1789518371.172570:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:2.0:1789518371.178066:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617160704 00000100:00100000:2.0:1789518371.178139:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617160704 00000100:00100000:2.0:1789518371.178251:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1789518371.178264:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+31:21939:x1876445617160704:12345-192.168.206.51@tcp:36:dd.500 00010000:00010000:2.0:1789518371.178355:0:23302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518371.178452:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783bf0 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd257 expref: 31 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.178476:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.178482:0:23302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518371.178799:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.178816:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.178829:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518371.178921:0:23302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869246 00000004:00010000:2.0:1789518371.179359:0:23302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c5d689a reply state 00000000cad18780 transno 17179869247 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.179371:0:23302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518371.180268:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+33:21939:x1876445617160704:12345-192.168.206.51@tcp:36:dd.500 Request processed in 2000us (2972us total) trans 17179869247 rc 0/0 00000100:00100000:2.0:1789518371.180279:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000020:00080000:2.0:1789518371.180286:0:23302:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518371.182185:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.182206:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.182216:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.182243:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518371.182248:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.182257:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.182275:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518371.182279:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518371.182285:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.182291:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c783bfe lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.183894:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617160960 00000100:00100000:1.0:1789518371.183906:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617160960 00000100:00100000:1.0:1789518371.183975:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518371.184046:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+32:21939:x1876445617160960:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:1.0:1789518371.184479:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+33:21939:x1876445617160960:12345-192.168.206.51@tcp:35:dd.500 Request processed in 492us (880us total) trans 17179869248 rc 0/0 00000100:00100000:1.0:1789518371.184488:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518371.228798:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617161088 00000100:00100000:1.0:1789518371.228811:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617161088 00000100:00100000:1.0:1789518371.229111:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:1.0:1789518371.229123:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+33:21945:x1876445617161088:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518371.229152:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518371.229193:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783c05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd25e expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229340:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229357:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229370:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229385:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229391:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229397:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229512:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229520:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229528:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518371.229561:0:24710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00000004:00200000:1.0:1789518371.229566:0:24710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518371.229588:0:24710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.229607:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230418:0:24710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230430:0:24710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230439:0:24710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230446:0:24710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518371.230451:0:24710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230460:0:24710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230476:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:1.0:1789518371.230480:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518371.230485:0:24710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230493:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783c0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230510:0:24710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230516:0:24710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230535:0:24710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230541:0:24710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518371.230545:0:24710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230552:0:24710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230561:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518371.230563:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518371.230567:0:24710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230586:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230681:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44000/0x631fd8698c783c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd25e expref: 35 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230699:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd25e expref: 34 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.230706:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518371.230708:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518371.230712:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44200, rc 0) 00000100:00100000:1.0:1789518371.230792:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+34:21945:x1876445617161088:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 1671us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.230809:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:3.0:1789518371.235924:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617161344 00000100:00100000:3.0:1789518371.235936:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617161344 00000100:00100000:3.0:1789518371.236005:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1789518371.236019:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+34:21945:x1876445617161344:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518371.236046:0:23300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518371.236071:0:23300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783c21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd265 expref: -99 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.236263:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.236289:0:23300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd25e expref: 35 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.236299:0:23300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 4/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.236342:0:23300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd25e expref: 35 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.236365:0:23300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd25e expref: 35 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.236381:0:23300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23300:1876445627561600:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518371.236494:0:23300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518371.239800:0:23300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23300:1876445627561600:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518371.240107:0:23300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.240723:0:23286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617161472 00000100:00100000:1.0:1789518371.240732:0:23286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617161472 00010000:00010000:1.0:1789518371.240777:0:23286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd25e expref: 36 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.240822:0:23286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1789518371.240833:0:23286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:2342:x1876445617161472:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518371.240862:0:23286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518371.240871:0:23286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd25e expref: 36 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.240886:0:23286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd25e expref: 36 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.240914:0:23286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c1a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd25e expref: 36 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.240934:0:23286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518371.240940:0:23286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.240951:0:23286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.240960:0:23286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 4/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.241028:0:23286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518371.241108:0:23286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+35:2342:x1876445617161472:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 275us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.241117:0:23286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00010000:00010000:3.0:1789518371.242371:0:23300:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.242439:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518371.242465:0:23300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00010000:00010000:3.0:1789518371.242702:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783c21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd265 expref: 36 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.242725:0:23300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd265 expref: 35 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.242735:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.242738:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518371.242742:0:23300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:3.0:1789518371.242828:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+35:21945:x1876445617161344:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 6812us (7067us total) trans 17179869249 rc 0/0 00000100:00100000:3.0:1789518371.242864:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1789518371.249886:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617161728 00000100:00100000:2.0:1789518371.249899:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617161728 00000100:00100000:2.0:1789518371.249976:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518371.249989:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+35:21945:x1876445617161728:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:2.0:1789518371.250366:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21945:x1876445617161728:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 379us (607us total) trans 17179869250 rc 0/0 00000100:00100000:2.0:1789518371.250375:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518371.272651:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617161856 00000100:00100000:3.0:1789518371.272665:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617161856 00000100:00100000:3.0:1789518371.272738:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1789518371.272749:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21946:x1876445617161856:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:3.0:1789518371.272776:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518371.272796:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd26c expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.272875:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.272889:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.272899:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.272909:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.272914:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.272918:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.273610:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.273672:0:23301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd265 expref: 37 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.273681:0:23301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 4/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.273722:0:23301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd265 expref: 37 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.273738:0:23301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd265 expref: 37 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.273753:0:23301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627561728:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518371.273869:0:23301:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518371.276410:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617161984 00000100:00100000:2.0:1789518371.276431:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617161984 00010000:00010000:2.0:1789518371.276477:0:23287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 5/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd265 expref: 38 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.276534:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:2.0:1789518371.276546:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:2342:x1876445617161984:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518371.276566:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518371.276574:0:23287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 5/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd265 expref: 38 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.276800:0:23287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd265 expref: 38 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.276831:0:23287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.276837:0:23287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.276858:0:23287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.276866:0:23287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 4/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.276894:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518371.276938:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c28 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd265 expref: 38 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.276961:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627561728:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518371.277039:0:23301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277050:0:23301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277057:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518371.277240:0:23301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00000004:00200000:3.0:1789518371.277255:0:23301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518371.277341:0:23301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.277352:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+37:2342:x1876445617161984:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 806us (1106us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518371.277359:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.277365:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00010000:00010000:3.0:1789518371.277376:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277385:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277392:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277398:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.277403:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277411:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277421:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:3.0:1789518371.277424:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518371.277428:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277434:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277445:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277462:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277468:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277473:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.277476:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277483:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277491:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffe6f98400) 00010000:00010000:3.0:1789518371.277493:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518371.277496:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277501:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277556:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd26c expref: 37 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277570:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd26c expref: 36 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.277578:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.277581:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518371.277591:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:3.0:1789518371.277665:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21946:x1876445617161856:12345-192.168.206.51@tcp:101:chown.0 Request processed in 4917us (5116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.277674:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:2.0:1789518371.280888:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617162112 00000100:00100000:2.0:1789518371.280901:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617162112 00000100:00100000:2.0:1789518371.280996:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1789518371.281008:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+36:21946:x1876445617162112:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518371.281033:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518371.281058:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c52 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd273 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.281103:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783c59 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.281139:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783c59 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.281223:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783c59 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.281360:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c52 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd273 expref: 38 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.281382:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783c59 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd273 expref: 37 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.281390:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.281707:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518371.281712:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16e00, rc 0) 00000100:00100000:2.0:1789518371.281781:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+37:21946:x1876445617162112:12345-192.168.206.51@tcp:101:chown.0 Request processed in 774us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.281789:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1789518371.286011:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617162368 00000100:00100000:1.0:1789518371.286023:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617162368 00000100:00100000:1.0:1789518371.286518:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:1.0:1789518371.286533:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+37:21946:x1876445617162368:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:1.0:1789518371.286696:0:24710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518371.286732:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c4b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd26c expref: 37 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.286767:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518371.286773:0:24710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518371.286808:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.286825:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.286835:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518371.287261:0:24710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000746e63f3 reply state 00000000086c3708 transno 17179869251 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.287274:0:24710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518371.287526:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21946:x1876445617162368:12345-192.168.206.51@tcp:36:chown.0 Request processed in 996us (1637us total) trans 17179869251 rc 0/0 00000100:00100000:1.0:1789518371.287663:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00010000:00010000:2.0:1789518371.289225:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.289244:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.289253:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.289260:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.289265:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.289288:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.289326:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.289330:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518371.289336:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.289343:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783c60 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.330005:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617162496 00000100:00100000:3.0:1789518371.330019:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617162496 00000100:00100000:3.0:1789518371.330096:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518371.330108:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+37:21952:x1876445617162496:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518371.330140:0:23300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518371.330166:0:23300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd27a expref: -99 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330247:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330264:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330277:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330292:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330299:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330306:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330420:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330444:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330451:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518371.330491:0:23300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00000004:00200000:3.0:1789518371.330496:0:23300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518371.330520:0:23300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330533:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330543:0:23300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330550:0:23300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330558:0:23300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330564:0:23300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.330569:0:23300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330576:0:23300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330590:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:3.0:1789518371.330599:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518371.330606:0:23300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330650:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c783c6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330668:0:23300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330675:0:23300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330681:0:23300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330686:0:23300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.330689:0:23300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330695:0:23300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330702:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffe6f98400) 00010000:00010000:3.0:1789518371.330705:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518371.330708:0:23300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330714:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c783c75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330746:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c783c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd27a expref: 39 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330772:0:23300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd27a expref: 38 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.330780:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.331201:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518371.331206:0:23300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:2.0:1789518371.331393:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21952:x1876445617162496:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 1284us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.331403:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518371.334331:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617162752 00000100:00100000:3.0:1789518371.334343:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617162752 00000100:00100000:3.0:1789518371.334417:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:3.0:1789518371.334429:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21952:x1876445617162752:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518371.334454:0:23301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518371.334479:0:23301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd281 expref: -99 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.334953:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.334973:0:23301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd27a expref: 39 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.335041:0:23301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 4/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.335086:0:23301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd27a expref: 39 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.335103:0:23301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd27a expref: 39 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.335141:0:23301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627561856:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518371.335545:0:23301:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518371.338038:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617162880 00000100:00100000:1.0:1789518371.338050:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617162880 00010000:00010000:1.0:1789518371.338097:0:23285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd27a expref: 40 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.338141:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518371.338153:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+40:2342:x1876445617162880:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518371.338172:0:23285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518371.338180:0:23285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd27a expref: 40 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.338193:0:23285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd27a expref: 40 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.338232:0:23285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518371.338238:0:23285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.338257:0:23285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.338266:0:23285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 4/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.338289:0:23285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518371.338353:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+40:2342:x1876445617162880:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 201us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.338370:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00010000:00010000:2.0:1789518371.339113:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c783c7c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd27a expref: 39 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.339140:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627561856:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518371.339168:0:23301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.339179:0:23301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.339186:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518371.339210:0:23301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00010000:00010000:2.0:1789518371.339450:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c783c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd281 expref: 40 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.339464:0:23301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd281 expref: 39 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.339470:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.339473:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518371.339474:0:23301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc600, rc 0) 00000100:00100000:2.0:1789518371.339520:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+39:21952:x1876445617162752:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 5095us (5379us total) trans 17179869252 rc 0/0 00000100:00100000:2.0:1789518371.339540:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:2.0:1789518371.341673:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617163136 00000100:00100000:2.0:1789518371.341686:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617163136 00000100:00100000:2.0:1789518371.341759:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518371.341771:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+39:21952:x1876445617163136:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:2.0:1789518371.341791:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518371.341819:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c783b4f lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd22d expref: 39 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.341853:0:23287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.341859:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518371.341923:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21952:x1876445617163136:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 153us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.341931:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518371.343870:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617163264 00000100:00100000:2.0:1789518371.343882:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617163264 00000100:00100000:2.0:1789518371.343953:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:2.0:1789518371.343964:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21952:x1876445617163264:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:2.0:1789518371.344092:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.344112:0:23302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd250 expref: 7 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.344122:0:23302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.344180:0:23302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd250 expref: 7 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.344194:0:23302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd250 expref: 7 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.344222:0:23302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23302:1876445627561984:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518371.344334:0:23302:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518371.347415:0:23302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23302:1876445627561984:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518371.347762:0:23302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.347859:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617163392 00000100:00100000:1.0:1789518371.347870:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617163392 00010000:00010000:1.0:1789518371.347922:0:23285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd250 expref: 8 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.347966:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518371.347976:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff5624450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+8:2343:x1876445617163392:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518371.347995:0:23285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518371.348002:0:23285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd250 expref: 8 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.348015:0:23285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd250 expref: 8 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.348040:0:23285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c783bd4 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd250 expref: 8 pid: 23300 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.348059:0:23285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518371.348064:0:23285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.348074:0:23285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.348081:0:23285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.348141:0:23285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518371.348263:0:23302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.348274:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518371.348747:0:23302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].3, 136 off8600 00000100:00100000:3.0:1789518371.348831:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21952:x1876445617163264:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 4866us (5054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.348851:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:1.0:1789518371.349181:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff5624450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+7:2343:x1876445617163392:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1204us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.349191:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518371.351871:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617163520 00000100:00100000:1.0:1789518371.351885:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617163520 00000100:00100000:1.0:1789518371.351958:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:1.0:1789518371.351971:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+38:21952:x1876445617163520:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518371.351997:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518371.352029:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c9f lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd288 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.352108:0:24710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 2/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.352120:0:24710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c9f lrc: 4/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd288 expref: 39 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.352144:0:24710:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.352159:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c9f lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd288 expref: 39 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.352175:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518371.352178:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518371.352183:0:24710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c9f lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd288 expref: 39 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.352224:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44400, rc 0) 00000100:00100000:1.0:1789518371.352297:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+39:21952:x1876445617163520:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 328us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.352305:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1789518371.444295:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627562624:0@lo:400:kworker.0 00000100:00100000:3.0:1789518371.444346:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518371.444395:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789518371.444403:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c8a322e-2788-4faf-9195-ae294b8818bd:3282:1876445627562240:0@lo:400:kworker.0 00000100:00100000:3.0:1789518371.444451:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518371.444491:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffbb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627562752:0@lo:400:kworker.0 00000100:00100000:2.0:1789518371.444515:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627562496:0@lo:400:kworker.0 00000100:00100000:3.0:1789518371.444525:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518371.444562:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518371.444589:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518371.444598:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627562368:0@lo:400:kworker.0 00000100:00100000:2.0:1789518371.444655:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518371.444710:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627562624 00000100:00100000:2.0:1789518371.444718:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627562624 00000100:00080000:2.0:1789518371.444748:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518371.444785:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627562752 00000100:00100000:2.0:1789518371.444788:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627562752 00000100:00080000:2.0:1789518371.444802:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518371.444811:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627562496 00000100:00100000:2.0:1789518371.444815:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627562496 00000100:00100000:2.0:1789518371.444854:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518371.444867:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627562624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518371.444933:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627562624:12345-0@lo:400:kworker.0 Request processed in 69us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.444944:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518371.444971:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518371.444981:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627562496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518371.445040:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627562496:12345-0@lo:400:kworker.0 Request processed in 60us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.445048:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518371.445087:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627562496:0@lo:400:kworker.0 00000100:00100000:2.0:1789518371.445141:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789518371.445150:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627562752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518371.445164:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627562624:0@lo:400:kworker.0 00000100:00100000:3.0:1789518371.445189:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c8a322e-2788-4faf-9195-ae294b8818bd:3282:1876445627562240:0@lo:400:kworker.0 00000100:00100000:2.0:1789518371.445195:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627562752:12345-0@lo:400:kworker.0 Request processed in 45us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.445201:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518371.445206:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffbb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627562752:0@lo:400:kworker.0 00000100:00100000:2.0:1789518371.450288:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627562368:0@lo:400:kworker.0 00000100:00100000:3.0:1789518371.451636:0:23335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23335:1876445627562880:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518371.451871:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617163648 00000100:00100000:2.0:1789518371.451878:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617163648 00000100:00100000:2.0:1789518371.451963:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:2.0:1789518371.451972:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+39:21953:x1876445617163648:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518371.452018:0:23300:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518371.452103:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+39:21953:x1876445617163648:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 131us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.452120:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:2.0:1789518371.459684:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617163776 00000100:00100000:2.0:1789518371.459708:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617163776 00000100:00100000:2.0:1789518371.459773:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:2.0:1789518371.459783:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+39:21953:x1876445617163776:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789518371.459862:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.459880:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.459890:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.459906:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.459914:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.459921:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.459942:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.459950:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.459956:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518371.460005:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00000004:00200000:2.0:1789518371.460009:0:23302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518371.460027:0:23302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460038:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460043:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460050:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460056:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.460060:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460067:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460079:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:2.0:1789518371.460081:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.460086:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460091:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783ca6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460105:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460111:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460115:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460126:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.460129:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460134:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460146:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2d0f3245 (ffff99ffd8a16200) 00010000:00010000:2.0:1789518371.460148:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.460151:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460156:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783cad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460170:0:23302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460176:0:23302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460181:0:23302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460186:0:23302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.460188:0:23302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460193:0:23302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460210:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.460212:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.460215:0:23302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.460221:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783cb4 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.460299:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+39:21953:x1876445617163776:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 518us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.460307:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1789518371.463117:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.467768:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617164160 00000100:00100000:1.0:1789518371.467784:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617164160 00000100:00100000:1.0:1789518371.467888:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:1.0:1789518371.467901:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+40:21953:x1876445617164160:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518371.467948:0:24710:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518371.468113:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+40:21953:x1876445617164160:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 214us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.468130:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:2.0:1789518371.474852:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518371.480376:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.480562:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617164544 00000100:00100000:1.0:1789518371.480571:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617164544 00000100:00100000:2.0:1789518371.480704:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:2.0:1789518371.480715:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+41:21953:x1876445617164544:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518371.480737:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518371.480756:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783ce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd29d expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.480827:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783cec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.480855:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.480867:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518371.480899:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518371.480916:0:23302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518371.480939:0:23302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.480962:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783ce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd29d expref: 43 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.480978:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c783cec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd29d expref: 42 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.481262:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:2.0:1789518371.481266:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518371.481269:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16000, rc 0) 00000100:00100000:2.0:1789518371.481329:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+42:21953:x1876445617164544:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 615us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.481336:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:2.0:1789518371.483583:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518371.485812:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627563008:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518371.485836:0:23301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c783cf3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.486833:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518371.486930:0:23286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617164928 00000100:00100000:3.0:1789518371.486939:0:23286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617164928 00010000:00010000:3.0:1789518371.486969:0:23286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783baa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd242 expref: 7 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.487035:0:23286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518371.487044:0:23286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+7:2343:x1876445617164928:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518371.487059:0:23286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518371.487065:0:23286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783baa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd242 expref: 7 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.487078:0:23286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783baa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd242 expref: 7 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.487123:0:23286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c783baa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd242 expref: 7 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.487137:0:23286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdcc00) 00010000:00010000:3.0:1789518371.487142:0:23286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c783cf3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.487152:0:23286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c783cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.487159:0:23286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c783cf3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.487211:0:23286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518371.487254:0:23286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:248f1a9b-0266-4d36-9534-dab733fe88d3+6:2343:x1876445617164928:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 211us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.487261:0:23286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518371.489819:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.489917:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617165056 00000100:00100000:1.0:1789518371.489924:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617165056 00000100:00100000:1.0:1789518371.489964:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1789518371.489973:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+40:21953:x1876445617165056:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518371.489990:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518371.490010:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783d01 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2a4 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.490044:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783d08 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.490055:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783d08 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.490079:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783d08 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.490158:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783d01 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2a4 expref: 42 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.490169:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783d08 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2a4 expref: 41 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.490175:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518371.490177:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518371.490179:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45600, rc 0) 00000100:00100000:1.0:1789518371.490252:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+41:21953:x1876445617165056:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 281us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.490257:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:3.0:1789518371.493589:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518371.493824:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617165312 00000100:00100000:2.0:1789518371.493832:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617165312 00000100:00100000:2.0:1789518371.493933:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:2.0:1789518371.493943:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+41:21953:x1876445617165312:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518371.494023:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.494044:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.494056:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518371.494516:0:23300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].3, 88 off8432 00000004:00080000:2.0:1789518371.494528:0:23300:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425490913257ns, next at 426490910757ns, rc = 0 00000004:00010000:2.0:1789518371.494607:0:23300:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0627b8a reply state 0000000038cc4824 transno 17179869255 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.494694:0:23300:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518371.494789:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+43:21953:x1876445617165312:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 845us (1206us total) trans 17179869255 rc 0/0 00000100:00100000:2.0:1789518371.494797:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:3.0:1789518371.496809:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518371.496917:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617165440 00000100:00100000:2.0:1789518371.496926:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617165440 00000100:00100000:2.0:1789518371.496989:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:2.0:1789518371.496999:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+43:21953:x1876445617165440:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518371.497020:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518371.497036:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2ab expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.497085:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ab expref: 44 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.497109:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ab expref: 44 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.497139:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.497150:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.497157:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.497215:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:2.0:1789518371.497220:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518371.497225:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.497226:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00010000:00010000:1.0:1789518371.497233:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.497243:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.497326:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518371.497331:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518371.497336:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.497344:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c783d0f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.497353:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+44:21953:x1876445617165440:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 352us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.497361:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:3.0:1789518371.499196:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.499390:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617165568 00000100:00100000:1.0:1789518371.499400:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617165568 00000100:00100000:1.0:1789518371.499470:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1789518371.499481:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2342:x1876445617165568:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789518371.499656:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518371.500427:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2342:x1876445617165568:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 946us (1235us total) trans 17179869191 rc 0/0 00000100:00100000:1.0:1789518371.500437:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518371.502071:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518371.502139:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617165824 00000100:00100000:2.0:1789518371.502145:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617165824 00000100:00100000:2.0:1789518371.502217:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518371.502225:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+43:21953:x1876445617165824:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518371.502432:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+44:21953:x1876445617165824:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 206us (363us total) trans 17179869256 rc 0/0 00000100:00100000:2.0:1789518371.502440:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518371.504322:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.512688:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617166208 00000100:00100000:1.0:1789518371.512698:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617166208 00000100:00100000:1.0:1789518371.512754:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:1.0:1789518371.512764:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+44:21953:x1876445617166208:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518371.512783:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518371.512801:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783d1d lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2b2 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.513172:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d24 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.513187:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d24 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.513210:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d24 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518371.513242:0:24710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518371.513257:0:24710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d24 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.513276:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45e00/0x631fd8698c783d1d lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b2 expref: 46 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.513289:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d24 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b2 expref: 45 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.513295:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518371.513296:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518371.513299:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45c00, rc 0) 00000100:00100000:1.0:1789518371.513346:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+45:21953:x1876445617166208:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 585us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.513351:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:3.0:1789518371.516018:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518371.520584:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518371.521561:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617166592 00000100:00100000:3.0:1789518371.521572:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617166592 00000100:00100000:3.0:1789518371.521666:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:3.0:1789518371.521677:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+45:21953:x1876445617166592:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789518371.521800:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+45:21953:x1876445617166592:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 125us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.521820:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:3.0:1789518371.524579:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.524666:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617166720 00000100:00100000:1.0:1789518371.524675:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617166720 00000100:00100000:1.0:1789518371.524729:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518371.524739:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefadb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:21953:x1876445617166720:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518371.524754:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518371.524771:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2c0 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.524816:0:23985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007e5814d/0x631fd8698c783d2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b9 expref: 8 pid: 24439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.524825:0:23985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518371.524829:0:23985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518371.524835:0:23985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 8 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.524877:0:23985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007e5814d/0x631fd8698c783d2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b9 expref: 8 pid: 24439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.524890:0:23985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007e5814d/0x631fd8698c783d2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b9 expref: 8 pid: 24439 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.524903:0:23985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:23985:1876445627563136:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518371.524983:0:23985:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518371.527990:0:23985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:23985:1876445627563136:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518371.528025:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 8 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.528045:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44000, rc 0) 00000100:00100000:3.0:1789518371.528101:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefadb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+8:21953:x1876445617166720:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3363us (3530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.528110:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518371.528250:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617166848 00000100:00100000:1.0:1789518371.528258:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617166848 00010000:00010000:1.0:1789518371.528285:0:23285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007e5814d/0x631fd8698c783d2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b9 expref: 8 pid: 24439 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.528321:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518371.528332:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+8:2342:x1876445617166848:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518371.528345:0:23285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518371.528397:0:23285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007e5814d/0x631fd8698c783d2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b9 expref: 8 pid: 24439 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.528410:0:23285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007e5814d/0x631fd8698c783d2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b9 expref: 8 pid: 24439 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.528432:0:23285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e5814d/0x631fd8698c783d2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b9 expref: 8 pid: 24439 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.528447:0:23285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518371.528451:0:23285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518371.528459:0:23285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 7 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.528469:0:23285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 7 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.528514:0:23285:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 7 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.528527:0:23285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:23285:1876445627563264:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518371.528588:0:23285:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518371.533000:0:23991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617166976 00000100:00100000:3.0:1789518371.533009:0:23991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617166976 00002000:00100000:3.0:1789518371.533061:0:23991:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x63:0x0] (0->1023) req@ffff99ffff666680 x1876445617166976/t0(0) o4->b6d4c95d-bde2-47cb-a27f-4c74703c2487@192.168.206.51@tcp:17/0 lens 1512/0 e 0 to 0 dl 1789518382 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518371.533073:0:23991:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff666680 with x1876445617166976 ext(0->1023) 00002000:00010000:3.0:1789518371.533079:0:23991:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff666680 00000100:00100000:1.0:1789518371.533124:0:23285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:23285:1876445627563264:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518371.533147:0:23285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518371.533152:0:23991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518371.533166:0:23991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+8:2342:x1876445617166976:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518371.533196:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+8:2342:x1876445617166848:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4864us (5157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.533222:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1789518371.534106:0:23991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+9:2342:x1876445617166976:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 941us (1349us total) trans 17179869192 rc 0/0 00000100:00100000:3.0:1789518371.534114:0:23991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00002000:00100000:3.0:1789518371.534122:0:23991:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x63:0x0] (0->1023) req@ffff99ffff666680 x1876445617166976/t17179869192(0) o4->b6d4c95d-bde2-47cb-a27f-4c74703c2487@192.168.206.51@tcp:17/0 lens 1512/448 e 0 to 0 dl 1789518382 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518371.534142:0:23991:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff666680 with x1876445617166976 ext(0->1023) 00002000:00010000:3.0:1789518371.534146:0:23991:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffff666680 00000100:00100000:2.0:1789518371.539434:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617167104 00000100:00100000:2.0:1789518371.539444:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617167104 00000100:00100000:2.0:1789518371.539494:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:2.0:1789518371.539503:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+45:21953:x1876445617167104:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789518371.574743:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869254 is committed 00000001:00080000:1.0:1789518371.574768:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869256 is committed 00000004:00080000:1.0:1789518371.574773:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1789518371.574794:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789518371.574805:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff7a2c000 refcount 2 committed 0 result 0 batchid 12884902054 00000020:00080000:1.0:1789518371.574809:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fffdc2e600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7a2c780 00000020:00080000:1.0:1789518371.574811:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fffdc2e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffef908c00 00000001:00080000:1.0:1789518371.574849:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869244 is committed 00000020:00080000:1.0:1789518371.574875:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 12884902053 batchid updated 00000020:00080000:1.0:1789518371.574894:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12884902054 committed batchid 12884902053 00000100:00100000:3.0:1789518371.574970:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21953:x1876445617167104:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 35462us (35612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.574981:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000020:00080000:1.0:1789518371.575081:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902053 00000100:00100000:1.0:1789518371.575475:0:23984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627563392 00000100:00100000:1.0:1789518371.575482:0:23984:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627563392 00000100:00100000:2.0:1789518371.575483:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627563520 00000100:00100000:2.0:1789518371.575491:0:24439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627563520 00000100:00100000:1.0:1789518371.575533:0:23984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518371.575542:0:23984:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627563392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789518371.575567:0:23984:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:98 count 1 00002000:00010000:1.0:1789518371.575608:0:23984:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x62:0x0] initial LVB size: 1024, mtime: 0x6aa9e223, atime: 0x6aa9e223, ctime: 0x6aa9e223, blocks: 0x1 00010000:00010000:1.0:1789518371.575638:0:23984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.575653:0:23984:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1789518371.575657:0:23984:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518371.575664:0:23984:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.575686:0:24439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518371.575700:0:24439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627563520:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789518371.575705:0:23984:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.575722:0:23984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.575729:0:23984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.575746:0:23984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789518371.575865:0:24439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x63:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1789518371.575869:0:24439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x63:0x0] updating lvb mtime from disk: 0 -> 1789518372 00002000:00010000:2.0:1789518371.575872:0:24439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x63:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518371.575874:0:24439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x63:0x0] updating lvb ctime from disk: 1789518372 -> 1789518372 00002000:00010000:2.0:1789518371.575877:0:24439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x63:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518371.575918:0:24439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627563520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (680us total) trans 17179869193 rc 0/0 00000100:00100000:2.0:1789518371.575925:0:24439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:2.0:1789518371.575967:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffffe5aa00/2, rc 0, transno 17179869193 00000100:00100000:2.0:1789518371.575974:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627563520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518371.576248:0:23984:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627563392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 707us (1093us total) trans 17179869189 rc 0/0 00000100:00100000:1.0:1789518371.576255:0:23984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789518371.576275:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518371.576281:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.576290:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518371.576294:0:23288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.576304:0:23288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.576320:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.576336:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c23681fb/0x631fd8698c783d39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.576353:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518371.576368:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518371.576370:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789518371.576666:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffd846df80/2, rc 0, transno 17179869189 00000100:00100000:2.0:1789518371.576673:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627563392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518371.580863:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000001:00080000:3.0:1789518371.603351:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869191 is committed 00000001:00080000:3.0:1789518371.603362:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869193 is committed 00000001:00080000:3.0:1789518371.603368:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869192 is committed 00000100:00100000:3.0:1789518371.605893:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518371.606106:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617167488 00000100:00100000:2.0:1789518371.606115:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617167488 00000100:00100000:2.0:1789518371.606187:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:2.0:1789518371.606197:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21953:x1876445617167488:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518371.606245:0:23300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518371.606282:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d24 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2b2 expref: 17 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.606300:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:2.0:1789518371.606305:0:23300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518371.606343:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.607250:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.608082:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518371.608331:0:23300:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e4db6aa reply state 0000000030dbe9e9 transno 17179869257 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.608341:0:23300:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518371.608878:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:21953:x1876445617167488:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 2677us (2988us total) trans 17179869257 rc 0/0 00000100:00100000:2.0:1789518371.608887:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00010000:00010000:2.0:1789518371.610753:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.610769:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.610776:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.610782:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.610787:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.610794:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.610808:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:2.0:1789518371.610823:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.610829:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.610835:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c783d40 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.611231:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.615963:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.618916:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:1.0:1789518371.618927:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:21953:x1876445617167872:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789518371.618997:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.619014:0:24710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783d08 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2a4 expref: 17 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.619025:0:24710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 4/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.619060:0:24710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783d08 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2a4 expref: 17 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.619074:0:24710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45600/0x631fd8698c783d08 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2a4 expref: 17 pid: 24710 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.619088:0:24710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24710:1876445627563648:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518371.619220:0:24710:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518371.623679:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.623796:0:24710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24710:1876445627563648:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518371.623821:0:24710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.625830:0:24710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.625851:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.625880:0:24710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.625888:0:24710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.625894:0:24710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.625900:0:24710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518371.625905:0:24710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.625913:0:24710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.625926:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518371.625929:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789518371.625933:0:24710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.625939:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c783d47 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.625994:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21953:x1876445617167872:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 7068us (10038us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789518371.626002:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:2.0:1789518371.631185:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.631331:0:23984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617168128 00000100:00100000:1.0:1789518371.631342:0:23984:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617168128 00000100:00100000:1.0:1789518371.631396:0:23984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1789518371.631407:0:23984:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:2342:x1876445617168128:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789518371.631447:0:23984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.631466:0:23984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 7 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.631475:0:23984:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518371.631479:0:23984:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518371.631484:0:23984:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.631516:0:23984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 7 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.631531:0:23984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 7 pid: 23985 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.631546:0:23984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:23984:1876445627563776:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518371.631664:0:23984:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518371.637419:0:23984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:23984:1876445627563776:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518371.637447:0:23984:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.641461:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.641803:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617168256 00000100:00100000:1.0:1789518371.641812:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617168256 00010000:00010000:1.0:1789518371.641861:0:23285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 8 pid: 23985 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.641939:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:1.0:1789518371.641950:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+8:2343:x1876445617168256:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518371.641964:0:23285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518371.641986:0:23285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 8 pid: 23985 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.642001:0:23285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 8 pid: 23985 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.642024:0:23285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c783d32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c0 expref: 8 pid: 23985 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.642051:0:23285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518371.642056:0:23285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518371.642062:0:23285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.642073:0:23285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.642105:0:23285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518371.642178:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:2343:x1876445617168256:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 229us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.642186:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00010000:00010000:2.0:1789518371.642371:0:23984:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.642381:0:23984:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.642411:0:23984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.642420:0:23984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.642427:0:23984:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.642446:0:23984:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518371.642450:0:23984:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.642459:0:23984:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.642471:0:23984:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.642477:0:23984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000283a0eae/0x631fd8698c783d4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.642537:0:23984:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2342:x1876445617168128:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 11131us (11360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.642545:0:23984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1789518371.648691:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.652322:0:23286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617168640 00000100:00100000:1.0:1789518371.652333:0:23286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617168640 00000100:00100000:3.0:1789518371.652361:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627563904:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518371.652370:0:23286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783c59 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd273 expref: 17 pid: 23302 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.652416:0:23286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518371.652425:0:23286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:2343:x1876445617168640:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518371.652438:0:23286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518371.652443:0:23301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.652445:0:23286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783c59 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd273 expref: 17 pid: 23302 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.652470:0:23286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783c59 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd273 expref: 17 pid: 23302 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.652491:0:23286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783c59 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd273 expref: 17 pid: 23302 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.652507:0:23286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518371.652514:0:23286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c9f lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd288 expref: 16 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.652522:0:23286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.652529:0:23286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.652549:0:23286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.652577:0:23286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518371.652681:0:23286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:2343:x1876445617168640:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 248us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.652694:0:23286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00010000:00010000:3.0:1789518371.652832:0:23301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.652850:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.653163:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.653177:0:23301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ab expref: 16 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.653197:0:23301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.653225:0:23301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ab expref: 16 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.653239:0:23301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ab expref: 16 pid: 23302 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.653253:0:23301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627564032:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518371.653314:0:23301:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518371.656547:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627564032:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518371.656576:0:23301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.656817:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518371.657041:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617168768 00000100:00100000:1.0:1789518371.657049:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617168768 00010000:00010000:1.0:1789518371.657083:0:23285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ab expref: 17 pid: 23302 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.657162:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1789518371.657173:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:2343:x1876445617168768:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518371.657187:0:23285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518371.657194:0:23285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ab expref: 17 pid: 23302 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.657207:0:23285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ab expref: 17 pid: 23302 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.657226:0:23285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d16 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ab expref: 17 pid: 23302 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.657241:0:23285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:1.0:1789518371.657247:0:23285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.657274:0:23285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.657281:0:23285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.657310:0:23285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518371.657359:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:2343:x1876445617168768:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 187us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.657379:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00010000:00010000:3.0:1789518371.657442:0:23301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.657450:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518371.657651:0:23301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869258 00000001:00080000:3.0:1789518371.657803:0:23301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869259 00000001:00080000:3.0:1789518371.657861:0:23301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869260 00000100:00100000:3.0:1789518371.657937:0:23301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23301:1876445627564160:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518371.657981:0:23301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518371.658018:0:23301:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff78019c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518371.658511:0:23301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869193 gen 2 00000004:00080000:3.0:1789518371.658516:0:23301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffffe5aa00, transno 17179869193 00000100:00100000:3.0:1789518371.658536:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23301:1876445627564160:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789518371.658996:0:23301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869261 00000100:00100000:3.0:1789518371.659053:0:23301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23301:1876445627564288:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518371.659083:0:23301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518371.659104:0:23301:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518371.659117:0:23306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627564288 00000100:00100000:3.0:1789518371.659121:0:23306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627564288 00000100:00100000:3.0:1789518371.659148:0:23306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518371.659155:0:23306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:23301:x1876445627564288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518371.659309:0:23306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23301:x1876445627564288:12345-0@lo:1000:mdt00_001.0 Request processed in 153us (224us total) trans 17179869195 rc 0/0 00000100:00100000:3.0:1789518371.659316:0:23306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518371.659347:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23301:1876445627564288:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789518371.661016:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661032:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661040:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661047:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.661052:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661059:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661085:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:3.0:1789518371.661088:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518371.661093:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661099:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d5c lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661130:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661136:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661142:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661147:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.661150:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661156:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661179:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.661181:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518371.661189:0:23301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c9f lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd288 expref: 19 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661200:0:23301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c9f lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd288 expref: 19 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661216:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c9f lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd288 expref: 19 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.661250:0:23301:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44400/0x631fd8698c783c9f lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd288 expref: 19 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.661264:0:23301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627564416:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518371.661392:0:23301:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518371.666771:0:23301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23301:1876445627564416:192.168.206.51@tcp:105: 00010000:00010000:3.0:1789518371.666808:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666817:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783c98 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666870:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666888:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666901:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666914:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666921:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666948:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666954:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.666959:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666967:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666980:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.666983:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518371.666987:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.666994:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d63 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.667006:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.667012:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.667018:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.667022:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518371.667025:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.667041:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.667051:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518371.667054:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518371.667057:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.667063:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c200/0x631fd8698c783d55 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518371.667388:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:21953:x1876445617168512:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 18068us (18704us total) trans 17179869262 rc 0/0 00000100:00100000:3.0:1789518371.668311:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000020:00080000:3.0:1789518371.668321:0:23301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789518371.669200:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617168896 00000100:00100000:3.0:1789518371.669213:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617168896 00000100:00100000:3.0:1789518371.669342:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1789518371.669355:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:21952:x1876445617168896:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:3.0:1789518371.669527:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:21952:x1876445617168896:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 176us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.669535:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000040:00080000:1.0:1789518371.669653:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:1.0:1789518371.669662:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518371.669733:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 4 00000040:00080000:1.0:1789518371.669755:0:23335:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1789518371.669759:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518371.669792:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 4 count 4 00000040:00080000:1.0:1789518371.669797:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000100:00100000:2.0:1789518371.670386:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518371.670508:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617169152 00000100:00100000:3.0:1789518371.670516:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617169152 00000100:00100000:3.0:1789518371.670596:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518371.670606:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+19:21953:x1876445617169152:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789518371.671815:0:23304:0:(mdd_object.c:4014:mdd_close()) Object [0x200001b71:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789518371.672069:0:23304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869263 00010000:00010000:3.0:1789518371.672123:0:23304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.672142:0:23304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.672156:0:23304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.672166:0:23304:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.672173:0:23304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.672179:0:23304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.672216:0:23304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518371.672339:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+21:21953:x1876445617169152:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1729us (1951us total) trans 17179869264 rc 0/0 00000100:00100000:3.0:1789518371.672349:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000020:00080000:3.0:1789518371.672354:0:23304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789518371.672439:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518371.672552:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617169408 00000100:00100000:3.0:1789518371.672559:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617169408 00000100:00100000:3.0:1789518371.672640:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:3.0:1789518371.672651:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+21:21952:x1876445617169408:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:3.0:1789518371.672953:0:23302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].4, 136 off8736 00000100:00100000:3.0:1789518371.673013:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+21:21952:x1876445617169408:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 364us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.673029:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00010000:00010000:1.0:1789518371.673415:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518371.673425:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.673435:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518371.673440:0:23289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.673449:0:23289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.673465:0:23289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff99ffe6f98c00) 00010000:00010000:1.0:1789518371.673476:0:23289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518371.673482:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.673489:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c783d6a lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.673512:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518371.673514:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518371.673516:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518371.675310:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518371.677006:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617169664 00000100:00100000:2.0:1789518371.677023:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617169664 00000100:00100000:2.0:1789518371.677113:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518371.677124:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+21:21952:x1876445617169664:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:2.0:1789518371.677393:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+22:21952:x1876445617169664:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 271us (2096us total) trans 17179869265 rc 0/0 00000100:00100000:2.0:1789518371.677415:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518371.696813:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518371.696922:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617169792 00000100:00100000:3.0:1789518371.696935:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617169792 00000100:00100000:3.0:1789518371.697014:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:3.0:1789518371.697026:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+22:21955:x1876445617169792:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518371.697910:0:23300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518371.697947:0:23300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783d71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2c7 expref: -99 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.698744:0:23300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.698765:0:23300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.698781:0:23300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518371.698846:0:23300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518371.698852:0:23300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518371.698879:0:23300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.698913:0:23300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783d71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c7 expref: 24 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.698938:0:23300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c783d78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2c7 expref: 23 pid: 23300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518371.698987:0:23300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98400) 00010000:00010000:3.0:1789518371.698990:0:23300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518371.698995:0:23300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bcc00, rc 0) 00000100:00100000:3.0:1789518371.699087:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+23:21955:x1876445617169792:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2062us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518371.699097:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:2.0:1789518371.706779:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617169920 00000100:00100000:2.0:1789518371.706794:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617169920 00000100:00100000:2.0:1789518371.706879:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:2.0:1789518371.706893:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+23:21955:x1876445617169920:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518371.706924:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518371.706956:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2ce expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.707043:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.707062:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.707076:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.707231:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.707239:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.707246:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.708083:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.708107:0:24710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd281 expref: 24 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.708117:0:24710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 4/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.708158:0:24710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd281 expref: 24 pid: 23301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.708173:0:24710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd281 expref: 24 pid: 23301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.708189:0:24710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24710:1876445627564544:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518371.708360:0:24710:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518371.711664:0:23286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617170048 00000100:00100000:1.0:1789518371.711676:0:23286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617170048 00010000:00010000:1.0:1789518371.711726:0:23286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 5/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd281 expref: 25 pid: 23301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518371.711776:0:23286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1789518371.711789:0:23286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff5624050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:2342:x1876445617170048:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518371.711808:0:23286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518371.711817:0:23286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 5/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd281 expref: 25 pid: 23301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.711835:0:23286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd281 expref: 25 pid: 23301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.711875:0:23286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518371.711881:0:23286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.711893:0:23286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.711923:0:23286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 4/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518371.711947:0:23286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518371.712007:0:23286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff5624050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:2342:x1876445617170048:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 221us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518371.712018:0:23286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00010000:00010000:2.0:1789518371.712171:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c783c8a lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd281 expref: 24 pid: 23301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518371.712192:0:24710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24710:1876445627564544:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518371.712353:0:24710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712364:0:24710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712371:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518371.712488:0:24710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00000004:00200000:2.0:1789518371.712501:0:24710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518371.712529:0:24710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712546:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712557:0:24710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712565:0:24710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712573:0:24710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712689:0:24710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.712695:0:24710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712704:0:24710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712716:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98400) 00010000:00010000:2.0:1789518371.712719:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.712723:0:24710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712730:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c783d86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712743:0:24710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712761:0:24710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712768:0:24710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712773:0:24710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518371.712777:0:24710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712783:0:24710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712792:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff99ffd8a16300) 00010000:00010000:2.0:1789518371.712795:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518371.712798:0:24710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712805:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c783d8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712862:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c783d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ce expref: 24 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712877:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c783d94 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ce expref: 23 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518371.712884:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:2.0:1789518371.712887:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518371.712895:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16e00, rc 0) 00000100:00100000:2.0:1789518371.712946:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+23:21955:x1876445617169920:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 6057us (6249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518371.712954:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00010000:00010000:1.0:1789518372.083712:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518372.199676:0:25762:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:1.0:1789518372.199685:0:25762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518372.199745:0:25762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 4 00000040:00080000:1.0:1789518372.199765:0:25762:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1789518372.199768:0:25762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518372.199816:0:25762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:1.0:1789518372.199820:0:25762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000040:00080000:1.0:1789518372.722860:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:1.0:1789518372.722870:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518372.722904:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 4 00000040:00080000:1.0:1789518372.722930:0:23335:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1789518372.722933:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518372.722962:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:1.0:1789518372.722966:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000100:00100000:1.0:1789518372.723081:0:23335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23335:1876445627564672:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518372.723198:0:23335:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518372.725143:0:23335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23335:1876445627564672:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518372.726530:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617170176 00000100:00100000:3.0:1789518372.726538:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617170176 00000100:00100000:3.0:1789518372.726694:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1789518372.726704:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+23:21967:x1876445617170176:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518372.726730:0:23301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200001b71:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518372.726822:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+23:21967:x1876445617170176:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 119us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518372.726829:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00080000:2.0:1789518372.727761:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518372.731397:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617170432 00000100:00100000:3.0:1789518372.731407:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617170432 00000100:00100000:3.0:1789518372.731468:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1789518372.731477:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+23:21967:x1876445617170432:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518372.731495:0:23302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518372.731515:0:23302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783d9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2d5 expref: -99 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518372.731606:0:23302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783da2 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518372.731660:0:23302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783da2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518372.731672:0:23302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783da2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518372.731685:0:23302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1789518372.731804:0:23302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783d9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2d5 expref: 26 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518372.731824:0:23302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783da2 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2d5 expref: 25 pid: 23302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518372.731843:0:23302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518372.731846:0:23302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518372.731850:0:23302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bde00, rc 0) 00000100:00100000:3.0:1789518372.731905:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:21967:x1876445617170432:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 429us (607us total) trans 17179869266 rc 0/0 00000100:00100000:3.0:1789518372.731913:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:1.0:1789518372.735730:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518372.738030:0:23301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617170816 00000100:00100000:1.0:1789518372.738050:0:23301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617170816 00000100:00100000:1.0:1789518372.738097:0:23301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:1.0:1789518372.738107:0:23301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+24:21967:x1876445617170816:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518372.738177:0:23301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518372.738193:0:23301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518372.738203:0:23301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518372.738379:0:23301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518372.738388:0:23301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518372.738395:0:23301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518372.738401:0:23301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518372.738405:0:23301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518372.738413:0:23301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518372.738424:0:23301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:1.0:1789518372.738427:0:23301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518372.738432:0:23301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518372.738450:0:23301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44200/0x631fd8698c783db0 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518372.738598:0:23301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:21967:x1876445617170816:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 491us (770us total) trans 17179869267 rc 0/0 00000100:00100000:1.0:1789518372.738606:0:23301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000040:00080000:3.0:1789518372.738931:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:3.0:1789518372.738936:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518372.738972:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 4 00000040:00080000:3.0:1789518372.739186:0:23335:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1789518372.739189:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518372.739216:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:3.0:1789518372.739673:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000100:00100000:1.0:1789518372.741056:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518372.741230:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617171072 00000100:00100000:2.0:1789518372.741239:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617171072 00000100:00100000:2.0:1789518372.741290:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1789518372.741299:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+25:21967:x1876445617171072:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518372.741557:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+26:21967:x1876445617171072:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 258us (507us total) trans 17179869268 rc 0/0 00000100:00100000:2.0:1789518372.741564:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00010000:00010000:1.0:1789518373.106762:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518373.264050:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617171584 00000100:00100000:2.0:1789518373.264060:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617171584 00000100:00100000:2.0:1789518373.264118:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617171840 00000100:00100000:2.0:1789518373.264122:0:23985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617171840 00000100:00100000:1.0:1789518373.264135:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617171328 00000100:00100000:1.0:1789518373.264139:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617171328 00000100:00100000:1.0:1789518373.264179:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617171712 00000100:00100000:1.0:1789518373.264182:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617171712 00000100:00100000:3.0:1789518373.265498:0:23294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617171200 00000100:00100000:3.0:1789518373.265511:0:23294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617171200 00000100:00100000:3.0:1789518373.265595:0:23294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1789518373.265608:0:23294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed6f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+13:2344:x1876445617171200:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518373.265740:0:23294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed6f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83b7d112-ac86-4580-aba7-3f82c95a71b7+13:2344:x1876445617171200:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 134us (3146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518373.265749:0:23294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:2.0:1789518373.265879:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1789518373.265891:0:23985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2345:x1876445617171584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518373.265925:0:23985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2345:x1876445617171584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518373.265932:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1789518373.266737:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518373.266747:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2344:x1876445617171712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518373.267030:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2344:x1876445617171712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 283us (3059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518373.267038:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000040:00080000:2.0:1789518373.724805:0:25813:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:2.0:1789518373.724814:0:25813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518373.724954:0:25813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 7 count 4 00000040:00080000:2.0:1789518373.724972:0:25813:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1789518373.724975:0:25813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518373.725017:0:25813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:2.0:1789518373.725101:0:25813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 3 00000100:00100000:1.0:1789518373.860330:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518373.860395:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617172224 00000100:00100000:3.0:1789518373.860406:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617172224 00000100:00100000:3.0:1789518373.860466:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:3.0:1789518373.860476:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+26:21990:x1876445617172224:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:3.0:1789518373.860496:0:24710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518373.860515:0:24710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783db7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2dc expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518373.860605:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783dbe lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518373.860639:0:24710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783dbe lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518373.860650:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783dbe lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518373.860846:0:24710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1789518373.860980:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c783db7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2dc expref: 29 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518373.860997:0:24710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c783dbe lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2dc expref: 28 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518373.861032:0:24710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff99ffe6f98200) 00010000:00010000:3.0:1789518373.861035:0:24710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518373.861039:0:24710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bde00, rc 0) 00000100:00100000:3.0:1789518373.861101:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+28:21990:x1876445617172224:12345-192.168.206.51@tcp:101:dd.500 Request processed in 626us (778us total) trans 17179869269 rc 0/0 00000100:00100000:3.0:1789518373.861108:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:2.0:1789518373.864641:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617172352 00000100:00100000:2.0:1789518373.864651:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617172352 00000100:00100000:2.0:1789518373.864735:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518373.864755:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:21990:x1876445617172352:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:2.0:1789518373.864777:0:23983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518373.864798:0:23983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c783dcc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2e3 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518373.864838:0:23983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63:0x0] initial LVB size: 1024, mtime: 0x6aa9e223, atime: 0x6aa9e223, ctime: 0x6aa9e223, blocks: 0xb 00010000:00010000:2.0:1789518373.864861:0:23983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1789518373.864866:0:23983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518373.864876:0:23983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c783dcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2e3 expref: 7 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518373.864894:0:23983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c783dcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2e3 expref: 7 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518373.864906:0:23983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16000, rc 0) 00000100:00100000:2.0:1789518373.864963:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:21990:x1876445617172352:12345-192.168.206.51@tcp:101:dd.500 Request processed in 220us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518373.864970:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1789518373.868648:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518373.868929:0:23989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617172480 00000100:00100000:2.0:1789518373.868939:0:23989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617172480 00002000:00100000:2.0:1789518373.868990:0:23989:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x63:0x0] (0->4095) req@ffff99fec1b9c700 x1876445617172480/t0(0) o3->b6d4c95d-bde2-47cb-a27f-4c74703c2487@192.168.206.51@tcp:19/0 lens 488/0 e 0 to 0 dl 1789518384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518373.869002:0:23989:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9c700 with x1876445617172480 ext(0->4095) 00002000:00010000:2.0:1789518373.869022:0:23989:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9c700 00000100:00100000:2.0:1789518373.869077:0:23989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518373.869088:0:23989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:2345:x1876445617172480:12345-192.168.206.51@tcp:3:dd.500 00000100:00100000:2.0:1789518373.869326:0:23989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+7:2345:x1876445617172480:12345-192.168.206.51@tcp:3:dd.500 Request processed in 239us (719us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789518373.869335:0:23989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:2.0:1789518373.869342:0:23989:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x63:0x0] (0->4095) req@ffff99fec1b9c700 x1876445617172480/t0(0) o3->b6d4c95d-bde2-47cb-a27f-4c74703c2487@192.168.206.51@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789518384 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518373.869350:0:23989:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9c700 with x1876445617172480 ext(0->4095) 00002000:00010000:2.0:1789518373.869354:0:23989:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9c700 00000100:00100000:3.0:1789518374.003056:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627564800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518374.003133:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518374.003791:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627564800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789518374.005305:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789518374.130819:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789518375.059465:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869188 is committed 00000001:00080000:3.0:1789518375.059485:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869187 is committed 00000001:00080000:3.0:1789518375.059495:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869189 is committed 00010000:00010000:1.0:1789518375.154834:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518376.179116:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518376.564040:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627564928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518376.564115:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518376.564193:0:23987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627564928 00000100:00100000:2.0:1789518376.564200:0:23987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627564928 00000100:00100000:2.0:1789518376.564260:0:23987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518376.564271:0:23987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627564928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518376.564303:0:23987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789518376.564348:0:23987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627564928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518376.564355:0:23987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789518376.564382:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518376.564420:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627564928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518376.565308:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627565312:0@lo:400:kworker.0 00000100:00100000:2.0:1789518376.565351:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518376.565388:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518376.565394:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627565440:0@lo:400:kworker.0 00000100:00100000:1.0:1789518376.565444:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627565568 00000100:00100000:1.0:1789518376.565448:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627565568 00000100:00100000:1.0:1789518376.565475:0:23302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627565312 00000100:00100000:1.0:1789518376.565477:0:23302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627565312 00000100:00100000:1.0:1789518376.565500:0:23302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518376.565510:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518376.565512:0:23302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627565568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518376.565516:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627565312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518376.565548:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518376.565564:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627565312:12345-0@lo:400:kworker.0 Request processed in 47us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518376.565572:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789518376.565584:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627565312:0@lo:400:kworker.0 00000100:00100000:3.0:1789518376.565587:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627565440 00000100:00100000:3.0:1789518376.565592:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627565440 00000100:00080000:2.0:1789518376.565639:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518376.565645:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518376.565653:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518376.565661:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627565440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518376.565661:0:23301:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789518376.565700:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627565440:12345-0@lo:400:kworker.0 Request processed in 40us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518376.565706:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789518376.565722:0:23301:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789518376.565905:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627565440:0@lo:400:kworker.0 00000100:00100000:1.0:1789518376.566523:0:23302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627565568:12345-0@lo:400:kworker.0 Request processed in 1009us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518376.566531:0:23302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000001:00080000:1.0:1789518376.596859:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869267 is committed 00000020:00080000:1.0:1789518376.596871:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 12884902054 batchid updated 00000001:00080000:1.0:1789518376.596880:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869268 is committed 00000001:00080000:1.0:1789518376.596888:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869269 is committed 00000020:00080000:3.0:1789518376.596893:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902054 00000020:00080000:1.0:1789518376.596900:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff78019c0 refcount 2 committed 0 result 0 batchid 12884902055 00000020:00080000:1.0:1789518376.596905:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff79e5b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7801840 00000020:00080000:3.0:1789518376.596908:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902054 00000020:00080000:1.0:1789518376.596908:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff79e5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec2840000 00000020:00080000:3.0:1789518376.596937:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12884902055 committed batchid 12884902054 00000020:00080000:3.0:1789518376.597094:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902054 00000100:00100000:1.0:1789518376.779832:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518376.779905:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617172608 00000100:00100000:3.0:1789518376.779914:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617172608 00000100:00100000:3.0:1789518376.779999:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:3.0:1789518376.780008:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+15:21882:x1876445617172608:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789518376.780131:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+15:21882:x1876445617172608:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 123us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518376.780138:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00080000:2.0:1789518376.780748:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518376.785446:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518376.785659:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617172864 00000100:00100000:1.0:1789518376.785670:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617172864 00000100:00100000:1.0:1789518376.785733:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1789518376.785743:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+15:21882:x1876445617172864:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518376.786004:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:21882:x1876445617172864:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 261us (566us total) trans 17179869270 rc 0/0 00000100:00100000:1.0:1789518376.786011:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000001:00080000:3.0:1789518377.117210:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869194 is committed 00000001:00080000:3.0:1789518377.117292:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869195 is committed 00010000:00010000:1.0:1789518377.202776:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518377.919430:0:26014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2a: Test multi open when creating ===== 20:26:17 (1789518377) 00010000:00010000:1.0:1789518378.227110:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518378.381577:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518378.381647:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518378.381682:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518378.381711:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518378.381713:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617173248 00000100:00100000:2.0:1789518378.381723:0:24439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617173248 00000100:00100000:3.0:1789518378.381745:0:25959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617173504 00000100:00100000:3.0:1789518378.381753:0:25959:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617173504 00000100:00100000:1.0:1789518378.381766:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518378.381800:0:25959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617173120 00000100:00100000:1.0:1789518378.381814:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617173376 00000100:00100000:3.0:1789518378.381817:0:25959:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617173120 00000100:00100000:1.0:1789518378.381820:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617173376 00000100:00100000:2.0:1789518378.381825:0:24439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518378.381840:0:24439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2344:x1876445617173248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518378.381855:0:25959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1789518378.381860:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518378.381870:0:25959:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2344:x1876445617173504:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518378.381873:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2344:x1876445617173376:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518378.381916:0:24439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2344:x1876445617173248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518378.381917:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2344:x1876445617173376:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518378.381923:0:25959:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2344:x1876445617173504:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 54us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518378.381936:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518378.381939:0:25959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1789518378.381948:0:24439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1789518378.381965:0:25959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518378.381976:0:25959:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:2344:x1876445617173120:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:2.0:1789518378.381977:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518378.381984:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518378.381986:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518378.382011:0:25959:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:2344:x1876445617173120:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518378.382030:0:25959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1789518378.395858:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518378.395891:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518378.395922:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617173632 00000100:00100000:1.0:1789518378.395929:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617173632 00000100:00100000:1.0:1789518378.395975:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617173760 00000100:00100000:1.0:1789518378.395979:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617173760 00000100:00100000:1.0:1789518378.396002:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518378.396011:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2341:x1876445617173632:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:1.0:1789518378.396036:0:23983:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7836e1 00000100:00080000:1.0:1789518378.396049:0:23983:0:(import.c:65:import_set_state_nolock()) ffff99ffdf98e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518378.396080:0:23983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869189 00000100:00100000:1.0:1789518378.396313:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+2:2341:x1876445617173632:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 301us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518378.396321:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518378.396336:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518378.396342:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2341:x1876445617173760:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:1.0:1789518378.396353:0:23983:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7836e8 00000100:00080000:1.0:1789518378.396359:0:23983:0:(import.c:65:import_set_state_nolock()) ffff99ffed5a1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518378.396390:0:23983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869195 00000100:00100000:1.0:1789518378.396526:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:248f1a9b-0266-4d36-9534-dab733fe88d3+2:2341:x1876445617173760:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 184us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518378.396533:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00010000:00010000:1.0:1789518378.396550:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518378.396563:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518378.396566:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789518378.396774:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518379.123683:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789518379.251255:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518379.293771:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000040:00080000:3.0:1789518379.891130:0:23335:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:3.0:1789518379.891140:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518379.891781:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 6 count 1 00000040:00080000:3.0:1789518379.891818:0:23335:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 3, last_idx 4 00000040:00080000:3.0:1789518379.891877:0:23335:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518379.891923:0:23335:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1789518379.891926:0:23335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518379.891954:0:23335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:3.0:1789518379.891958:0:23335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1789518379.932842:0:23304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617174144 00000100:00100000:3.0:1789518379.932851:0:23304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617174144 00000100:00100000:3.0:1789518379.932898:0:23304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518379.932907:0:23304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+16:22646:x1876445617174144:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:3.0:1789518379.933249:0:23304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:22646:x1876445617174144:12345-192.168.206.51@tcp:35:umount.0 Request processed in 341us (531us total) trans 17179869271 rc 0/0 00000100:00100000:3.0:1789518379.933257:0:23304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1789518379.936922:0:23303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617174400 00000100:00100000:1.0:1789518379.937005:0:23303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617174400 00000100:00100000:1.0:1789518379.937124:0:23303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518379.937138:0:23303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:22646:x1876445617174400:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:1.0:1789518379.937482:0:23303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:22646:x1876445617174400:12345-192.168.206.51@tcp:35:umount.0 Request processed in 346us (879us total) trans 17179869272 rc 0/0 00000100:00100000:1.0:1789518379.937492:0:23303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:2.0:1789518379.942546:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518379.942598:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518379.942662:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518379.942702:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617175040 00000100:00100000:1.0:1789518379.942718:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617175040 00000100:00100000:1.0:1789518379.942820:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1789518379.942834:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+6:2341:x1876445617175040:12345-192.168.206.51@tcp:9:umount.0 00000100:00100000:2.0:1789518379.942845:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000020:00000080:1.0:1789518379.942892:0:23983:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7835d7 00000020:00010000:1.0:1789518379.942904:0:23983:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fffbb74800: total 0 00000100:00080000:1.0:1789518379.942910:0:23983:0:(import.c:65:import_set_state_nolock()) ffff99fffbb73000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518379.942967:0:23983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869195 00000100:00100000:1.0:1789518379.943244:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d4c95d-bde2-47cb-a27f-4c74703c2487+4:2341:x1876445617175040:12345-192.168.206.51@tcp:9:umount.0 Request processed in 413us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518379.943253:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000020:00010000:1.0:1789518379.944084:0:23288:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fffbb74800: total 0 00010000:00010000:1.0:1789518379.944091:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518379.944124:0:23288:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fffbb74800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789518379.944303:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a882a1/0x631fd8698c783dcc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2e3 expref: 3 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518379.944336:0:23288:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fffbb74800, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1789518379.944683:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617174528 00000100:00100000:3.0:1789518379.944696:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617174528 00000100:00100000:3.0:1789518379.944744:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617174784 00000100:00100000:3.0:1789518379.944748:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617174784 00000100:00100000:3.0:1789518379.944762:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617174656 00000100:00100000:3.0:1789518379.944764:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617174656 00000100:00100000:3.0:1789518379.944783:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518379.944791:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+15:2345:x1876445617174528:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518379.944820:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518379.944841:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7835b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd03c expref: 15 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518379.944861:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518379.944864:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518379.944866:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518379.944875:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518379.944949:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+14:2345:x1876445617174528:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 157us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518379.944957:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518379.944978:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518379.944985:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+13:2345:x1876445617174784:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518379.944993:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518379.945004:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16800/0x631fd8698c783862 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd154 expref: 13 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518379.945015:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518379.945032:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+12:2345:x1876445617174784:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 49us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518379.945039:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518379.945052:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1789518379.945058:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+11:2345:x1876445617174656:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518379.945067:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518379.945079:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bc400/0x631fd8698c7835bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd066 expref: 11 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518379.945089:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518379.945113:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+10:2345:x1876445617174656:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 53us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518379.945122:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518379.950149:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518379.950387:0:23984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617175168 00000100:00100000:2.0:1789518379.950400:0:23984:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617175168 00000100:00100000:2.0:1789518379.950477:0:23984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1789518379.950486:0:23984:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+5:2341:x1876445617175168:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:2.0:1789518379.950520:0:23984:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7835d0 00000100:00080000:2.0:1789518379.950531:0:23984:0:(import.c:65:import_set_state_nolock()) ffff99ffc5e14000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518379.950590:0:23984:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869189 00010000:00010000:3.0:1789518379.950983:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518379.953090:0:23984:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d4c95d-bde2-47cb-a27f-4c74703c2487+2:2341:x1876445617175168:12345-192.168.206.51@tcp:9:umount.0 Request processed in 2596us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518379.953102:0:23984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1789518379.968380:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518379.968501:0:24710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617176064 00000100:00100000:3.0:1789518379.968511:0:24710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617176064 00000100:00100000:3.0:1789518379.968570:0:24710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:3.0:1789518379.968580:0:24710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+18:2341:x1876445617176064:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:3.0:1789518379.968647:0:24710:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7835c9 00000020:00010000:3.0:1789518379.968667:0:24710:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fec3ada800: total 0 00000100:00080000:3.0:1789518379.968672:0:24710:0:(import.c:65:import_set_state_nolock()) ffff99fec3ad9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518379.968694:0:24710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869272 00000100:00100000:3.0:1789518379.969061:0:24710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d4c95d-bde2-47cb-a27f-4c74703c2487+17:2341:x1876445617176064:12345-192.168.206.51@tcp:39:umount.0 Request processed in 481us (687us total) trans 17179869273 rc 0/0 00000100:00100000:3.0:1789518379.969069:0:24710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000020:00000080:3.0:1789518380.192410:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffdf98d000/248f1a9b-0266-4d36-9534-dab733fe88d3 for lustre-OST0000 00000020:00000080:3.0:1789518380.192458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5e13800/b6d4c95d-bde2-47cb-a27f-4c74703c2487 for lustre-OST0000 00000020:00000080:3.0:1789518380.192482:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffdf98e000 for lustre-OST0000 00000020:00000080:3.0:1789518380.192487:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc5e14000 for lustre-OST0000 00010000:00010000:3.0:1789518380.275706:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518380.766023:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518380.766061:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518380.766092:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617176192 00000100:00100000:3.0:1789518380.766104:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617176192 00000100:00100000:1.0:1789518380.766143:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518380.766165:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617176320 00000100:00100000:3.0:1789518380.766169:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617176320 00000100:00100000:3.0:1789518380.766183:0:23287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617176448 00000100:00100000:3.0:1789518380.766186:0:23287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617176448 00000100:00100000:3.0:1789518380.766359:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518380.766384:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+10:2344:x1876445617176320:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518380.766394:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518380.766405:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16200/0x631fd8698c7836cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd0c8 expref: 10 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518380.766427:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518380.766449:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+9:2344:x1876445617176320:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 82us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518380.766456:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518380.766471:0:23287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518380.766477:0:23287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff5624c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+8:2343:x1876445617176448:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518380.766485:0:23287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518380.766494:0:23287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c78385b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd14d expref: 8 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518380.766505:0:23287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518380.766608:0:23287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff5624c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83b7d112-ac86-4580-aba7-3f82c95a71b7+7:2343:x1876445617176448:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 130us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518380.766657:0:23287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518380.772981:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518380.773082:0:25959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617176704 00000100:00100000:3.0:1789518380.773092:0:25959:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617176704 00000100:00100000:3.0:1789518380.773305:0:25959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1789518380.773317:0:25959:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:248f1a9b-0266-4d36-9534-dab733fe88d3+6:2341:x1876445617176704:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:3.0:1789518380.773355:0:25959:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7836da 00000020:00010000:3.0:1789518380.773362:0:25959:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ffdf98a800: total 0 00000100:00080000:3.0:1789518380.773367:0:25959:0:(import.c:65:import_set_state_nolock()) ffff99ffdf989000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518380.773396:0:25959:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869273 00000100:00100000:3.0:1789518380.773580:0:25959:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:248f1a9b-0266-4d36-9534-dab733fe88d3+5:2341:x1876445617176704:12345-192.168.206.51@tcp:39:umount.0 Request processed in 267us (748us total) trans 17179869274 rc 0/0 00000100:00100000:3.0:1789518380.773586:0:25959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00080000:1.0:1789518380.773780:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518380.784598:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000020:00010000:3.0:1789518380.787163:0:23289:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ffc5e12800: total 0 00010000:00010000:3.0:1789518380.787204:0:23289:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ffc5e12800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789518380.787235:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17800/0x631fd8698c7835ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd035 expref: 2 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518380.787251:0:23289:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ffc5e12800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789518380.787260:0:23289:0:(genops.c:885:class_export_put()) final put ffff99ffc5e12800/83b7d112-ac86-4580-aba7-3f82c95a71b7 00010000:00010000:3.0:1789518380.787274:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518380.787276:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518380.787277:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789518380.787287:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5e12800/83b7d112-ac86-4580-aba7-3f82c95a71b7 for MGS 00000020:00000080:3.0:1789518380.787315:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc5e16000 for MGS 00010000:00010000:2.0:1789518381.298821:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518381.683230:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627565952 00000100:00100000:1.0:1789518381.683240:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627565952 00000100:00100000:1.0:1789518381.683301:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518381.683313:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627565952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.683471:0:23983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627565952:12345-0@lo:400:kworker.0 Request processed in 159us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.683481:0:23983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789518381.683511:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518381.683653:0:24439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627566080 00000100:00100000:1.0:1789518381.683660:0:24439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627566080 00000100:00100000:1.0:1789518381.683703:0:24439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518381.683722:0:24439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627566080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.683766:0:24439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627566080:12345-0@lo:400:kworker.0 Request processed in 46us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.683773:0:24439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789518381.683803:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518381.683819:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627566464 00000100:00100000:1.0:1789518381.683823:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627566464 00000100:00100000:1.0:1789518381.683859:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627566336 00000100:00100000:1.0:1789518381.683863:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627566336 00000100:00100000:1.0:1789518381.683886:0:23300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627566208 00000100:00100000:1.0:1789518381.683889:0:23300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627566208 00000100:00100000:2.0:1789518381.683894:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518381.683908:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627566592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518381.683909:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518381.683918:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627566464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518381.683949:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518381.683970:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627566464:12345-0@lo:400:kworker.0 Request processed in 52us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.683979:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789518381.683992:0:23987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627566592 00000100:00100000:2.0:1789518381.683997:0:23987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627566592 00000100:00100000:1.0:1789518381.683998:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789518381.684009:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627566336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518381.684036:0:23987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518381.684049:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627566336:12345-0@lo:400:kworker.0 Request processed in 40us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518381.684050:0:23987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627566592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518381.684063:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789518381.684082:0:23300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00002000:00000024:2.0:1789518381.684084:0:23987:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789518381.684092:0:23300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627566208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518381.684139:0:23300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627566208:12345-0@lo:400:kworker.0 Request processed in 50us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518381.684147:0:23987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627566592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518381.684150:0:23300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789518381.684159:0:23987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789518381.684177:0:23296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518381.684198:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869195 gen 2 00000004:00080000:2.0:1789518381.684205:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869195 committed transno 17179869195 00000100:00100000:1.0:1789518381.684214:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627566208:0@lo:400:kworker.0 00000100:00100000:2.0:1789518381.684231:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627566592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518381.684232:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627566080:0@lo:400:kworker.0 00000001:00100000:1.0:1789518381.725093:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 248f1a9b-0266-4d36-9534-dab733fe88d3 00000001:00080000:1.0:1789518381.725101:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869274 is committed 00000020:00000080:1.0:1789518381.725105:0:5833:0:(genops.c:885:class_export_put()) final put ffff99ffdf98a800/248f1a9b-0266-4d36-9534-dab733fe88d3 00000001:00100000:1.0:1789518381.725129:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b6d4c95d-bde2-47cb-a27f-4c74703c2487 00000001:00080000:1.0:1789518381.725134:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869273 is committed 00000020:00000080:1.0:1789518381.725138:0:5833:0:(genops.c:885:class_export_put()) final put ffff99fec3ada800/b6d4c95d-bde2-47cb-a27f-4c74703c2487 00000020:00080000:1.0:1789518381.725148:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 12884902055 batchid updated 00000020:00080000:1.0:1789518381.725166:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902055 00000020:00080000:1.0:1789518381.725175:0:23339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902055 00000020:01000004:1.0:1789518381.911807:0:26212:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789518381.918266:0:26212:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789518381.918312:0:26212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.918343:0:26212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.918350:0:26212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.918357:0:26212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.918376:0:26212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789518381.918382:0:26212:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789518381.918399:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518381.918405:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518381.918409:0:26212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1789518381.918413:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1b17c20) 00000100:00100000:2.0:1789518381.918415:0:26212:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 10000000:00010000:1.0:1789518381.918417:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518381.918423:0:26212:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1789518381.918425:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518381.918431:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518381.918434:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518381.918436:0:23289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789518381.918437:0:23289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1789518381.918446:0:26212:0:(import.c:65:import_set_state_nolock()) ffff99ffc84da000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789518381.918468:0:23289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.918476:0:23289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789518381.918549:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c8a322e-2788-4faf-9195-ae294b8818bd:3281:1876445627566848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518381.918588:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.918597:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c783392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783399 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518381.918610:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518381.918707:0:23286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627566848 00000100:00100000:2.0:1789518381.918714:0:23286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627566848 00010000:00010000:1.0:1789518381.918745:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518381.918748:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518381.918751:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518381.918765:0:23286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518381.918784:0:23286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+19:3281:x1876445627566848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518381.918807:0:23286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518381.918823:0:23286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697000/0x631fd8698c783399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783392 expref: 19 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.918838:0:23286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518381.918846:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518381.918895:0:23286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c8a322e-2788-4faf-9195-ae294b8818bd+18:3281:x1876445627566848:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518381.918913:0:23286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518381.918998:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c8a322e-2788-4faf-9195-ae294b8818bd:3281:1876445627566848:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789518381.919147:0:26212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518381.919150:0:26212:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789518381.919154:0:26212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789518381.920254:0:26212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920266:0:26212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920272:0:26212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920279:0:26212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920299:0:26212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518381.920304:0:26212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920310:0:26212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920317:0:26212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920323:0:26212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920348:0:26212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789518381.920353:0:26212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920359:0:26212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920365:0:26212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920370:0:26212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920375:0:26212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789518381.920379:0:26212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920384:0:26212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920389:0:26212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920395:0:26212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518381.920400:0:26212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789518381.920402:0:26212:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789518381.920424:0:26212:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789518381.920427:0:26212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789518381.920430:0:26212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518381.920434:0:26212:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789518381.920439:0:26212:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99ffed5a3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518381.920444:0:26212:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99ffc6490000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518381.920449:0:26212:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff99ffc64a19c0) has exports, disconnecting them 00000020:00080000:2.0:1789518381.920453:0:26212:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ffed5a3800), last request at 1789518381 00000020:00000080:2.0:1789518381.920459:0:26212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78358a 00000100:00080000:2.0:1789518381.920473:0:26212:0:(import.c:65:import_set_state_nolock()) ffff99ffed5a7800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789518381.920573:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789518381.920583:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920591:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518381.920595:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920604:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518381.920630:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518381.920638:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518381.920641:0:23289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1789518381.920649:0:23289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:2.0:1789518381.920678:0:26212:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffed5a3800): rc 0 00000020:00000080:2.0:1789518381.920681:0:26212:0:(genops.c:885:class_export_put()) final put ffff99ffed5a3800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1789518381.920686:0:23289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920694:0:23289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518381.920717:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920729:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7832f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7832ff expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920743:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789518381.920748:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920754:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518381.920758:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920765:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518381.920772:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518381.920777:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518381.920779:0:23289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789518381.920781:0:23289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789518381.920808:0:23289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920816:0:23289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518381.920830:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920838:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffd0696400/0x631fd8698c783598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78359f expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920850:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518381.920855:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920877:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44c00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518381.920882:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920890:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518381.920896:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518381.920902:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789518381.920905:0:23289:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789518381.920917:0:23289:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789518381.920931:0:23289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920938:0:23289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518381.920955:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920964:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b44c00/0x631fd8698c78384d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783854 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.920993:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518381.920997:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.921005:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518381.921008:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.921017:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518381.921037:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518381.921042:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518381.921043:0:23289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789518381.921045:0:23289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789518381.921059:0:23289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.921064:0:23289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518381.921071:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.921077:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45400/0x631fd8698c7832ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7832f1 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518381.921088:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518381.921091:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518381.921101:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518381.921113:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c8a322e-2788-4faf-9195-ae294b8818bd:3280:1876445627567232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518381.921167:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518381.921194:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518381.921203:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c8a322e-2788-4faf-9195-ae294b8818bd:3280:1876445627567360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518381.921248:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518381.921309:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627567360 00000100:00100000:1.0:1789518381.921315:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627567360 00010000:00010000:3.0:1789518381.921399:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518381.921860:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed5a3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1789518381.921893:0:26212:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ffc6490000), last request at 1789518381 00000020:00000080:2.0:1789518381.921900:0:26212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783448 00000100:00080000:2.0:1789518381.921907:0:26212:0:(import.c:65:import_set_state_nolock()) ffff99ffc6494000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789518381.921925:0:26212:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffc6490000): rc 0 00000020:00000080:2.0:1789518381.921928:0:26212:0:(genops.c:885:class_export_put()) final put ffff99ffc6490000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1789518381.921929:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1789518381.921938:0:26212:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa50841cf7ae0 00000100:00080000:2.0:1789518381.921956:0:26212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789518381.921959:0:26212:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869189 gen 3 00000004:00080000:2.0:1789518381.921974:0:26212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789518381.924835:0:26212:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789518381.924939:0:26212:0:(import.c:65:import_set_state_nolock()) ffff99fec271e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789518381.924958:0:26212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789518381.924961:0:26212:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869195 gen 3 00000004:00080000:2.0:1789518381.924971:0:26212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789518381.925017:0:26212:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789518381.925027:0:26212:0:(import.c:65:import_set_state_nolock()) ffff99ffc5de1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789518381.925062:0:26212:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99ffc64a19c0) has no exports 00000100:00100000:1.0:1789518381.925089:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627567488 00000100:00100000:1.0:1789518381.925099:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627567488 00000100:00100000:1.0:1789518381.925157:0:23983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627567616 00000100:00100000:1.0:1789518381.925162:0:23983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627567616 00000100:00100000:1.0:1789518381.925194:0:23983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518381.925202:0:23983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876445627567488:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789518381.925231:0:23983:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783464 00000100:00080000:1.0:1789518381.925243:0:23983:0:(import.c:65:import_set_state_nolock()) ffff99fec11e2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518381.925294:0:23983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869189 00010000:00010000:3.0:1789518381.925336:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518381.925674:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc5de1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789518381.925688:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789518381.925691:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518381.925695:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627567616:0@lo:9:umount.0 00000100:00080000:3.0:1789518381.925825:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec271e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789518381.925844:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789518381.925846:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518381.925849:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627567488:0@lo:9:umount.0 00000020:00080000:2.0:1789518381.935848:0:26212:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99ffc64a19c0) has no exports 00000020:00000080:2.0:1789518381.975975:0:26212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783345 00000020:00000080:2.0:1789518381.975991:0:26212:0:(genops.c:885:class_export_put()) final put ffff99ffff797000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789518381.976056:0:26212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789518381.976117:0:26212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518381.976127:0:26212:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789518381.976131:0:26212:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff99ffc64a3380) has no exports 00000020:00000080:3.0:1789518381.976297:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff797000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789518381.976569:0:26212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78333e 00000020:00000080:2.0:1789518381.976575:0:26212:0:(genops.c:885:class_export_put()) final put ffff99ffc76d7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789518381.976673:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc76d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789518381.976915:0:26212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518381.976923:0:26212:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789518381.976926:0:26212:0:(genops.c:885:class_export_put()) final put ffff99ffff791000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789518381.976929:0:26212:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff791000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789518381.976936:0:26212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1789518381.977036:0:26212:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffd07fc480 - data ffff99ffd7848ca8/ffff99fec4a1cc00 00000020:01000000:2.0:1789518381.977165:0:26212:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99fec2186660 - data ffff9a0000bdca20/ffff99ffd1099000 00000001:00000004:3.0:1789518381.991776:0:26212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869274 00000004:00080000:2.0:1789518382.041027:0:23323:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789518382.041032:0:23323:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x16:0x0] index 2 count 1 00000040:00080000:2.0:1789518382.041042:0:23323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 4 count 2 00000004:00080000:2.0:1789518382.042402:0:23325:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789518382.042406:0:23325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 3 count 1 00000040:00080000:2.0:1789518382.042414:0:23325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 4 count 2 00000020:00000080:3.0:1789518382.086835:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec271f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518382.087158:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec2718800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1789518382.087402:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed4df000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789518382.087431:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5de4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518382.087966:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc5de1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789518382.087974:0:8:0:(genops.c:885:class_export_put()) final put ffff99ffff742000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789518382.087977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff742000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789518382.087982:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518382.088397:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff742800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789518382.088404:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff747000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518382.088571:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec271e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789518382.088946:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec271a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789518382.088952:0:8:0:(genops.c:885:class_export_put()) final put ffff99fec2719000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789518382.088955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec2719000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789518382.088959:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00010000:2.0:1789518382.089254:0:23288:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ffd9259800: total 2 00010000:00010000:2.0:1789518382.089259:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518382.089295:0:23288:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ffd9259800, canceled 0 locks, left on hash table 8. 00000100:00100000:1.0:1789518382.089301:0:23292:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff99fff5aee800:23292] 0 exiting: rc = 1 00010000:00010000:2.0:1789518382.089327:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17400/0x631fd8698c783846 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c78383f expref: 9 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518382.089344:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697c00/0x631fd8698c7833fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c7833f4 expref: 8 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518382.089363:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd800/0x631fd8698c78354b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783544 expref: 7 pid: 23295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518382.089388:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c800/0x631fd8698c783838 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783831 expref: 6 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518382.089410:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b45800/0x631fd8698c783409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783402 expref: 5 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518382.089422:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b45000/0x631fd8698c783575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c78356e expref: 4 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518382.089433:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b44800/0x631fd8698c783433 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c78342c expref: 3 pid: 23292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518382.089446:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc14cc00/0x631fd8698c7832e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c7832dc expref: 2 pid: 23294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518382.089459:0:23288:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ffd9259800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789518382.089482:0:23288:0:(genops.c:885:class_export_put()) final put ffff99ffd9259800/7c8a322e-2788-4faf-9195-ae294b8818bd 00010000:00010000:2.0:1789518382.089496:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518382.089499:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518382.089500:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789518382.089513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec271b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518382.089520:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd9259800/7c8a322e-2788-4faf-9195-ae294b8818bd for MGS 00000020:00000080:3.0:1789518382.089543:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffd925e800 for MGS 00000020:00000080:2.0:1789518382.092584:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5e36800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789518382.093332:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc84d8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789518382.096831:0:26212:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789518382.096839:0:26212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518382.096843:0:26212:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789518382.096850:0:26212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518382.097031:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc84da000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789518382.097048:0:26212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518382.097057:0:26212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789518382.097063:0:26212:0:(genops.c:885:class_export_put()) final put ffff99ffc81aa800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789518382.097077:0:26212:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc81aa800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789518382.097087:0:26212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789518382.097149:0:26212:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc5e32800 1 00000020:00000080:2.0:1789518382.097155:0:26212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7832ab 00000020:00000080:2.0:1789518382.097162:0:26212:0:(genops.c:885:class_export_put()) final put ffff99ffc5e34000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789518382.097178:0:26212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789518382.097183:0:26212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518382.097187:0:26212:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789518382.097191:0:26212:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff99ffd10f99c0) has no exports 00000020:00000080:3.0:1789518382.097563:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5e34000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518382.120036:0:26212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518382.120051:0:26212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789518382.120056:0:26212:0:(genops.c:885:class_export_put()) final put ffff99ffc5e36000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789518382.120061:0:26212:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5e36000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789518382.120072:0:26212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789518382.120245:0:26212:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffc5e37000 00000020:01000000:3.0:1789518382.120265:0:26212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789518382.120269:0:26212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518382.120274:0:26212:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789518382.120277:0:26212:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff99fec18ccd40) has no exports 00000100:00100000:3.0:1789518382.120441:0:25959:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff99fffdc81400:25959] 4 exiting: rc = 0 00000100:00100000:2.0:1789518382.120781:0:23302:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff99fff7abac00:23302] 2 exiting: rc = 0 00000100:00100000:1.0:1789518382.121728:0:23300:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff99ffc6096a00:23300] 0 exiting: rc = 1 00000100:00100000:3.0:1789518382.130564:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.130573:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.130594:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.130601:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.130608:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131242:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131249:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131254:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131259:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131265:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131271:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131277:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131282:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131287:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131292:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131298:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131304:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131310:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131316:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131321:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131327:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131332:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131338:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131343:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131349:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131354:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131360:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131365:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131369:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131374:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131379:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131384:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131389:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131394:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131404:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131410:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131415:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131428:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131435:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131440:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131446:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131453:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131458:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131466:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131470:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131475:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131479:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131484:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131488:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131493:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131497:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131501:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131507:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131512:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131517:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131523:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131528:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131533:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131540:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131545:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131552:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131557:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131562:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518382.131568:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.135646:0:23303:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99fff723ee00:23303] 0 exiting: rc = 1 00000100:00100000:3.0:1789518382.135761:0:23304:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99fff723ec00:23304] 1 exiting: rc = 0 00000100:00100000:0.0:1789518382.136315:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136336:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136342:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136347:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136352:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136357:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136363:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136368:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136373:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136378:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136384:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136389:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136394:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136399:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136404:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136409:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136414:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136419:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136425:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136430:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136435:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136440:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136445:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136450:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136456:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136461:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136466:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136471:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136476:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136481:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136486:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136491:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136495:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136500:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.136506:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.137342:0:23306:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff99fff723e600:23306] 1 exiting: rc = 0 00000100:00100000:3.0:1789518382.137492:0:23305:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff99fff723f800:23305] 0 exiting: rc = 1 00000100:00100000:0.0:1789518382.137642:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137657:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137663:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137669:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137675:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137681:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137687:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137693:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137700:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137706:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137712:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137719:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137740:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137747:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137761:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137768:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137775:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137780:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137798:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137805:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137811:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137817:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137823:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137829:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137855:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137862:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137868:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137877:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137884:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137890:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137896:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137902:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137907:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137912:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137917:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137923:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137951:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137958:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137964:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137970:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137976:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137981:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137987:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137992:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.137999:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138005:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138011:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138017:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138038:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138046:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138053:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138061:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138067:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138073:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138079:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138086:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138091:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138098:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138104:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138110:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138132:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138139:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138145:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.138152:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.145744:0:23308:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99ffc86d1600:23308] 1 exiting: rc = 0 00000100:00100000:0.0:1789518382.145875:0:23307:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99fff723fc00:23307] 0 exiting: rc = 1 00000100:00100000:1.0:1789518382.146063:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146071:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146076:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146081:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146086:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146091:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146096:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146113:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146118:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146123:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146128:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146133:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146138:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146143:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146149:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146154:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146159:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146164:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146172:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146180:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146187:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146195:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146200:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146205:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146210:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146214:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146219:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146227:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146234:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146243:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146249:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146255:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146259:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146265:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146270:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146276:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146281:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146286:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146291:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146296:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146300:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146305:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146319:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146324:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146328:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146333:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146337:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146342:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146347:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146351:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146356:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146360:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146364:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146369:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146373:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146377:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146381:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146386:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146390:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146394:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146398:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146402:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146406:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.146411:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147259:0:23309:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99ffc6b1d400:23309] 0 exiting: rc = 1 00000100:00100000:2.0:1789518382.147359:0:23310:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99fffc389a00:23310] 1 exiting: rc = 0 00000100:00100000:0.0:1789518382.147449:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147455:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147461:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147465:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147470:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147484:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147490:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147495:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147501:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147506:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147511:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147517:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147521:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147526:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147531:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147536:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147541:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147546:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147551:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147556:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147561:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147566:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147572:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147577:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147582:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147586:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147591:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147596:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147601:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147607:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147644:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147651:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147656:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147661:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147666:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147670:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147675:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147680:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147685:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147690:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147702:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147707:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147713:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147719:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147724:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147729:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147734:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147739:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147743:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147749:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147754:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147759:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147763:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147768:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147773:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147778:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147783:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147802:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147807:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147812:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147817:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147821:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147826:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.147831:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148391:0:23312:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff99fffc389400:23312] 1 exiting: rc = 0 00000100:00100000:2.0:1789518382.148486:0:23311:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff99fffc389e00:23311] 0 exiting: rc = 1 00000100:00100000:0.0:1789518382.148574:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148580:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148585:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148590:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148595:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148600:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148605:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148636:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148643:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148648:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148661:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148667:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148672:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148677:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148682:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148687:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148692:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148697:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148702:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148707:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148713:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148718:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148723:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148728:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148732:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148737:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148742:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148747:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148752:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148757:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148762:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148768:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148772:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148778:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148795:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148802:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148807:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148811:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148816:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148821:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148826:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148832:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148837:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148842:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148847:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148860:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148865:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148871:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148875:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148880:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148885:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148890:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148895:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148900:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148906:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148911:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148916:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148920:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148926:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148931:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148936:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148941:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148946:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518382.148951:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518382.149667:0:23313:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff99fffc389800:23313] 0 exiting: rc = 1 00000100:00100000:0.0:1789518382.149887:0:23315:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff99fffc388000:23315] 2 exiting: rc = 0 00000100:00100000:3.0:1789518382.150009:0:23314:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff99fffc389200:23314] 1 exiting: rc = 0 00000100:00100000:2.0:1789518382.150189:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150197:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150203:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150209:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150215:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150220:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150226:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150232:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150247:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150254:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150260:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150268:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150274:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150279:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150285:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150291:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150297:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150302:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150307:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150312:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150328:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150333:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150338:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150344:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150359:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150377:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150385:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150390:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150396:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150401:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150407:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150414:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150420:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150426:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150431:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150436:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150441:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150446:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150452:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150457:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150464:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150470:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150476:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150481:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150487:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150502:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150510:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150517:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150522:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150528:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150534:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150540:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150546:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150552:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150558:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150571:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150577:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150583:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150590:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150595:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150601:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150607:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150698:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518382.150706:0:26212:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789518382.155002:0:26212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518382.155015:0:26212:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789518382.155021:0:26212:0:(genops.c:885:class_export_put()) final put ffff99fec13e0000/MDS_uuid 00000020:00000080:2.0:1789518382.155026:0:26212:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec13e0000/MDS_uuid for MDS 00000020:01000000:2.0:1789518382.155031:0:26212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789518382.155139:0:26212:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:0.0:1789518382.226084:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789518382.226092:0:7607:0:(genops.c:885:class_export_put()) final put ffff99fec11e3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789518382.226112:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b6d4c95d-bde2-47cb-a27f-4c74703c2487 00000020:00000080:0.0:1789518382.226114:0:7607:0:(genops.c:885:class_export_put()) final put ffff99fffbb74800/b6d4c95d-bde2-47cb-a27f-4c74703c2487 00000001:00100000:0.0:1789518382.226121:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 248f1a9b-0266-4d36-9534-dab733fe88d3 00000020:00000080:0.0:1789518382.226123:0:7607:0:(genops.c:885:class_export_put()) final put ffff99ffed5a5000/248f1a9b-0266-4d36-9534-dab733fe88d3 00000020:00000080:0.0:1789518382.226136:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec11e3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789518382.226171:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffbb74800/b6d4c95d-bde2-47cb-a27f-4c74703c2487 for lustre-OST0001 00000020:00000080:0.0:1789518382.226184:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed5a5000/248f1a9b-0266-4d36-9534-dab733fe88d3 for lustre-OST0001 00000020:00000080:0.0:1789518382.227833:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffffbf2800 for lustre-OST0001 00000020:00000080:0.0:1789518382.227843:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fffbb73000 for lustre-OST0001 00000020:00000080:0.0:1789518382.227858:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffed5a1000 for lustre-OST0001 00010000:00010000:0.0:1789518382.323549:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518383.348119:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789518383.871233:0:26364:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789518383.880770:0:26364:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789518383.880828:0:26364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518383.880844:0:26364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518383.880852:0:26364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518383.880890:0:26364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518383.880912:0:26364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789518383.880917:0:26364:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789518383.880939:0:26364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518383.880944:0:26364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789518383.880949:0:26364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789518383.880974:0:26364:0:(import.c:65:import_set_state_nolock()) ffff99fec11e1000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789518383.881175:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627567744:0@lo:39:umount.0 00000400:00000100:3.0:1789518383.881223:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627567744 offset 0 length 224: 4 00010000:00010000:0.0:1789518383.881267:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518383.881275:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518383.881285:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518383.881289:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518383.881298:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518383.881305:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518383.881311:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518383.881313:0:23289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789518383.881316:0:23289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789518383.881342:0:23289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518383.881349:0:23289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518383.881383:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518383.881391:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c78342c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783433 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518383.881408:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518383.881412:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518383.881424:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518383.881443:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518383.881454:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c8a322e-2788-4faf-9195-ae294b8818bd:3283:1876445627567872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518383.881494:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518383.881556:0:23285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627567872 00000100:00100000:0.0:1789518383.881565:0:23285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627567872 00000100:00100000:0.0:1789518383.881698:0:23285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518383.881708:0:23285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1876445627567872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789518383.881716:0:23285:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518383 with bad export cookie 7142665481872749262 00000100:00100000:0.0:1789518383.894043:0:23285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1876445627567872:12345-0@lo:103:ldlm_bl.0 Request processed in 12328us (12540us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789518383.894057:0:23285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789518383.898500:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789518383.898507:0:3283:0:(import.c:65:import_set_state_nolock()) ffff99fec13e1000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789518383.898512:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1789518383.904588:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789518383.904593:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789518383.904602:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff4b1dc00 x1876445627567872/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789518399 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789518383.904759:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789518383.904762:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789518383.904764:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789518383.904767:0:3283:0:(import.c:65:import_set_state_nolock()) ffff99fec13e1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518383.904773:0:3283:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 391 00000100:00080000:1.0:1789518383.904798:0:3283:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99fec13e1000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518383.904830:0:3283:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd1009c00 x1876445627568000/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518383.904888:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c8a322e-2788-4faf-9195-ae294b8818bd:3283:1876445627567872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518383.904967:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c8a322e-2788-4faf-9195-ae294b8818bd:3279:1876445627568000:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1789518383.905013:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627568000 offset 0 length 520: 4 00010000:00010000:2.0:1789518384.371477:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789518385.293393:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789518385.293401:0:6674:0:(genops.c:885:class_export_put()) final put ffff99fec11e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789518385.293682:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec11e6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789518385.293720:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec11e2800 for lustre-OST0000 00010000:00010000:0.0:1789518385.394999:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518386.418882:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518386.802872:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518386.802896:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518386.802981:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627568128:0@lo:400:kworker.0 00000400:00000100:1.0:1789518386.803031:0:3283:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627568128 offset 0 length 224: 4 00010000:00010000:0.0:1789518387.442953:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518388.466935:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518388.852577:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518388.852586:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518388.852731:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518388.852762:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627568256:0@lo:400:kworker.0 00000400:00000100:1.0:1789518388.852812:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627568256 offset 0 length 224: 4 00010000:00010000:0.0:1789518389.490831:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518390.514799:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518391.538889:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518392.564366:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518393.459163:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518383/real 1789518383] req@ffff99ffd1009c00 x1876445627568000/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518393 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518393.459191:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffd1009c00 x1876445627568000/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518393 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518393.459199:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518383/real 1789518383] req@ffff99ffd100b480 x1876445627567744/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518393 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518393.459208:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffd100b480 x1876445627567744/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518393 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789518393.459224:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec13e1000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518393.459275:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789518393.459280:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c8a322e-2788-4faf-9195-ae294b8818bd:3279:1876445627568000:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1789518393.459291:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec11e1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789518393.459389:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518393.459396:0:19561:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789518393.459399:0:19561:0:(import.c:65:import_set_state_nolock()) ffff99fec13e1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518393.459405:0:19561:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1789518393.459412:0:19561:0:(import.c:630:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789518393.459426:0:19561:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99fec13e1000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518393.459466:0:19561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffefff3480 x1876445627568384/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518393.459532:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518393.459546:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627568512:0@lo:400:kworker.0 00000400:00000100:3.0:1789518393.459604:0:3280:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627568512 offset 0 length 224: 4 00000100:00100000:0.0:1789518393.459862:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627567744:0@lo:39:umount.0 00000100:00100000:0.0:1789518393.459891:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c8a322e-2788-4faf-9195-ae294b8818bd:3279:1876445627568384:0@lo:250:kworker.0 00000400:00000100:0.0:1789518393.459914:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627568384 offset 0 length 520: 4 00000100:00080000:1.0:1789518393.460286:0:26364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518393.460291:0:26364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789518393.460296:0:26364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789518393.463316:0:26364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.463342:0:26364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.463350:0:26364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.463358:0:26364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.463468:0:26364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518393.463479:0:26364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.463486:0:26364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.463510:0:26364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518393.463517:0:26364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.465978:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518393.465995:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.466009:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518393.466014:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.466026:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518393.466034:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518393.466041:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518393.466056:0:23289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789518393.466073:0:23289:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fec13e1000 00010000:00010000:0.0:1789518393.466077:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.466084:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c783402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783409 expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.466132:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518393.466136:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.466143:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518393.466146:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.466153:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518393.466159:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518393.466163:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789518393.466166:0:23289:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789518393.466170:0:23289:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fec13e1000 00010000:00010000:0.0:1789518393.466173:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518393.466180:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518393.466182:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518393.466184:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518393.466936:0:26364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789518393.466947:0:26364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c78383f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783846 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518393.466962:0:26364:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789518393.466971:0:26364:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1789518393.466976:0:26364:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1789518393.466991:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789518393.467024:0:26364:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789518393.467029:0:26364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789518393.467037:0:26364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518393.467043:0:26364:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789518393.467048:0:26364:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99fec2aa4d40) has no exports 00000020:00080000:1.0:1789518393.467080:0:26364:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99fec2aa4d40) has no exports 00000020:01000000:1.0:1789518393.468973:0:26364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc818bea0 - data ffff99ffd9749870/ffff99fec4958000 00000020:01000000:1.0:1789518393.469152:0:26364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc2d3b8a0 - data ffff9a0000b5e438/ffff99fec2842800 00100000:10000000:1.0:1789518393.476982:0:26364:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789518393.495115:0:26364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783417 00000020:00000080:1.0:1789518393.495130:0:26364:0:(genops.c:885:class_export_put()) final put ffff99ffed5a6000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789518393.495144:0:26364:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc5112000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789518393.495148:0:26364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc5112000 2 00000020:00000080:3.0:1789518393.495184:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed5a6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1789518393.495229:0:26364:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffc5112000 from lustre-OST0000 00000020:00000080:1.0:1789518393.495263:0:26364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518393.495276:0:26364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789518393.495388:0:26364:0:(genops.c:885:class_export_put()) final put ffff99ffed5a5800/lustre-OST0000_UUID 00000020:00000080:1.0:1789518393.495391:0:26364:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed5a5800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789518393.495400:0:26364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789518393.495460:0:26364:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789518393.495466:0:26364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789518393.495471:0:26364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518393.495477:0:26364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789518393.495524:0:26364:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99fec11e5000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518393.495532:0:26364:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff99fff783cd40) has exports, disconnecting them 00000020:00080000:1.0:1789518393.495538:0:26364:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99fec11e5000), last request at 1789518343 00000020:00000080:1.0:1789518393.495548:0:26364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783441 00000020:00080000:1.0:1789518393.495559:0:26364:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fec11e5000): rc 0 00000020:00000080:1.0:1789518393.495565:0:26364:0:(genops.c:885:class_export_put()) final put ffff99fec11e5000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789518393.495641:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec11e5000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789518393.506775:0:26364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789518393.506852:0:26364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518393.506861:0:26364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789518393.506874:0:26364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518393.506955:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec11e1000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789518393.507132:0:26364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518393.507145:0:26364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789518393.507152:0:26364:0:(genops.c:885:class_export_put()) final put ffff99ffdf988800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789518393.507158:0:26364:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffdf988800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789518393.507170:0:26364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789518393.507391:0:26364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc5112000 1 00000020:00000080:2.0:1789518393.507399:0:26364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7833e6 00000020:00000080:2.0:1789518393.507408:0:26364:0:(genops.c:885:class_export_put()) final put ffff99ffffbf5000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789518393.507428:0:26364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789518393.507434:0:26364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518393.507439:0:26364:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789518393.507444:0:26364:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99ffd10fb380) has no exports 00000020:00000080:3.0:1789518393.507575:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789518393.523803:0:26364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518393.523820:0:26364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789518393.523825:0:26364:0:(genops.c:885:class_export_put()) final put ffff99ffffbf4000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789518393.523831:0:26364:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789518393.523839:0:26364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789518393.523999:0:26364:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffffbf1000 00000020:02000400:1.0:1789518393.524466:0:26364:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789518393.587201:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518394.611055:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789518395.044880:0:26517:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789518395.056775:0:26517:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789518395.056855:0:26517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518395.056868:0:26517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518395.056875:0:26517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518395.056897:0:26517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518395.056920:0:26517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789518395.056925:0:26517:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789518395.056946:0:26517:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518395.056957:0:26517:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffefff0380 x1876445627568128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518402 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789518395.056972:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518395.056982:0:23289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518395.056983:0:26517:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffefff0a80 x1876445627568256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518404 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789518395.057002:0:23289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518395.057014:0:23289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518395.057015:0:26517:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffefff2d80 x1876445627568512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518409 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789518395.057033:0:23289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518395.057037:0:26517:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789518395.057046:0:26517:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:00010000:0.0:1789518395.057047:0:23289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518395.057055:0:23289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518395.057058:0:23289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789518395.057060:0:23289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:1.0:1789518395.057071:0:26517:0:(import.c:65:import_set_state_nolock()) ffff99ffc76f6000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789518395.057072:0:23289:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fec13e1000 00010000:00010000:0.0:1789518395.057078:0:23289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518395.057087:0:23289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c78356e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783575 expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518395.057098:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518395.057099:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518395.057102:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518395.057120:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627568640:0@lo:39:umount.0 00000100:00100000:2.0:1789518395.057176:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627568128:0@lo:400:kworker.0 00000400:00000100:1.0:1789518395.057269:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627568640 offset 0 length 224: 4 00000100:00100000:1.0:1789518395.057342:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627568512:0@lo:400:kworker.0 00000100:00100000:3.0:1789518395.058769:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627568256:0@lo:400:kworker.0 00010000:00010000:2.0:1789518395.635470:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518396.659629:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518397.682828:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518398.578771:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518398.578780:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789518398.706850:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518399.731082:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518400.755253:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518401.778954:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518402.802823:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518403.698845:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789518403.698855:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789518403.826894:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518404.852593:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518405.234760:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518395/real 1789518395] req@ffff99ffd1009500 x1876445627568640/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518405 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518405.234793:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffd1009500 x1876445627568640/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518405 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789518405.234830:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc76f6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789518405.234857:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627568640:0@lo:39:umount.0 00000100:00080000:1.0:1789518405.235217:0:26517:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518405.235222:0:26517:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789518405.235227:0:26517:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789518405.236232:0:26517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518405.236246:0:26517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518405.236264:0:26517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518405.236271:0:26517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518405.236357:0:26517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518405.236366:0:26517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518405.236374:0:26517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518405.236380:0:26517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518405.236386:0:26517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518405.236482:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518405.236489:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518405.236496:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518405.236500:0:23288:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518405.236508:0:23288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518405.236515:0:23288:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518405.236531:0:23288:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518405.236534:0:23288:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789518405.236545:0:23288:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fec13e1000 00010000:00010000:2.0:1789518405.236549:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518405.236556:0:23288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17a00/0x631fd8698c783544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c78354b expref: -99 pid: 24698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518405.236569:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518405.236572:0:23288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518405.236578:0:23288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518405.236581:0:23288:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518405.236588:0:23288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518405.236594:0:23288:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518405.236599:0:23288:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789518405.236601:0:23288:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789518405.236604:0:23288:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fec13e1000 00010000:00010000:2.0:1789518405.236607:0:23288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518405.236667:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518405.236680:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518405.236683:0:23288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518405.236834:0:26517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789518405.236839:0:26517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b44a00/0x631fd8698c783831 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783838 expref: -99 pid: 23297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518405.236852:0:26517:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789518405.236856:0:26517:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1789518405.236858:0:26517:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789518405.236883:0:26517:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789518405.236887:0:26517:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789518405.236892:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518405.236905:0:26517:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789518405.236909:0:26517:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff99fec18c99c0) has no exports 00000020:00080000:1.0:1789518405.236933:0:26517:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff99fec18c99c0) has no exports 00000020:01000000:1.0:1789518405.239899:0:26517:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc77f30c0 - data ffff99fff7ff1510/ffff99fec488dc00 00010000:00010000:0.0:1789518405.240718:0:23289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789518405.241533:0:26517:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc77f3de0 - data ffff99fff7f32bd0/ffff99fec488d800 00100000:10000000:1.0:1789518405.255351:0:26517:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789518405.284825:0:26517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783559 00000020:00000080:0.0:1789518405.284835:0:26517:0:(genops.c:885:class_export_put()) final put ffff99fffbb70000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789518405.284861:0:26517:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fec26f0800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789518405.284864:0:26517:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fec26f0800 2 00000020:01000004:0.0:1789518405.284867:0:26517:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99fec26f0800 from lustre-OST0001 00000020:00000080:0.0:1789518405.284889:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518405.284898:0:26517:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789518405.284901:0:26517:0:(genops.c:885:class_export_put()) final put ffff99fffbb71800/lustre-OST0001_UUID 00000020:00000080:0.0:1789518405.284904:0:26517:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffbb71800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789518405.284910:0:26517:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1789518405.284921:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffbb70000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1789518405.284992:0:26517:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7c8a322e-2788-4faf-9195-ae294b8818bd->MGS 00010000:00010000:0.0:1789518405.285008:0:26517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc14c000/0x631fd8698c7833f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7833fb expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518405.285025:0:26517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc14c000/0x631fd8698c7833f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7833fb expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518405.285031:0:26517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789518405.285034:0:26517:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789518405.285037:0:26517:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789518405.285050:0:26517:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fec13e1000 00010000:00010000:0.0:1789518405.285054:0:26517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc14c000/0x631fd8698c7833f4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7833fb expref: -99 pid: 23982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518405.285071:0:26517:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7832e3 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518405.285092:0:26517:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7832e3 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518405.285098:0:26517:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518405.285101:0:26517:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789518405.285102:0:26517:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789518405.285118:0:26517:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fec13e1000 00010000:00010000:0.0:1789518405.285120:0:26517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b44e00/0x631fd8698c7832dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7832e3 expref: -99 pid: 23282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789518405.285136:0:26517:0:(import.c:65:import_set_state_nolock()) ffff99fec13e1000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789518405.285140:0:26517:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789518405.285142:0:26517:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789518405.285149:0:26517:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789518405.285154:0:26517:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789518405.285165:0:26517:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffefff3480 x1876445627568384/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789518408 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789518405.285189:0:26517:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789518405.285198:0:26517:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1789518405.285263:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c8a322e-2788-4faf-9195-ae294b8818bd:3279:1876445627568384:0@lo:250:kworker.0 10000000:01000000:0.0:1789518405.285288:0:26517:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789518405.285296:0:26517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7832c7 00000020:00000080:0.0:1789518405.285301:0:26517:0:(genops.c:885:class_export_put()) final put ffff99fec13e7000/7c8a322e-2788-4faf-9195-ae294b8818bd 00000020:01000000:0.0:1789518405.285363:0:26517:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.151@tcp (flags='') 00000020:00000080:0.0:1789518405.285369:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518405.285374:0:26517:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789518405.285377:0:26517:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff99fec18c8000) has no exports 10000000:01000000:3.0:1789518405.285441:0:23297:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789518405.285489:0:26517:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.151@tcp: client import never connected 00000100:00080000:0.0:1789518405.285492:0:26517:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789518405.285494:0:26517:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789518405.285497:0:26517:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789518405.285505:0:26517:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789518405.285600:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec13e7000/7c8a322e-2788-4faf-9195-ae294b8818bd for MGC192.168.206.151@tcp 00000020:00000080:0.0:1789518405.285731:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518405.285736:0:26517:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.151@tcp (uuid 7c8a322e-2788-4faf-9195-ae294b8818bd) 00000020:01000000:0.0:1789518405.285742:0:26517:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789518405.285745:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518405.285748:0:26517:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789518405.285753:0:26517:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99fec3ad8000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789518405.285758:0:26517:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff99fffee299c0) has exports, disconnecting them 00000020:00080000:0.0:1789518405.285763:0:26517:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99fec3ad8000), last request at 1789518351 00000020:00000080:0.0:1789518405.285766:0:26517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783583 00000020:00080000:0.0:1789518405.285780:0:26517:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fec3ad8000): rc 0 00000020:00000080:0.0:1789518405.285783:0:26517:0:(genops.c:885:class_export_put()) final put ffff99fec3ad8000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789518405.285810:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec13e1000 for MGC192.168.206.151@tcp 00000020:00000080:2.0:1789518405.285818:0:19561:0:(genops.c:885:class_export_put()) final put ffff99fec13e3000/7c8a322e-2788-4faf-9195-ae294b8818bd 00000020:00000080:2.0:1789518405.285819:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec13e3000/7c8a322e-2788-4faf-9195-ae294b8818bd for MGC192.168.206.151@tcp 00000020:01000000:2.0:1789518405.285824:0:19561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.151@tcp (7c8a322e-2788-4faf-9195-ae294b8818bd) 00000020:00000080:2.0:1789518405.287997:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec3ad8000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789518405.289764:0:26517:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789518405.289771:0:26517:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518405.289775:0:26517:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789518405.289781:0:26517:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789518405.289824:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc76f6000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1789518405.289873:0:23288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789518405.293692:0:23289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1789518405.294709:0:23284:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99ffc64c5c00:23284] 1 exiting: rc = 0 00000100:00100000:3.0:1789518405.294832:0:23283:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99ffc64c5e00:23283] 0 exiting: rc = 1 00000100:00100000:3.0:1789518405.294890:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295161:0:23286:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99ffc64c5600:23286] 1 exiting: rc = 0 00000100:00100000:3.0:1789518405.295241:0:23285:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99ffc64c4a00:23285] 0 exiting: rc = 1 00000100:00100000:2.0:1789518405.295339:0:23287:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99ffc6ac6000:23287] 2 exiting: rc = 0 00000100:00100000:3.0:1789518405.295447:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295454:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295460:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295467:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295474:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295481:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295487:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295493:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295498:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295503:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295509:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295514:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295520:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295525:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295530:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295535:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295540:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295545:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295550:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295558:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295565:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295571:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295580:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295585:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295591:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295597:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295602:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295606:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295639:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295644:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295649:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295659:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295667:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295693:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295698:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295704:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295710:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295715:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295719:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295725:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295730:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295734:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295739:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295744:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295749:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295754:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295759:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295763:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295768:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295773:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295777:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295782:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295787:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295793:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295798:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295803:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295809:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295814:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295820:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295824:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295829:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295834:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295838:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.295844:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789518405.299179:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518405.299192:0:26517:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789518405.299197:0:26517:0:(genops.c:885:class_export_put()) final put ffff99fff4014800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789518405.299201:0:26517:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4014800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789518405.299216:0:26517:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789518405.299388:0:26517:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fec26f0800 1 00000020:00000080:3.0:1789518405.299394:0:26517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78353d 00000020:00000080:3.0:1789518405.299401:0:26517:0:(genops.c:885:class_export_put()) final put ffff99fec26f3000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789518405.299418:0:26517:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789518405.299423:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518405.299428:0:26517:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789518405.299432:0:26517:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99fec2aa3380) has no exports 00000020:00000080:2.0:1789518405.299540:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec26f3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789518405.317073:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518405.317088:0:26517:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789518405.317094:0:26517:0:(genops.c:885:class_export_put()) final put ffff99fec26f7800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789518405.317098:0:26517:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec26f7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789518405.317110:0:26517:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789518405.317336:0:26517:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99fec26f5000 00000020:01000000:3.0:1789518405.317358:0:26517:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789518405.317363:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518405.317367:0:26517:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789518405.317371:0:26517:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff99ffd10fcd40) has no exports 00000020:00000080:3.0:1789518405.317401:0:26517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518405.317409:0:26517:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789518405.317412:0:26517:0:(genops.c:885:class_export_put()) final put ffff99ffffbf0000/OSS_uuid 00000020:00000080:3.0:1789518405.317415:0:26517:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf0000/OSS_uuid for OSS 00000020:01000000:3.0:1789518405.317420:0:26517:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789518405.317498:0:23985:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff99ffd8127a00:23985] 2 exiting: rc = 0 00000100:00100000:3.0:1789518405.317594:0:23984:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff99fff45c5600:23984] 1 exiting: rc = 0 00000100:00080000:0.0:1789518405.317885:0:23296:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789518405.317979:0:24439:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff99fec26dd200:24439] 3 exiting: rc = 0 00000100:00100000:0.0:1789518405.318044:0:23983:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff99fff45c5e00:23983] 0 exiting: rc = 1 00000100:00100000:3.0:1789518405.318095:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318111:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318118:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318125:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318131:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318136:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318140:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318145:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318161:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318166:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318171:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318176:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318182:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318187:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318192:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318199:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318206:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318214:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318220:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318226:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318231:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318236:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318241:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318245:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318251:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318256:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318262:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318271:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318278:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318283:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318288:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318292:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318297:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318302:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318307:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318313:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318318:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318325:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318332:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318340:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318347:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318355:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318363:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318380:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318386:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318392:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318397:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318404:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318411:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318419:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318441:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318448:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318455:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318464:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318472:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318480:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318486:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318495:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318503:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318509:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318514:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318521:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318528:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518405.318535:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319551:0:23988:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99fec34eb800:23988] 1 exiting: rc = 0 00000100:00100000:3.0:1789518405.319664:0:23987:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99fec34ea800:23987] 0 exiting: rc = 1 00000100:00100000:1.0:1789518405.319807:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319813:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319819:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319827:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319834:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319843:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319854:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319864:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319874:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319883:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319892:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319898:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319903:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319909:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319931:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319940:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319948:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319955:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319962:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319969:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319976:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319984:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.319992:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320000:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320007:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320014:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320034:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320043:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320049:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320056:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320060:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320067:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320074:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320082:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320090:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320098:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320106:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320113:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320120:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320127:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320135:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320142:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320148:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320156:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320164:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320172:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320180:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320186:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320192:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320199:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320204:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320209:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320214:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320220:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320225:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320229:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320234:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320238:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320243:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320249:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320253:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320264:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320268:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.320271:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321598:0:23991:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99fec34ea600:23991] 2 exiting: rc = 0 00000100:00100000:3.0:1789518405.321645:0:23989:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99fec34eba00:23989] 0 exiting: rc = 1 00000100:00100000:2.0:1789518405.321843:0:23990:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99fec34eb600:23990] 1 exiting: rc = 0 00000100:00100000:1.0:1789518405.321897:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321904:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321909:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321922:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321933:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321944:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321955:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321965:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321976:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321985:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.321995:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322006:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322017:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322027:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322036:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322046:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322053:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322062:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322071:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322080:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322105:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322115:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322125:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322135:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322145:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322156:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322165:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322174:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322185:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322195:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322203:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322221:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322227:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322232:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322237:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322243:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322248:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322254:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322259:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322264:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322270:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322278:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322287:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322295:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322331:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322343:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322354:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322365:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322375:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322384:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322393:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322404:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322415:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322429:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322434:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322443:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322447:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322451:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322455:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322461:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322466:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322472:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322477:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.322484:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.325931:0:23993:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99fec34ea200:23993] 1 exiting: rc = 0 00000100:00100000:3.0:1789518405.325935:0:23992:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99fec34ea400:23992] 0 exiting: rc = 1 00000100:00100000:0.0:1789518405.326036:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326044:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326049:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326055:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326061:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326066:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326072:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326084:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326089:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326093:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326096:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326100:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326103:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326106:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326109:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326112:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326116:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326133:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326136:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326140:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326144:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326147:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326151:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326154:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326158:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326162:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326165:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326169:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326172:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326175:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326178:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326181:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326184:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326187:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326190:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326193:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326198:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326203:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326207:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326212:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326218:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326232:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326239:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326244:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326249:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326254:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326258:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326263:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326268:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326273:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326278:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326284:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326296:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326299:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326303:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326306:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326309:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326313:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326315:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326318:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326322:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326325:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326327:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518405.326332:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518405.327057:0:23994:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99ffc66c5e00:23994] 0 exiting: rc = 1 00000100:00100000:1.0:1789518405.327135:0:23995:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99ffc66c5c00:23995] 1 exiting: rc = 0 00000100:00100000:2.0:1789518405.327268:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327285:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327310:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327317:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327330:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327335:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327341:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327347:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327353:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327373:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327380:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327386:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327393:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327400:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327544:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327556:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327562:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327568:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327574:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327579:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327584:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327590:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327595:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327601:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327607:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327678:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327700:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327707:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327713:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327720:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327726:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327731:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327737:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327742:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327748:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327754:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327760:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327766:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327787:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327800:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327806:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327814:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327820:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327825:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327831:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327837:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327844:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327849:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327915:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327924:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327944:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.327951:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328024:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328030:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328036:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328042:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328048:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328053:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328060:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328066:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328072:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328077:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328090:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518405.328103:0:26517:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789518405.335413:0:26517:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789518414.332814:0:27134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789518418.758362:0:27594:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789518418.758366:0:27594:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789518418.758438:0:27594:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99fffbb6a000 00000020:01000004:1.0:1789518418.758449:0:27594:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789518418.758456:0:27594:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789518418.758466:0:27594:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99fec18cb380) 00000020:00000080:1.0:1789518418.758475:0:27594:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789518418.770081:0:27594:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789518418.772096:0:27594:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x38:0x0] (8/32) 00100000:10000000:2.0:1789518418.772686:0:27594:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789518418.772762:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:2.0:1789518418.772941:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1789518418.773047:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1789518418.773152:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:2.0:1789518418.773325:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:2.0:1789518418.773420:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1789518418.773765:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:2.0:1789518418.774883:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 390: rc = 0 00100000:10000000:2.0:1789518418.774991:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 390: rc = 0 00100000:10000000:2.0:1789518418.775958:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 398: rc = 0 00100000:10000000:2.0:1789518418.776461:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 398: rc = 0 00100000:10000000:2.0:1789518418.776919:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 398: rc = 0 00100000:10000000:2.0:1789518418.777294:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 398: rc = 0 00100000:10000000:2.0:1789518418.778010:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 398: rc = 0 00100000:10000000:2.0:1789518418.778413:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 398: rc = 0 00100000:10000000:2.0:1789518418.778691:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 398: rc = 0 00100000:10000000:2.0:1789518418.779064:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 398: rc = 0 00100000:10000000:2.0:1789518418.779307:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 398: rc = 0 00100000:10000000:2.0:1789518418.779554:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 398: rc = 0 00100000:10000000:2.0:1789518418.780407:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 398: rc = 0 00100000:10000000:2.0:1789518418.780681:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 398: rc = 0 00100000:10000000:2.0:1789518418.781117:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 166: rc = 0 00100000:10000000:2.0:1789518418.781400:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 166: rc = 0 00100000:10000000:2.0:1789518418.781682:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 166: rc = 0 00100000:10000000:2.0:1789518418.781934:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 166: rc = 0 00100000:10000000:2.0:1789518418.782178:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 166: rc = 0 00100000:10000000:2.0:1789518418.782437:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 166: rc = 0 00100000:10000000:2.0:1789518418.782721:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 166: rc = 0 00100000:10000000:2.0:1789518418.782966:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 166: rc = 0 00100000:10000000:2.0:1789518418.783371:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 166: rc = 0 00100000:10000000:2.0:1789518418.783700:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 166: rc = 0 00100000:10000000:2.0:1789518418.784021:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 166: rc = 0 00100000:10000000:2.0:1789518418.784253:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 166: rc = 0 00100000:10000000:2.0:1789518418.784498:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 166: rc = 0 00100000:10000000:2.0:1789518418.784922:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 166: rc = 0 00100000:10000000:2.0:1789518418.785154:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 166: rc = 0 00100000:10000000:2.0:1789518418.785398:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 166: rc = 0 00100000:10000000:2.0:1789518418.785716:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 166: rc = 0 00100000:10000000:2.0:1789518418.786057:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 166: rc = 0 00100000:10000000:2.0:1789518418.786296:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 166: rc = 0 00100000:10000000:2.0:1789518418.786532:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 166: rc = 0 00100000:10000000:2.0:1789518418.786933:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 166: rc = 0 00100000:10000000:2.0:1789518418.787178:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 166: rc = 0 00100000:10000000:2.0:1789518418.787411:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 166: rc = 0 00100000:10000000:2.0:1789518418.787726:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 166: rc = 0 00100000:10000000:2.0:1789518418.788055:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 166: rc = 0 00100000:10000000:2.0:1789518418.788306:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 166: rc = 0 00100000:10000000:2.0:1789518418.788491:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 166: rc = 0 00100000:10000000:2.0:1789518418.788753:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 166: rc = 0 00100000:10000000:2.0:1789518418.789027:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 166: rc = 0 00100000:10000000:2.0:1789518418.789255:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 166: rc = 0 00100000:10000000:2.0:1789518418.789485:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 166: rc = 0 00100000:10000000:2.0:1789518418.789789:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 166: rc = 0 00100000:10000000:2.0:1789518418.790188:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 155: rc = 0 00100000:10000000:2.0:1789518418.790674:0:27594:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789518418.790934:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 391: rc = 0 00100000:10000000:2.0:1789518418.791097:0:27594:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789518418.791171:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 391: rc = 0 00100000:10000000:2.0:1789518418.791351:0:27594:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789518418.791422:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 391: rc = 0 00100000:10000000:2.0:1789518418.791749:0:27594:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789518418.791795:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 395: rc = 0 00100000:10000000:2.0:1789518418.792030:0:27594:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789518418.792100:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 395: rc = 0 00100000:10000000:2.0:1789518418.792284:0:27594:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789518418.792355:0:27594:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 395: rc = 0 00000020:00000080:2.0:1789518418.792599:0:27594:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789518418.792688:0:27594:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789518418.792699:0:27594:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c783de8 00000020:01000004:2.0:1789518418.792707:0:27594:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789518418.792711:0:27594:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789518418.792717:0:27594:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99fffbb6a000 from MGS 00000020:01000004:2.0:1789518418.792720:0:27594:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789518418.792730:0:27594:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99fff783cd40) 00000020:00000080:2.0:1789518418.792739:0:27594:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789518418.792793:0:27594:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fffbb6a000 from MGS, refs=2 00080000:01000000:2.0:1789518418.792798:0:27594:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789518418.792884:0:27594:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c783df6 00000100:00100000:2.0:1789518418.792984:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789518418.793116:0:27594:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789518418.793123:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789518418.793780:0:27594:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789518418.793786:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789518418.794550:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518418.795047:0:27594:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789518418.795060:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789518418.795563:0:27594:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789518418.795570:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789518418.796028:0:27594:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789518418.796035:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789518418.796745:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518418.796748:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518418.796749:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518418.797025:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518418.797027:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518418.797029:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518418.797508:0:27594:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789518418.798699:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789518418.811427:0:27594:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789518418.811442:0:27594:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789518418.811445:0:27594:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789518418.814269:0:27603:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789518418.814445:0:27594:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789518418.814575:0:27594:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789518418.816026:0:27594:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789518418.816372:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518418.816524:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789518418.816529:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789518418.817910:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789518418.817920:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789518418.818398:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789518418.818406:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1789518418.819454:0:27608:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1789518418.819465:0:27594:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789518418.819707:0:27594:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.151@tcp' 00000020:01000004:3.0:1789518418.819709:0:27594:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789518418.819743:0:27594:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.151@tcp (typ=mgc) 00000020:00000080:3.0:1789518418.819756:0:27594:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.151@tcp (ffff99fec2aa3380) 00000020:00000080:3.0:1789518418.819772:0:27594:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789518418.819853:0:27594:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fffc79e000@MGC192.168.206.151@tcp: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518418.820000:0:27594:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.151@tcp-0 is initialized 00000040:01000000:3.0:1789518418.820005:0:27594:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789518418.821192:0:27609:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789518418.821248:0:27594:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.151@tcp (uuid ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5) 00000020:00000080:3.0:1789518418.821270:0:27594:0:(genops.c:1384:class_connect()) connect: client ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5, cookie 0x631fd8698c783e04 00000100:00080000:3.0:1789518418.821281:0:27594:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518418.821291:0:27594:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99fffc79e000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518418.821319:0:27594:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffefff0000 x1876445627568768/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518418.821377:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3279:1876445627568768:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789518418.821436:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518418.821515:0:27594:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS 00000020:01000004:3.0:1789518418.821535:0:27594:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789518418.821567:0:27594:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789518418.821580:0:27594:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99fec2aa4d40) 00000100:00100000:1.0:1789518418.821589:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627568768 00000020:00000080:3.0:1789518418.821592:0:27594:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789518418.821599:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627568768 00000100:00100000:1.0:1789518418.821663:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518418.821671:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3279:x1876445627568768:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789518418.821693:0:27605:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1789518418.821722:0:27605:0:(genops.c:1384:class_connect()) connect: client ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5, cookie 0x631fd8698c783e12 00000100:00080000:1.0:1789518418.821839:0:27605:0:(import.c:65:import_set_state_nolock()) ffff99fffbb6c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518418.823790:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+5:3279:x1876445627568768:12345-0@lo:250:mount.lustre.0 Request processed in 2110us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518418.823803:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518418.824785:0:3279:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789518418.824798:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1789518418.824806:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789518418.824812:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789518418.824816:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fffc79e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789518418.824819:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789518418.824835:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789518418.824843:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3279:1876445627568768:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789518418.830332:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518418.830577:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789518418.830585:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789518418.831365:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789518418.831373:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789518418.835131:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789518418.835143:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789518418.837233:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518418.837402:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789518418.837409:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789518418.838011:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789518418.838019:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789518418.869325:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518418.869513:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789518418.869519:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789518418.870797:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789518418.870808:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789518418.871353:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518418.871520:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789518418.871525:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789518418.872191:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789518418.872198:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789518418.872928:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518418.873076:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789518418.873081:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789518418.873443:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789518418.873449:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789518418.874196:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518418.874330:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789518418.874335:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789518418.874802:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789518418.874809:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789518418.888389:0:27594:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518418.888591:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789518418.888599:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789518418.890090:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789518418.890100:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789518418.891002:0:27594:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789518418.891011:0:27594:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789518418.891875:0:27594:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789518418.891898:0:27594:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789518418.891910:0:27594:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789518418.892021:0:27594:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789518418.892051:0:27594:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789518418.892055:0:27594:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789518418.892057:0:27594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518418.892058:0:27594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518418.892060:0:27594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518418.892061:0:27594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518418.892062:0:27594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518418.892063:0:27594:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518418.892065:0:27594:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518418.892067:0:27594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518418.892068:0:27594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518418.892070:0:27594:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789518418.892072:0:27594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518418.892074:0:27594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518418.892075:0:27594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518418.892076:0:27594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518418.892077:0:27594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518418.892078:0:27594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518418.892079:0:27594:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518418.892080:0:27594:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518418.892081:0:27594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518418.892082:0:27594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518418.892105:0:27594:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789518418.892123:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627568896:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518418.892186:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518418.892280:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518418.892367:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627568896 00000100:00100000:0.0:1789518418.892374:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627568896 00000100:00100000:0.0:1789518418.892454:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518418.892464:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+5:27594:x1876445627568896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789518418.892499:0:27607:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789518418.892502:0:27607:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789518418.892505:0:27607:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789518418.892902:0:27628:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789518418.893215:0:27607:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 14 20000000:01000000:3.0:1789518418.894123:0:27629:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789518418.894128:0:27629:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789518418.894131:0:27629:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789518418.894167:0:27629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789518418.894371:0:27607:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789518418.894379:0:27607:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789518418.901261:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+5:27594:x1876445627568896:12345-0@lo:253:mount.lustre.0 Request processed in 8790us (9065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518418.901279:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518418.901455:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627568896:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789518418.901469:0:27594:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789518418.901473:0:27594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518418.901475:0:27594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789518418.901476:0:27594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518418.901477:0:27594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518418.901478:0:27594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518418.901479:0:27594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518418.901481:0:27594:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789518418.901482:0:27594:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789518418.901484:0:27594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518418.901485:0:27594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789518418.901502:0:27594:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99fffbb6a000 from lustre-MDT0000 10000000:01000000:3.0:1789518418.901535:0:27594:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789518418.901537:0:27594:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789518418.901541:0:27594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99fec2aa3380 10000000:01000000:3.0:1789518418.901545:0:27594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518418.901553:0:27594:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99fec2aa3380 from 1 10000000:01000000:3.0:1789518418.901555:0:27594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789518418.901589:0:27594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.901600:0:27594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.901686:0:27594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518418.901706:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518418.901809:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518418.901880:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518418.901918:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627569024 00000100:00100000:1.0:1789518418.901924:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627569024 00000100:00100000:1.0:1789518418.901998:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518418.902008:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+5:27594:x1876445627569024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518418.902019:0:27606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518418.902034:0:27606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b44e00/0x631fd8698c783e20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783e19 expref: -99 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518418.902067:0:27606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b44e00/0x631fd8698c783e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783e19 expref: 6 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518418.902077:0:27606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b44e00/0x631fd8698c783e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783e19 expref: 6 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518418.902086:0:27606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44e00, rc 0) 00000100:00100000:1.0:1789518418.902125:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+6:27594:x1876445627569024:12345-0@lo:101:mount.lustre.0 Request processed in 119us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518418.902131:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518418.902190:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518418.902203:0:27594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.902212:0:27594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518418.902257:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518418.902282:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518418.902402:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518418.902470:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627569152 00000100:00100000:2.0:1789518418.902475:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627569152 00000100:00100000:2.0:1789518418.902496:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518418.902502:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+6:27594:x1876445627569152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518418.902738:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+6:27594:x1876445627569152:12345-0@lo:501:mount.lustre.0 Request processed in 235us (454us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518418.902754:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518418.902899:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569152:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789518418.902933:0:27594:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789518418.902945:0:27594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.902954:0:27594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518418.902962:0:27594:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99fffbb6a000 10000000:01000000:3.0:1789518418.902966:0:27594:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789518418.902969:0:27594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99fffbb6a000 10000000:01000000:3.0:1789518418.902972:0:27594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789518418.902974:0:27594:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99fffbb6a000 from 1 10000000:01000000:3.0:1789518418.902977:0:27594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789518418.902993:0:27594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.903000:0:27594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.903008:0:27594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518418.903022:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518418.903047:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518418.903066:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518418.903122:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627569280 00000100:00100000:2.0:1789518418.903126:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627569280 00000100:00100000:2.0:1789518418.903145:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518418.903152:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+6:27594:x1876445627569280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518418.903223:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518418.903235:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17400/0x631fd8698c783e2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783e27 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518418.903250:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17400/0x631fd8698c783e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783e27 expref: 7 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518418.903258:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17400/0x631fd8698c783e2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783e27 expref: 7 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518418.903265:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:2.0:1789518418.903304:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+7:27594:x1876445627569280:12345-0@lo:101:mount.lustre.0 Request processed in 152us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518418.903310:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518418.903374:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518418.903385:0:27594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.903404:0:27594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518418.903416:0:27594:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789518418.903430:0:27594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.903437:0:27594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518418.903443:0:27594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789518418.903447:0:27594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518418.903451:0:27594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99fffbb6a000 10000000:01000000:3.0:1789518418.903453:0:27594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789518418.903456:0:27594:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789518418.903458:0:27594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789518418.903471:0:27594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.903477:0:27594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.903484:0:27594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518418.903496:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518418.903520:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518418.903532:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518418.903590:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627569408 00000100:00100000:2.0:1789518418.903594:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627569408 00000100:00100000:2.0:1789518418.903647:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518418.903654:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+7:27594:x1876445627569408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518418.903661:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518418.903669:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17200/0x631fd8698c783e3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783e35 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518418.903683:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17200/0x631fd8698c783e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783e35 expref: 8 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518418.903698:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17200/0x631fd8698c783e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783e35 expref: 8 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518418.903705:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:2.0:1789518418.903850:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+8:27594:x1876445627569408:12345-0@lo:101:mount.lustre.0 Request processed in 195us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518418.903856:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518418.903921:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518418.903931:0:27594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.903939:0:27594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518418.903975:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518418.904000:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518418.904026:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518418.904078:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627569536 00000100:00100000:1.0:1789518418.904082:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627569536 00000100:00100000:1.0:1789518418.904103:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518418.904109:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+8:27594:x1876445627569536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518418.904525:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+9:27594:x1876445627569536:12345-0@lo:501:mount.lustre.0 Request processed in 416us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518418.904532:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518418.904925:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518418.904954:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518418.904995:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518418.905058:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518418.905088:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627569664 00000100:00100000:1.0:1789518418.905093:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627569664 00000100:00100000:1.0:1789518418.905225:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518418.905232:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+9:27594:x1876445627569664:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518418.905548:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+9:27594:x1876445627569664:12345-0@lo:503:mount.lustre.0 Request processed in 315us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518418.905555:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518418.905690:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627569664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518418.906088:0:27630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27630:1876445627569792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518418.906127:0:27630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518418.906252:0:27630:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518418.906355:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627569792 00000100:00100000:1.0:1789518418.906360:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627569792 00000100:00100000:1.0:1789518418.906399:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518418.906407:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+9:27630:x1876445627569792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518418.906664:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+9:27630:x1876445627569792:12345-0@lo:502:llog_process_th.0 Request processed in 257us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518418.906672:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518418.906712:0:27630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27630:1876445627569792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518418.906879:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518418.906890:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.906892:0:27630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789518418.906900:0:27630:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789518418.906903:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518418.906916:0:27630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99fec18c8000) 00000020:00000080:1.0:1789518418.906932:0:27630:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789518418.906937:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789518418.906996:0:27630:0:(osd_handler.c:1614:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789518418.907002:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c783e4a 00000020:00000080:1.0:1789518418.907265:0:27630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789518418.907270:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518418.907273:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.907275:0:27630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789518418.907278:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518418.907281:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.907283:0:27630:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789518418.907286:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518418.907293:0:27630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99fec18c99c0) 00000020:00000080:1.0:1789518418.907302:0:27630:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789518418.907306:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789518418.907308:0:27630:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789518418.907310:0:27630:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789518418.907316:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789518418.907485:0:27630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fffbb6a000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789518418.907497:0:27630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99fec18ccd40) 00000020:00000080:1.0:1789518418.907506:0:27630:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789518418.907556:0:27630:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789518418.907562:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c783e5f 00000020:00000080:1.0:1789518418.907844:0:27630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789518418.907851:0:27630:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789518418.907856:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x631fd8698c783e66 00080000:01000000:1.0:1789518418.907861:0:27630:0:(osd_handler.c:1614:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789518418.907865:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c783e6d 00010000:00010000:0.0:1789518418.959146:0:27630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789518418.959598:0:27630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 17179869274 00000001:00080000:0.0:1789518418.959937:0:27630:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789518418.960663:0:27630:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99fffee299c0) 00000020:00000080:0.0:1789518418.960680:0:27630:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789518418.960747:0:27630:0:(osd_handler.c:1614:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789518418.960753:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c783e7b 00000020:00000080:1.0:1789518418.961321:0:27630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789518418.967044:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x631fd8698c783e82 00000020:00000080:1.0:1789518418.967526:0:27630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789518418.967536:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518418.967542:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.967544:0:27630:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789518418.967547:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518418.967552:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.967554:0:27630:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789518418.967558:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789518418.967588:0:27630:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789518418.967640:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518418.967643:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.967645:0:27630:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789518418.967648:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789518418.967650:0:27630:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1789518418.967652:0:27630:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518418.967653:0:27630:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518418.967655:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789518418.967657:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.967658:0:27630:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789518418.967660:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789518418.967663:0:27630:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789518418.967666:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.967674:0:27630:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789518418.967677:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789518418.967682:0:27630:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1789518418.967705:0:27630:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789518418.967708:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518418.967794:0:27630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99ffee0619c0) 00000020:00000080:1.0:1789518418.967810:0:27630:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789518418.967816:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789518418.967862:0:27630:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789518418.967867:0:27630:0:(osd_handler.c:1614:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789518418.967872:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c783e90 00010000:00080000:1.0:1789518418.967899:0:27630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffc6bdb800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1789518418.968118:0:27630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789518418.968498:0:27630:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789518418.968542:0:27630:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789518418.972039:0:27630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518418.972109:0:27630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].5, 64 off8512 00000040:00080000:1.0:1789518418.972980:0:27630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].1, 64 off8256 00000040:00080000:1.0:1789518418.974830:0:27634:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1789518418.974837:0:27634:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1c:0x0] at index 5 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789518418.977692:0:27630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789518418.977705:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789518418.977747:0:27630:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789518418.977765:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c783e97 00000100:00080000:1.0:1789518418.977774:0:27630:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518418.977786:0:27630:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffc6bdb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518418.977819:0:27630:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd100aa00 x1876445627569920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518418.977838:0:27630:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789518418.977888:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518418.977904:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.977906:0:27630:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789518418.977910:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789518418.977913:0:27630:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789518418.977914:0:27630:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518418.977916:0:27630:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518418.977917:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789518418.977920:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.977922:0:27630:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789518418.977924:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789518418.977928:0:27630:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789518418.977931:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.977932:0:27630:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789518418.977935:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789518418.977938:0:27630:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1789518418.977957:0:27630:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789518418.977960:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518418.977970:0:27630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99ffee060000) 00000020:00000080:1.0:1789518418.977981:0:27630:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789518418.977986:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789518418.978034:0:27630:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789518418.978040:0:27630:0:(osd_handler.c:1614:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789518418.978045:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c783ea5 00010000:00080000:1.0:1789518418.978072:0:27630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffedb76000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1789518418.978282:0:27630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789518418.978454:0:27630:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789518418.978475:0:27630:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789518418.978998:0:27630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518418.979056:0:27630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].5, 64 off8512 00000040:00080000:1.0:1789518418.979123:0:27630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].1, 64 off8256 00000100:00100000:0.0:1789518418.979334:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627569920:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789518418.979377:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627569920 offset 0 length 520: 4 00000040:00080000:0.0:1789518418.979876:0:27636:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1789518418.979881:0:27636:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 5 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789518418.980534:0:27630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789518418.980545:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789518418.980573:0:27630:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789518418.980591:0:27630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c783eac 00000100:00080000:2.0:1789518418.980629:0:27630:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518418.980638:0:27630:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffedb76000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518418.980666:0:27630:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffffe5a300 x1876445627570048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518418.980690:0:27630:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789518418.980820:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627570048:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789518418.980855:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627570048 offset 0 length 520: 4 00000020:01000000:2.0:1789518418.980959:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518418.980964:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518418.980966:0:27630:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789518418.980969:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518418.980973:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518418.980975:0:27630:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789518418.980977:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789518418.980979:0:27630:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789518418.980981:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518418.980983:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518418.980984:0:27630:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789518418.980987:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518418.980989:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518418.980995:0:27630:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789518418.981000:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789518418.981026:0:27630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27630:1876445627570176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518418.981071:0:27630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518418.981332:0:27630:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1789518418.982011:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627570176 00000100:00100000:0.0:1789518418.982018:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627570176 00000100:00100000:0.0:1789518418.982061:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518418.982069:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+9:27630:x1876445627570176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518418.982306:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+9:27630:x1876445627570176:12345-0@lo:502:llog_process_th.0 Request processed in 236us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518418.982314:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518418.982405:0:27630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27630:1876445627570176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789518418.982434:0:27630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518418.982439:0:27630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518418.982441:0:27630:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789518418.982445:0:27630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789518418.982636:0:27594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789518418.982656:0:27594:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789518418.982671:0:27594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.982682:0:27594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518418.982689:0:27594:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99fffbb6a000 from 1 10000000:01000000:0.0:1789518418.982692:0:27594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518418.982868:0:27594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.982878:0:27594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.982887:0:27594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518418.982903:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518418.982934:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518418.982971:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063900 going to sleep for 11 seconds 00000100:00100000:2.0:1789518418.983025:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627570304 00000100:00100000:2.0:1789518418.983030:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627570304 00000100:00100000:2.0:1789518418.983063:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518418.983071:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+9:27594:x1876445627570304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518418.983079:0:27607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518418.983092:0:27607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783eb3 expref: -99 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518418.983109:0:27607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783eb3 expref: 10 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518418.983118:0:27607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783eb3 expref: 10 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518418.983125:0:27607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:2.0:1789518418.983162:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+10:27594:x1876445627570304:12345-0@lo:101:mount.lustre.0 Request processed in 93us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518418.983168:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518418.983228:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518418.983240:0:27594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.983249:0:27594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518418.983851:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570432:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789518418.983890:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518418.983908:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518418.983962:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627570432 00000100:00100000:2.0:1789518418.983970:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627570432 00000100:00100000:2.0:1789518418.983998:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518418.984003:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+10:27594:x1876445627570432:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789518418.984015:0:27605:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789518418.984020:0:27605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789518418.984071:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+10:27594:x1876445627570432:12345-0@lo:256:mount.lustre.0 Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518418.984077:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518418.984136:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570432:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789518418.984659:0:27594:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518418.984671:0:27594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.984681:0:27594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518418.984688:0:27594:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fffbb6a000 from 1 10000000:01000000:3.0:1789518418.984691:0:27594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518418.984709:0:27594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.984716:0:27594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518418.985023:0:27594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518418.985038:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518418.985071:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518418.985101:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518418.985143:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627570560 00000100:00100000:0.0:1789518418.985147:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627570560 00000100:00100000:0.0:1789518418.985179:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518418.985185:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+10:27594:x1876445627570560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518418.985193:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518418.985206:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783ec1 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.985224:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783ec1 expref: 11 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.985232:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783ec1 expref: 11 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.985240:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c600, rc 0) 00000100:00100000:0.0:1789518418.985290:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27594:x1876445627570560:12345-0@lo:101:mount.lustre.0 Request processed in 105us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518418.985297:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518418.985377:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518418.985390:0:27594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518418.985405:0:27594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518418.985452:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518418.985478:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518418.985500:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518418.985546:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627570688 00000100:00100000:3.0:1789518418.985551:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627570688 00000100:00100000:3.0:1789518418.985580:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518418.985587:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27594:x1876445627570688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518418.986024:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27594:x1876445627570688:12345-0@lo:501:mount.lustre.0 Request processed in 437us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518418.986032:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518418.986171:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518418.986210:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518418.986245:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518418.986272:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518418.986312:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627570816 00000100:00100000:3.0:1789518418.986316:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627570816 00000100:00100000:3.0:1789518418.986368:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518418.986374:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27594:x1876445627570816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518418.986500:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27594:x1876445627570816:12345-0@lo:503:mount.lustre.0 Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518418.986507:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518418.986540:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627570816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518418.986874:0:27638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27638:1876445627570944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518418.986910:0:27638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518418.986936:0:27638:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc91843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518418.986994:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627570944 00000100:00100000:0.0:1789518418.986999:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627570944 00000100:00100000:0.0:1789518418.987061:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518418.987069:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27638:x1876445627570944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518418.987261:0:27638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27638:1876445627570944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518418.987283:0:27638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518418.987291:0:27638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.987294:0:27638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789518418.987300:0:27638:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fffbb6a000 00000020:00000080:1.0:1789518418.987303:0:27638:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518418.987317:0:27638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518418.987320:0:27638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.987321:0:27638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789518418.987323:0:27638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518418.987326:0:27638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.987327:0:27638:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789518418.987331:0:27638:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fffbb6a000 00000020:00000080:1.0:1789518418.987338:0:27638:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518418.987386:0:27638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518418.987390:0:27638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.987391:0:27638:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789518418.987393:0:27638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518418.987395:0:27638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.987396:0:27638:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789518418.987399:0:27638:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99fffbb6a000 00000020:00000080:1.0:1789518418.987401:0:27638:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789518418.987429:0:27638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27638:1876445627571072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518418.987464:0:27638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518418.987660:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27638:x1876445627570944:12345-0@lo:502:llog_process_th.0 Request processed in 591us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518418.987668:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789518418.987803:0:27638:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc91843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518418.987988:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627571072 00000100:00100000:0.0:1789518418.987993:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627571072 00000100:00100000:0.0:1789518418.988012:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518418.988018:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27638:x1876445627571072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518418.988174:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27638:x1876445627571072:12345-0@lo:502:llog_process_th.0 Request processed in 155us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518418.988181:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789518418.988262:0:27638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27638:1876445627571072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789518418.988284:0:27638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518418.988289:0:27638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518418.988291:0:27638:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789518418.988294:0:27638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789518418.988453:0:27594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789518418.988473:0:27594:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518418.988495:0:27594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.988505:0:27594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518418.988539:0:27594:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789518418.988542:0:27594:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99fffbb6a000 10000000:01000000:0.0:1789518418.988545:0:27594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99fffbb6a000 10000000:01000000:0.0:1789518418.988549:0:27594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789518418.988554:0:27594:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99fffbb6a000 from 1 10000000:01000000:0.0:1789518418.988556:0:27594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518418.988584:0:27594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.988592:0:27594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.988610:0:27594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518418.988648:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627571200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518418.988673:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518418.988689:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518418.988701:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627571200 00000100:00100000:0.0:1789518418.988704:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627571200 00000100:00100000:0.0:1789518418.988856:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518418.988864:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27594:x1876445627571200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518418.988872:0:27606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518418.988883:0:27606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28ca00/0x631fd8698c783ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783ecf expref: -99 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.988901:0:27606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28ca00/0x631fd8698c783ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783ecf expref: 12 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.988910:0:27606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28ca00/0x631fd8698c783ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783ecf expref: 12 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518418.988918:0:27606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28ca00, rc 0) 00000100:00100000:0.0:1789518418.988960:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27594:x1876445627571200:12345-0@lo:101:mount.lustre.0 Request processed in 97us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518418.988966:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518418.989039:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627571200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518418.989051:0:27594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518418.989060:0:27594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518418.989101:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627571328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518418.989124:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518418.989154:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc91843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518418.989203:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627571328 00000100:00100000:0.0:1789518418.989208:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627571328 00000100:00100000:0.0:1789518418.989226:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518418.989231:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27594:x1876445627571328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518418.989430:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27594:x1876445627571328:12345-0@lo:501:mount.lustre.0 Request processed in 198us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518418.989437:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789518418.989507:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627571328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518418.989539:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627571456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518418.989573:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518418.989679:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc91843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518418.989845:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627571456 00000100:00100000:3.0:1789518418.989850:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627571456 00000100:00100000:3.0:1789518418.989906:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789518418.989913:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27594:x1876445627571456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518418.990039:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27594:x1876445627571456:12345-0@lo:503:mount.lustre.0 Request processed in 127us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518418.990045:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789518418.990104:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627571456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518418.991333:0:27639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27639:1876445627571584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518418.991382:0:27639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518418.991452:0:27639:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc865bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518418.994355:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627571584 00000100:00100000:3.0:1789518418.994368:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627571584 00000100:00100000:3.0:1789518418.994424:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518418.994434:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27639:x1876445627571584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518418.994722:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27639:x1876445627571584:12345-0@lo:502:llog_process_th.0 Request processed in 290us (3338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518418.994730:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789518418.996731:0:27639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27639:1876445627571584:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789518418.996804:0:27639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789518418.996818:0:27639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99fff7838000) 00000020:00000080:2.0:1789518418.996836:0:27639:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789518418.996915:0:27639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fffbb6a000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789518418.996919:0:27639:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fffbb6a000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789518418.996922:0:27639:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fffbb6a000 4 00010000:00080000:2.0:1789518418.996951:0:27639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fff4013000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1789518418.999873:0:27639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789518419.000063:0:27639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789518419.000105:0:27639:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789518419.000119:0:27639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x631fd8698c783ee4 00000100:00080000:2.0:1789518419.000127:0:27639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518419.000137:0:27639:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99fff4013000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518419.000168:0:27639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffffe5b800 x1876445627571712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518419.002550:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627571712:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789518419.003338:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518419.003440:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627571712 00000100:00100000:2.0:1789518419.003449:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627571712 00000100:00100000:2.0:1789518419.003483:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518419.003490:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627571712:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789518419.003546:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627571712:12345-0@lo:38:llog_process_th.0 Request processed in 55us (212us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789518419.003553:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518419.003591:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789518419.003598:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fff4013000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518419.003633:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789518419.003638:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627571712:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789518419.003669:0:27639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789518419.003860:0:27639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27639:1876445627571840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518419.003904:0:27639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518419.003926:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627571840 00000100:00100000:2.0:1789518419.003930:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627571840 00000100:00100000:2.0:1789518419.003956:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789518419.003962:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27639:x1876445627571840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518419.004194:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27639:x1876445627571840:12345-0@lo:502:llog_process_th.0 Request processed in 231us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518419.005957:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789518419.006033:0:27639:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc865b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518419.006057:0:27639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27639:1876445627571840:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789518419.006096:0:27639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789518419.006356:0:27594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789518419.006377:0:27594:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518419.006393:0:27594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518419.006406:0:27594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518419.006451:0:27594:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518419.006453:0:27594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518419.006454:0:27594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518419.006455:0:27594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518419.006456:0:27594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518419.006458:0:27594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518419.006459:0:27594:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518419.006460:0:27594:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518419.006462:0:27594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518419.006463:0:27594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518419.006467:0:27594:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789518419.006469:0:27594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518419.006470:0:27594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518419.006471:0:27594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518419.006472:0:27594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518419.006473:0:27594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518419.006474:0:27594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518419.006475:0:27594:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518419.006476:0:27594:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518419.006477:0:27594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518419.006478:0:27594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518419.006501:0:27594:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789518419.006516:0:27594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627571968:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518419.006566:0:27594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518419.006590:0:27594:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518419.006757:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627571968 00000100:00100000:2.0:1789518419.006764:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627571968 00000100:00100000:2.0:1789518419.006799:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518419.006808:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27594:x1876445627571968:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789518419.006832:0:27605:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789518419.006844:0:27605:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789518419.045646:0:27605:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789518419.045659:0:27605:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789518419.045713:0:27628:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789518419.045719:0:27628:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789518419.045754:0:27628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.045771:0:27628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783eb3 expref: 12 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.045779:0:27628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.045819:0:27628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c783eb3 expref: 12 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.045836:0:27628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c783eb3 expref: 12 pid: 27607 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518419.045850:0:27628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27628:1876445627572096:0@lo:104: 00000100:00100000:3.0:1789518419.045907:0:27628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518419.045956:0:27628:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc865b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518419.046105:0:27595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627572096 00000100:00100000:1.0:1789518419.046113:0:27595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627572096 00000100:00100000:1.0:1789518419.047031:0:27595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518419.047047:0:27595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:27628:x1876445627572096:12345-0@lo:104: 00010000:00010000:1.0:1789518419.047061:0:27595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518419.047135:0:27595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518419.047146:0:27595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:27628:x1876445627572096:12345-0@lo:104: Request processed in 105us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518419.047203:0:27628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27628:1876445627572096:0@lo:104: 00010000:00010000:3.0:1789518419.047222:0:27628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518419.048361:0:27595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789518419.048388:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518419.048394:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518419.048403:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28dc00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518419.048407:0:27601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518419.048416:0:27601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518419.048423:0:27601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518419.048429:0:27601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518419.048479:0:27601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518419.048486:0:27601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789518419.048552:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627572224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518419.048593:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518419.048725:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627572224 00010000:00010000:1.0:1789518419.048729:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518419.048731:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627572224 00010000:00010000:1.0:1789518419.048736:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc28dc00/0x631fd8698c783eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783eba expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048751:0:27597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783eb3 expref: 13 pid: 27607 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518419.048770:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518419.048784:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+13:3282:x1876445627572224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518419.048795:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518419.048796:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518419.048797:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518419.048799:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518419.048800:0:27597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783eb3 expref: 13 pid: 27607 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048810:0:27597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c783eb3 expref: 13 pid: 27607 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048823:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16400/0x631fd8698c783eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c783eb3 expref: 13 pid: 27607 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048835:0:27597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048842:0:27597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789518419.048855:0:27597:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003136568s 00010000:00010000:3.0:1789518419.048859:0:27597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048865:0:27597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048871:0:27597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048877:0:27597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048881:0:27597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518419.048890:0:27597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048897:0:27597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048919:0:27597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518419.048929:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518419.048962:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:3282:x1876445627572224:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518419.048968:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789518419.049107:0:27628:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518419.049118:0:27628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518419.049125:0:27628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783eeb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518419.049381:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627572224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518419.053165:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27594:x1876445627571968:12345-0@lo:253:mount.lustre.0 Request processed in 46351us (46592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518419.053177:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789518419.053229:0:27594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27594:1876445627571968:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518419.053241:0:27594:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789518419.053243:0:27594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518419.053245:0:27594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518419.053246:0:27594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518419.053247:0:27594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518419.053249:0:27594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518419.053250:0:27594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518419.053251:0:27594:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518419.053253:0:27594:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518419.053254:0:27594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518419.053256:0:27594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789518419.053269:0:27594:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789518419.063824:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518419.063930:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518419.064136:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518419.064289:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518419.064525:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518419.064692:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518419.065471:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518419.065669:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518419.065895:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518419.066044:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518419.066291:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518419.066450:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789518419.090489:0:27594:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 12884902055 00000040:01000000:3.0:1789518419.090910:0:27594:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789518419.090939:0:27651:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 12884902055 00000020:00080000:1.0:1789518419.090944:0:27651:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902055 00000040:01000000:1.0:1789518419.091652:0:27652:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789518419.091740:0:27652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789518419.093267:0:27594:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789518419.093381:0:27594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789518419.093822:0:27594:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789518419.093829:0:27594:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789518419.093943:0:27594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518419.094826:0:27594:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789518419.096994:0:27594:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789518419.097148:0:27594:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789518419.097591:0:27594:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 3, last_idx 4 00080000:10000000:2.0:1789518419.098336:0:27594:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/8/4) registered 00000040:00080000:1.0:1789518419.098584:0:27652:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789518419.098673:0:27652:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789518419.098678:0:27652:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00000004:2.0:1789518419.102503:0:27594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836480 00000001:00080000:1.0:1789518419.125689:0:27594:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789518419.125728:0:27594:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa50841a07988 00100000:10000000:1.0:1789518419.125736:0:27594:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789518419.126120:0:27594:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789518419.126147:0:27594:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789518419.126163:0:27594:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789518419.126224:0:27594:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789518419.826873:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518420.018951:0:27646:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1789518420.018960:0:27646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518420.020305:0:27646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:3.0:1789518420.020321:0:27646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 10000000:01000000:2.0:1789518420.210785:0:27609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789518420.210792:0:27609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99fffbb6a000 from 15 10000000:01000000:2.0:1789518420.210798:0:27609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789518420.210850:0:27609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518420.210862:0:27609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518420.210873:0:27609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518420.210898:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627572352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518420.210960:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518420.210993:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627572352 00000100:00100000:1.0:1789518420.211002:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627572352 00000100:00100000:2.0:1789518420.211007:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518420.211102:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518420.211112:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27609:x1876445627572352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518420.211125:0:27606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518420.211137:0:27606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783ef2 expref: -99 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518420.211159:0:27606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783ef2 expref: 12 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518420.211170:0:27606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783ef2 expref: 12 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518420.211178:0:27606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44400, rc 0) 00000100:00100000:1.0:1789518420.211224:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27609:x1876445627572352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518420.211240:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789518420.211319:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627572352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518420.211333:0:27609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518420.211343:0:27609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518420.211390:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627572480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789518420.211423:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518420.211450:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518420.211520:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627572480 00000100:00100000:3.0:1789518420.211525:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627572480 00000100:00100000:3.0:1789518420.211557:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518420.211564:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27609:x1876445627572480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789518420.211576:0:27605:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789518420.211592:0:27605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789518420.211605:0:27605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 15 00000100:00100000:3.0:1789518420.211697:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27609:x1876445627572480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518420.211705:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789518420.211936:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627572480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789518420.211976:0:27609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789518420.211982:0:27609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518420.211990:0:27609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518420.851152:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518421.043687:0:27646:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1789518421.043694:0:27646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518421.043732:0:27646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:0.0:1789518421.043738:0:27646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000001:02000400:0.0:1789518421.293470:0:27894:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789518421.875773:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518422.900652:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789518423.266520:0:28046:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda75fe6b0 20000000:00000080:0.0:1789518423.266544:0:28046:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffee0bfc00 uarg=0000000000000000 20000000:01000000:0.0:1789518423.266599:0:28046:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789518423.266609:0:28046:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789518423.266725:0:28046:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789518423.268100:0:28047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1789518423.268251:0:28046:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789518423.273808:0:28046:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789518423.273841:0:28046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.273858:0:28046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783ec1 expref: 11 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.273866:0:28046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.273914:0:28046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c783ec1 expref: 11 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.273931:0:28046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c783ec1 expref: 11 pid: 27605 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518423.273945:0:28046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28046:1876445627572608:0@lo:104: 00000100:00100000:0.0:1789518423.274026:0:28046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518423.274154:0:28046:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfdfde40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518423.274203:0:27596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627572608 00000100:00100000:2.0:1789518423.274210:0:27596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627572608 00000100:00100000:2.0:1789518423.274259:0:27596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518423.274270:0:27596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:28046:x1876445627572608:12345-0@lo:104: 00010000:00010000:2.0:1789518423.274284:0:27596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518423.274389:0:27596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518423.274395:0:27596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:28046:x1876445627572608:12345-0@lo:104: Request processed in 128us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518423.274402:0:27596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518423.274466:0:28046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28046:1876445627572608:0@lo:104: 00010000:00010000:0.0:1789518423.274484:0:28046:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518423.274650:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518423.274930:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518423.274948:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518423.274953:0:27600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518423.274963:0:27600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518423.274970:0:27600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518423.274975:0:27600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789518423.275066:0:27600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518423.275071:0:27600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789518423.275125:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789518423.275601:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518423.275611:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bda00/0x631fd8698c783ec1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783ec8 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518423.275785:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627572736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518423.275832:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518423.275852:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518423.275855:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518423.275858:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518423.275983:0:27599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627572736 00000100:00100000:0.0:1789518423.275991:0:27599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627572736 00010000:00010000:0.0:1789518423.276014:0:27599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783ec1 expref: 12 pid: 27605 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518423.276080:0:27599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518423.276089:0:27599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:3282:x1876445627572736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518423.276101:0:27599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518423.276105:0:27599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783ec1 expref: 12 pid: 27605 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276116:0:27599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c783ec1 expref: 12 pid: 27605 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276131:0:27599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c600/0x631fd8698c783ec8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c783ec1 expref: 12 pid: 27605 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276157:0:27599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276178:0:27599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276193:0:27599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276200:0:27599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276206:0:27599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276212:0:27599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276217:0:27599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518423.276221:0:27599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276228:0:27599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276250:0:27599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518423.276259:0:27599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518423.276314:0:27599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:3282:x1876445627572736:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518423.276327:0:27599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789518423.276388:0:28046:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518423.276403:0:28046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518423.276408:0:28046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c200/0x631fd8698c783f00 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518423.276504:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627572736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518423.925760:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518424.178896:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518424.178903:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518424.178905:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518424.178908:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518424.178910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789518424.178913:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789518424.178916:0:36:0:(import.c:65:import_set_state_nolock()) ffff99fff4013000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518424.178932:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99fff4013000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518424.178964:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffefff0e00 x1876445627572992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518424.179066:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3280:1876445627572864:0@lo:400:kworker.0 00000100:00100000:0.0:1789518424.179141:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518424.179271:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627572864 00000100:00100000:3.0:1789518424.179278:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627572864 00000100:00100000:3.0:1789518424.179323:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518424.179333:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:3280:x1876445627572864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518424.179384:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:3280:x1876445627572864:12345-0@lo:400:kworker.0 Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518424.179391:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518424.179434:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3280:1876445627572864:0@lo:400:kworker.0 00000100:00100000:2.0:1789518424.179656:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627572992:0@lo:38:kworker.0 00000100:00100000:2.0:1789518424.179687:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518424.179762:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627572992 00000100:00100000:0.0:1789518424.179767:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627572992 00000100:00100000:0.0:1789518424.179795:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518424.179800:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627572992:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789518424.179820:0:27614:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1789518424.179853:0:27614:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x631fd8698c783f07 00000004:00100000:0.0:1789518424.179866:0:27614:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789518424.179991:0:27614:0:(import.c:65:import_set_state_nolock()) ffff99ffd1032000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518424.180045:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876445627572992:12345-0@lo:38:kworker.0 Request processed in 243us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518424.180052:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789518424.180145:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffefff0e00 x1876445627572992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789518424.180158:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 5 00000100:00080000:2.0:1789518424.180164:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789518424.180169:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789518424.180171:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fff4013000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789518424.180175:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627572992:0@lo:38:kworker.0 10000000:01000000:3.0:1789518424.818692:0:27609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518424.818701:0:27609:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fffbb6a000 from 10 10000000:01000000:3.0:1789518424.818707:0:27609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518424.818747:0:27609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518424.818760:0:27609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518424.818771:0:27609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518424.818796:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627573120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518424.818859:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518424.818903:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518424.818926:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627573120 00000100:00100000:3.0:1789518424.818932:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627573120 00000100:00100000:3.0:1789518424.818976:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518424.818995:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+11:27609:x1876445627573120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518424.819009:0:27607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518424.819020:0:27607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783f0e expref: -99 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518424.819041:0:27607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783f0e expref: 12 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518424.819051:0:27607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783f0e expref: 12 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518424.819060:0:27607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:3.0:1789518424.819099:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27609:x1876445627573120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518424.819105:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789518424.819222:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627573120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518424.819234:0:27609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518424.819243:0:27609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518424.819285:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627573248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518424.819309:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518424.819323:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518424.819336:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627573248 00000100:00100000:3.0:1789518424.819339:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627573248 00000100:00100000:3.0:1789518424.819359:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789518424.819371:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27609:x1876445627573248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518424.819586:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27609:x1876445627573248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518424.819593:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789518424.819646:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627573248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518424.819672:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627573376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518424.819709:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518424.819733:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518424.819744:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627573376 00000100:00100000:3.0:1789518424.819748:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627573376 00000100:00100000:3.0:1789518424.819770:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518424.819776:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27609:x1876445627573376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518424.819899:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:27609:x1876445627573376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518424.819905:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518424.819936:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627573376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789518424.821102:0:28158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789518424.827537:0:27609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789518424.827568:0:27609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518424.827591:0:27609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518424.827604:0:27609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518424.946855:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518425.971323:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789518426.233511:0:28294:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789518426.233516:0:28294:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789518426.233681:0:28294:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99fff7a53800 00000020:01000004:2.0:1789518426.233699:0:28294:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789518426.233719:0:28294:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789518426.233736:0:28294:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99fff78399c0) 00000020:00000080:2.0:1789518426.233755:0:28294:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789518426.249994:0:28294:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789518426.250401:0:28294:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789518426.253213:0:28294:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789518426.253485:0:28294:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789518426.253908:0:28294:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xd:0x0] (8/32) 00100000:10000000:2.0:1789518426.254503:0:28294:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1789518426.254644:0:28294:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1789518426.254805:0:28294:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1789518426.255225:0:28294:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1789518426.255502:0:28294:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:3.0:1789518426.256897:0:28294:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:3.0:1789518426.257184:0:28294:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1789518426.257446:0:28294:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:3.0:1789518426.257763:0:28294:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00000020:00000080:3.0:1789518426.258583:0:28294:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789518426.258594:0:28294:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789518426.258603:0:28294:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c783f23 00000020:01000004:3.0:1789518426.258645:0:28294:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789518426.258663:0:28294:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789518426.258665:0:28294:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789518426.258670:0:28294:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789518426.258673:0:28294:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789518426.258681:0:28294:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99fec2aa19c0) 00000020:00000080:3.0:1789518426.258688:0:28294:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789518426.259890:0:28294:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518426.260086:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789518426.260093:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789518426.262717:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789518426.262731:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789518426.264790:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789518426.264803:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789518426.266124:0:28294:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518426.266296:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789518426.266301:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789518426.266962:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789518426.266970:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789518426.277480:0:28294:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518426.277777:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789518426.277784:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789518426.279773:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789518426.279784:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789518426.280363:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789518426.280368:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789518426.281914:0:28294:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518426.282105:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789518426.282113:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789518426.282870:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789518426.282879:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789518426.306235:0:28294:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518426.306437:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789518426.306444:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789518426.308096:0:28294:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789518426.308107:0:28294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789518426.308490:0:28294:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789518426.308512:0:28294:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789518426.308518:0:28294:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789518426.315474:0:28294:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789518426.315502:0:28294:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789518426.315505:0:28294:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789518426.315507:0:28294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789518426.315508:0:28294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518426.315509:0:28294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518426.315510:0:28294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518426.315510:0:28294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518426.315511:0:28294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518426.315512:0:28294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518426.315513:0:28294:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518426.315516:0:28294:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789518426.315517:0:28294:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518426.315518:0:28294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789518426.315519:0:28294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518426.315519:0:28294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518426.315520:0:28294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518426.315520:0:28294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518426.315521:0:28294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518426.315522:0:28294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518426.315522:0:28294:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518426.315548:0:28294:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789518426.315563:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627573504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518426.315725:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518426.315773:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627573504 00000100:00100000:1.0:1789518426.315776:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe0496840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.315782:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627573504 00000100:00100000:3.0:1789518426.315835:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518426.315845:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:28294:x1876445627573504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518426.315872:0:27607:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789518426.315876:0:27607:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789518426.315880:0:27607:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789518426.321676:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:28294:x1876445627573504:12345-0@lo:253:mount.lustre.0 Request processed in 5821us (5939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518426.321692:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789518426.321740:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627573504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789518426.321757:0:28294:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789518426.321761:0:28294:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518426.321763:0:28294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789518426.321764:0:28294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518426.321765:0:28294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518426.321767:0:28294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518426.321768:0:28294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518426.321784:0:28294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789518426.321786:0:28294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518426.321787:0:28294:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789518426.321808:0:28294:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99fff7a53800 from lustre-OST0000 10000000:01000000:0.0:1789518426.321834:0:28294:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789518426.321838:0:28294:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789518426.321844:0:28294:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99fec2aa3380 local copy 00010000:00010000:0.0:1789518426.321856:0:28294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518426.322085:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627573632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518426.322120:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518426.322203:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.322451:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627573632 00000100:00100000:3.0:1789518426.322458:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627573632 00000100:00100000:3.0:1789518426.322531:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518426.322541:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:28294:x1876445627573632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518426.322739:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:28294:x1876445627573632:12345-0@lo:501:mount.lustre.0 Request processed in 200us (617us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518426.322747:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518426.322807:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627573632:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789518426.322825:0:28294:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789518426.322938:0:28294:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789518426.322945:0:28294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.322954:0:28294:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518426.322974:0:28294:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99fff7a53800 10000000:01000000:1.0:1789518426.322979:0:28294:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789518426.322983:0:28294:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99fec2aa3380 10000000:01000000:1.0:1789518426.322986:0:28294:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789518426.322989:0:28294:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99fec2aa3380 from 1 10000000:01000000:1.0:1789518426.322991:0:28294:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789518426.323011:0:28294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.323018:0:28294:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.323026:0:28294:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518426.323037:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627573760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518426.323062:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.323088:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffed593240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.323107:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627573760 00000100:00100000:3.0:1789518426.323113:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627573760 00000100:00100000:3.0:1789518426.323179:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789518426.323192:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+12:28294:x1876445627573760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518426.323202:0:27607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518426.323214:0:27607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd000/0x631fd8698c783f38 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783f31 expref: -99 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518426.323234:0:27607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd000/0x631fd8698c783f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783f31 expref: 13 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518426.323244:0:27607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd000/0x631fd8698c783f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783f31 expref: 13 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518426.323253:0:27607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:3.0:1789518426.323290:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+13:28294:x1876445627573760:12345-0@lo:101:mount.lustre.0 Request processed in 99us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.323296:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518426.323901:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627573760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518426.323920:0:28294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f38 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.323939:0:28294:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783f38 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518426.323957:0:28294:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789518426.323970:0:28294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f38 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.323977:0:28294:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f38 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518426.323983:0:28294:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789518426.323988:0:28294:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518426.323993:0:28294:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789518426.323996:0:28294:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789518426.324011:0:28294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.324018:0:28294:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.324026:0:28294:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518426.324039:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627573888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518426.324065:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.324089:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffed593240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.324106:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627573888 00000100:00100000:3.0:1789518426.324111:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627573888 00000100:00100000:3.0:1789518426.324183:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789518426.324191:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+13:28294:x1876445627573888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518426.324198:0:27606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518426.324207:0:27606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd600/0x631fd8698c783f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783f3f expref: -99 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518426.324221:0:27606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd600/0x631fd8698c783f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783f3f expref: 14 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518426.324231:0:27606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd600/0x631fd8698c783f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783f3f expref: 14 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518426.324249:0:27606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd600, rc 0) 00000100:00100000:3.0:1789518426.324289:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627573888:12345-0@lo:101:mount.lustre.0 Request processed in 99us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.324295:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518426.324370:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627573888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518426.324386:0:28294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.324405:0:28294:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518426.325369:0:28294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000040:00080000:1.0:1789518426.326242:0:28294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518426.326493:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:1.0:1789518426.326541:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:1.0:1789518426.326598:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:1.0:1789518426.326707:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:1.0:1789518426.326752:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:1.0:1789518426.326797:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:1.0:1789518426.326849:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:1.0:1789518426.326888:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:1.0:1789518426.326939:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 80 off9712 00000040:00080000:1.0:1789518426.326990:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9936 00000040:00080000:1.0:1789518426.327026:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10160 00000040:00080000:1.0:1789518426.327081:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 120 off10280 00000040:00080000:1.0:1789518426.327136:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 224 off10504 00000040:00080000:1.0:1789518426.327143:0:28294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 14 00000100:00100000:1.0:1789518426.327209:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518426.327259:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518426.327300:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627574016 00000100:00100000:1.0:1789518426.327300:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffed593780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.327306:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627574016 00000100:00100000:3.0:1789518426.327344:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518426.327350:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627574016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518426.327668:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627574016:12345-0@lo:501:mount.lustre.0 Request processed in 317us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.327674:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789518426.327724:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518426.327755:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518426.327794:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.327820:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffed593780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.327897:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627574144 00000100:00100000:3.0:1789518426.327900:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627574144 00000100:00100000:3.0:1789518426.327922:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789518426.327928:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627574144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518426.328192:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627574144:12345-0@lo:503:mount.lustre.0 Request processed in 264us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.328200:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789518426.328222:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518426.328829:0:28294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518426.328879:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518426.328916:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.328949:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffed593780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.329136:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627574272 00000100:00100000:3.0:1789518426.329142:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627574272 00000100:00100000:3.0:1789518426.329177:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518426.329184:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627574272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518426.329367:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627574272:12345-0@lo:502:mount.lustre.0 Request processed in 182us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.329374:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518426.329773:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518426.330015:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:1.0:1789518426.330059:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:1.0:1789518426.330095:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:1.0:1789518426.330143:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:1.0:1789518426.330183:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:1.0:1789518426.330217:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:1.0:1789518426.330260:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:1.0:1789518426.330295:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:1.0:1789518426.330339:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 80 off9712 00000040:00080000:1.0:1789518426.330380:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9936 00000040:00080000:1.0:1789518426.330411:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10160 00000040:00080000:1.0:1789518426.330462:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 120 off10280 00000100:00100000:1.0:1789518426.330489:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518426.330524:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.330558:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffed593780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.330756:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627574400 00000100:00100000:3.0:1789518426.330762:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627574400 00000100:00100000:3.0:1789518426.330843:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789518426.330851:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627574400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518426.331010:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627574400:12345-0@lo:502:mount.lustre.0 Request processed in 160us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.331019:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518426.331025:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518426.331086:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 224 off10504 00000040:00080000:1.0:1789518426.331093:0:28294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789518426.331999:0:28308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518426.332007:0:28308:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789518426.332013:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518426.332015:0:28308:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789518426.332021:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518426.332034:0:28308:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99fec2aa0000) 00000020:00000080:3.0:1789518426.332054:0:28308:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789518426.332059:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789518426.332116:0:28308:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fff7a53800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789518426.332129:0:28308:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789518426.332135:0:28308:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c783f54 00010000:00010000:3.0:1789518426.335379:0:28308:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789518426.335833:0:28308:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 17179869189 00080000:10000000:3.0:1789518426.338013:0:28308:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00000020:00000080:3.0:1789518426.340216:0:28308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789518426.340228:0:28308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518426.340234:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518426.340236:0:28308:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789518426.340241:0:28308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789518426.340244:0:28308:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789518426.340245:0:28308:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518426.340247:0:28308:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518426.340249:0:28308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789518426.340251:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518426.340269:0:28308:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789518426.340272:0:28308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518426.340276:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518426.340278:0:28308:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518426.340282:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518426.340284:0:28308:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789518426.340286:0:28308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518426.340288:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518426.340289:0:28308:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789518426.340291:0:28308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518426.340294:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518426.340295:0:28308:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789518426.340299:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789518426.340353:0:28308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518426.340356:0:28308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518426.340358:0:28308:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789518426.340361:0:28308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000020:01000000:0.0:1789518426.342501:0:28294:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789518426.342537:0:28294:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789518426.342560:0:28294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.342585:0:28294:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518426.342603:0:28294:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fff7a53800 from 1 10000000:01000000:0.0:1789518426.342607:0:28294:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518426.342660:0:28294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.342669:0:28294:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.342681:0:28294:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518426.342716:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518426.342777:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.342833:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627574528 00000100:00100000:0.0:1789518426.342837:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518426.342840:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627574528 00000100:00100000:1.0:1789518426.342873:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518426.342880:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:28294:x1876445627574528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518426.342898:0:27607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518426.342907:0:27607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783f5b expref: -99 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.342928:0:27607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783f5b expref: 15 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.342939:0:27607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783f5b expref: 15 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.342948:0:27607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44600, rc 0) 00000100:00100000:1.0:1789518426.342996:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627574528:12345-0@lo:101:mount.lustre.0 Request processed in 116us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518426.343003:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518426.343080:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518426.343096:0:28294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.343120:0:28294:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518426.343748:0:28294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000040:00080000:0.0:1789518426.344369:0:28294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518426.344837:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:0.0:1789518426.344887:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:0.0:1789518426.344942:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:0.0:1789518426.344983:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:0.0:1789518426.345019:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:0.0:1789518426.345088:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:0.0:1789518426.345129:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:0.0:1789518426.345164:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:0.0:1789518426.345238:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:0.0:1789518426.345247:0:28294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 9 count 10 00000100:00100000:0.0:1789518426.345314:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518426.345366:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518426.345427:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518426.345526:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627574656 00000100:00100000:2.0:1789518426.345533:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627574656 00000100:00100000:2.0:1789518426.345587:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789518426.345595:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627574656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518426.345815:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627574656:12345-0@lo:501:mount.lustre.0 Request processed in 219us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518426.345823:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789518426.345882:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518426.345919:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518426.345958:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.345987:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518426.346006:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627574784 00000100:00100000:0.0:1789518426.346011:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627574784 00000100:00100000:0.0:1789518426.346043:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518426.346059:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627574784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518426.346216:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627574784:12345-0@lo:503:mount.lustre.0 Request processed in 158us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518426.346228:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789518426.346250:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518426.347188:0:28294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518426.347239:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518426.347279:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.347299:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518426.347370:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627574912 00000100:00100000:0.0:1789518426.347375:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627574912 00000100:00100000:0.0:1789518426.347413:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789518426.347422:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627574912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518426.347579:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627574912:12345-0@lo:502:mount.lustre.0 Request processed in 158us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518426.347586:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789518426.347935:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627574912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518426.348099:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:1.0:1789518426.348133:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:1.0:1789518426.348192:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:1.0:1789518426.348410:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:1.0:1789518426.348454:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:1.0:1789518426.348517:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:1.0:1789518426.348553:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:1.0:1789518426.348605:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:1.0:1789518426.348665:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518426.348706:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.348745:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518426.348807:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627575040 00000100:00100000:2.0:1789518426.348814:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627575040 00000100:00100000:2.0:1789518426.348904:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789518426.348912:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627575040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518426.349065:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627575040:12345-0@lo:502:mount.lustre.0 Request processed in 154us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518426.349077:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518426.349148:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518426.349221:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:1.0:1789518426.349230:0:28294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789518426.350596:0:28312:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518426.350607:0:28312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518426.350610:0:28312:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789518426.350643:0:28312:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fff7a53800 00000020:00000080:2.0:1789518426.350646:0:28312:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789518426.350653:0:28312:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518426.350655:0:28312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518426.350657:0:28312:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789518426.350659:0:28312:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518426.350662:0:28312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518426.350663:0:28312:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789518426.350666:0:28312:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fff7a53800 00000020:00000080:2.0:1789518426.350669:0:28312:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789518426.350730:0:28312:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518426.350734:0:28312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518426.350736:0:28312:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789518426.350739:0:28312:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518426.350742:0:28312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518426.350743:0:28312:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789518426.350747:0:28312:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99fff7a53800 00000020:00000080:2.0:1789518426.350749:0:28312:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789518426.350801:0:28312:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518426.350806:0:28312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518426.350807:0:28312:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789518426.350811:0:28312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000020:01000000:1.0:1789518426.350935:0:28294:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789518426.350964:0:28294:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518426.350986:0:28294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.350999:0:28294:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518426.351042:0:28294:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789518426.351046:0:28294:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99fff7a53800 10000000:01000000:1.0:1789518426.351049:0:28294:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99fff7a53800 10000000:01000000:1.0:1789518426.351053:0:28294:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518426.351059:0:28294:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99fff7a53800 from 1 10000000:01000000:1.0:1789518426.351062:0:28294:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518426.351093:0:28294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.351103:0:28294:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.351120:0:28294:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518426.351137:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518426.351179:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.351221:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.351225:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627575168 00000100:00100000:3.0:1789518426.351232:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627575168 00000100:00100000:3.0:1789518426.351279:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518426.351289:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdacfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627575168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518426.351300:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518426.351313:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd800/0x631fd8698c783f70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783f69 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518426.351342:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd800/0x631fd8698c783f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783f69 expref: 16 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518426.351354:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd800/0x631fd8698c783f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783f69 expref: 16 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518426.351363:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd800, rc 0) 00000100:00100000:3.0:1789518426.351420:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdacfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627575168:12345-0@lo:101:mount.lustre.0 Request processed in 133us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.351427:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518426.351554:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518426.351578:0:28294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.351588:0:28294:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518426.352322:0:28294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000040:00080000:1.0:1789518426.352668:0:28294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518426.352984:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:1.0:1789518426.353038:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:1.0:1789518426.353095:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:1.0:1789518426.353164:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:1.0:1789518426.353227:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:1.0:1789518426.353320:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:1.0:1789518426.353383:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:1.0:1789518426.353449:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:1.0:1789518426.353534:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:1.0:1789518426.353656:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:1.0:1789518426.353732:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:1.0:1789518426.353814:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:1.0:1789518426.353889:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:1.0:1789518426.353978:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:1.0:1789518426.354075:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:1.0:1789518426.354162:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:1.0:1789518426.354219:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:1.0:1789518426.354327:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:1.0:1789518426.354588:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:1.0:1789518426.354681:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:1.0:1789518426.354780:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:1.0:1789518426.354838:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:1.0:1789518426.354895:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:1.0:1789518426.354982:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:1.0:1789518426.355045:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 128 off12440 00000040:00080000:1.0:1789518426.355119:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12664 00000040:00080000:1.0:1789518426.355205:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12888 00000040:00080000:1.0:1789518426.355266:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off12968 00000040:00080000:1.0:1789518426.355311:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13192 00000040:00080000:1.0:1789518426.355366:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13416 00000040:00080000:1.0:1789518426.355411:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13504 00000040:00080000:1.0:1789518426.355450:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13632 00000040:00080000:1.0:1789518426.355499:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13776 00000040:00080000:1.0:1789518426.355589:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13904 00000040:00080000:1.0:1789518426.355664:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14128 00000040:00080000:1.0:1789518426.355716:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14352 00000040:00080000:1.0:1789518426.355738:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14432 00000040:00080000:1.0:1789518426.355763:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14656 00000040:00080000:1.0:1789518426.355844:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14880 00000040:00080000:1.0:1789518426.355898:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 120 off15000 00000040:00080000:1.0:1789518426.355980:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 224 off15224 00000040:00080000:1.0:1789518426.355986:0:28294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 41 count 42 00000100:00100000:1.0:1789518426.356080:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518426.356146:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.356201:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518426.356221:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627575296 00000100:00100000:0.0:1789518426.356229:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627575296 00000100:00100000:0.0:1789518426.356285:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518426.356295:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdacf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627575296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518426.356537:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdacf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627575296:12345-0@lo:501:mount.lustre.0 Request processed in 243us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518426.356546:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789518426.356559:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518426.356650:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518426.356693:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.356721:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518426.356748:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627575424 00000100:00100000:3.0:1789518426.356754:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627575424 00000100:00100000:3.0:1789518426.356785:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518426.356792:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627575424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518426.356919:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627575424:12345-0@lo:503:mount.lustre.0 Request processed in 127us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.356927:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518426.356990:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575424:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518426.357958:0:28294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518426.358031:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518426.358083:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.358172:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518426.358254:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627575552 00000100:00100000:2.0:1789518426.358261:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627575552 00000100:00100000:2.0:1789518426.358297:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789518426.358306:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627575552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518426.358694:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627575552:12345-0@lo:502:mount.lustre.0 Request processed in 387us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518426.358710:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789518426.358804:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518426.359242:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:1.0:1789518426.359325:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:1.0:1789518426.359473:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:1.0:1789518426.359543:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:1.0:1789518426.359644:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:1.0:1789518426.359808:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:1.0:1789518426.359936:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:1.0:1789518426.359987:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:1.0:1789518426.360028:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:1.0:1789518426.360676:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:1.0:1789518426.360964:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:1.0:1789518426.361045:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:1.0:1789518426.361095:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:1.0:1789518426.361158:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:1.0:1789518426.361225:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:1.0:1789518426.361271:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:1.0:1789518426.361317:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:1.0:1789518426.361375:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:1.0:1789518426.361428:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:1.0:1789518426.361466:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:1.0:1789518426.361520:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:1.0:1789518426.361561:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:1.0:1789518426.361682:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:1.0:1789518426.361752:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:1.0:1789518426.362125:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 128 off12440 00000040:00080000:1.0:1789518426.362186:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12664 00000040:00080000:1.0:1789518426.362289:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12888 00000040:00080000:1.0:1789518426.362336:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off12968 00000040:00080000:1.0:1789518426.362384:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13192 00000040:00080000:1.0:1789518426.362481:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13416 00000040:00080000:1.0:1789518426.362533:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13504 00000040:00080000:1.0:1789518426.362600:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13632 00000040:00080000:1.0:1789518426.362664:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13776 00000040:00080000:1.0:1789518426.362712:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13904 00000040:00080000:1.0:1789518426.362757:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14128 00000040:00080000:1.0:1789518426.362813:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14352 00000040:00080000:1.0:1789518426.362852:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14432 00000040:00080000:1.0:1789518426.362898:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14656 00000040:00080000:1.0:1789518426.362964:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14880 00000040:00080000:1.0:1789518426.363020:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 120 off15000 00000100:00100000:1.0:1789518426.363074:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518426.363152:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.363267:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518426.363328:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627575680 00000100:00100000:2.0:1789518426.363335:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627575680 00000100:00100000:2.0:1789518426.363376:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518426.363386:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627575680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518426.363672:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627575680:12345-0@lo:502:mount.lustre.0 Request processed in 287us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518426.363681:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789518426.363783:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627575680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518426.363874:0:28294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 224 off15224 00000040:00080000:1.0:1789518426.363893:0:28294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789518426.365188:0:28317:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789518426.365205:0:28317:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99ffc65119c0) 00000020:00000080:3.0:1789518426.365232:0:28317:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789518426.365309:0:28317:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fff7a53800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518426.365314:0:28317:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fff7a53800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518426.365317:0:28317:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fff7a53800 3 00010000:00080000:3.0:1789518426.365347:0:28317:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffc5566800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518426.368527:0:28317:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789518426.368778:0:28317:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789518426.368816:0:28317:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518426.368829:0:28317:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x631fd8698c783f7e 00000100:00080000:3.0:1789518426.368840:0:28317:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518426.368856:0:28317:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99ffc5566800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518426.368908:0:28317:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffefff0700 x1876445627575808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518426.368937:0:28317:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1789518426.369246:0:28317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000100:00080000:3.0:1789518426.369734:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518426.369747:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518426.369752:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518426.369756:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789518426.369816:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627575808:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518426.369881:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518426.369964:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627575936:0@lo:400:kworker.0 00000100:00100000:3.0:1789518426.370000:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518426.370068:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627575808 00000100:00100000:3.0:1789518426.370075:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627575808 00000100:00100000:3.0:1789518426.370111:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627575936 00000100:00100000:3.0:1789518426.370115:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627575936 00000100:00100000:3.0:1789518426.370146:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518426.370158:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627575936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518426.370214:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627575936:12345-0@lo:400:kworker.0 Request processed in 59us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.370221:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518426.370241:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518426.370247:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3279:x1876445627575808:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789518426.370269:0:27613:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1789518426.370310:0:27613:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x631fd8698c783f85 00000004:00100000:3.0:1789518426.370326:0:27613:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789518426.370359:0:27613:0:(import.c:65:import_set_state_nolock()) ffff99ffed5a6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518426.370414:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876445627575808:12345-0@lo:38:llog_process_th.0 Request processed in 165us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518426.370537:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:1.0:1789518426.370815:0:28294:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789518426.370854:0:28294:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518426.370872:0:28294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.370890:0:28294:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518426.370932:0:28294:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518426.370935:0:28294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789518426.370936:0:28294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518426.370938:0:28294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518426.370939:0:28294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518426.370941:0:28294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518426.370943:0:28294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518426.370945:0:28294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518426.370946:0:28294:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518426.370950:0:28294:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789518426.370953:0:28294:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518426.370955:0:28294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789518426.370956:0:28294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518426.370957:0:28294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518426.370957:0:28294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518426.370959:0:28294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518426.370960:0:28294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518426.370961:0:28294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518426.370962:0:28294:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518426.370979:0:28294:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789518426.370991:0:28294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627576064:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518426.371032:0:28294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518426.371067:0:28294:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406ee40 going to sleep for 11 seconds 00010000:00080000:3.0:1789518426.371207:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffefff1500 x1876445627575936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518426.371220:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627575936:0@lo:400:kworker.0 00010000:00080000:3.0:1789518426.371264:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffefff0700 x1876445627575808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518426.371272:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518426.371278:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 5 00000100:00080000:3.0:1789518426.371286:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789518426.371290:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789518426.371293:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc5566800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789518426.371298:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627575808:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518426.371772:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627576064 00000100:00100000:3.0:1789518426.371778:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627576064 00000100:00100000:3.0:1789518426.371818:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789518426.371826:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:28294:x1876445627576064:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518426.371849:0:27605:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789518426.371861:0:27605:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789518426.393115:0:27605:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789518426.393131:0:27605:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789518426.393147:0:27628:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789518426.393158:0:27628:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789518426.393192:0:27628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518426.393217:0:27628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783ef2 expref: 16 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518426.393228:0:27628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518426.393285:0:27628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c783ef2 expref: 16 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518426.393307:0:27628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c783ef2 expref: 16 pid: 27606 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518426.393327:0:27628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27628:1876445627576192:0@lo:104: 00000100:00100000:2.0:1789518426.393411:0:27628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518426.393468:0:27628:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80613c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518426.393502:0:27595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627576192 00000100:00100000:1.0:1789518426.393512:0:27595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627576192 00000100:00100000:1.0:1789518426.393575:0:27595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518426.393587:0:27595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:27628:x1876445627576192:12345-0@lo:104: 00000100:00100000:2.0:1789518426.393589:0:27596:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:1.0:1789518426.393604:0:27595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518426.393661:0:27596:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1789518426.393729:0:27595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518426.393737:0:27595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:27628:x1876445627576192:12345-0@lo:104: Request processed in 152us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518426.393745:0:27595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789518426.393781:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518426.393786:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.393794:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518426.393798:0:27600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.393807:0:27600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518426.393816:0:27600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518426.393822:0:27600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518426.393874:0:27600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.393881:0:27600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518426.393903:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.393911:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17000/0x631fd8698c783ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783ef9 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.393942:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518426.393944:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518426.393946:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518426.393965:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627576320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518426.394001:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518426.394075:0:27598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627576320 00000100:00100000:0.0:1789518426.394080:0:27598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627576320 00010000:00010000:0.0:1789518426.394099:0:27598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783ef2 expref: 17 pid: 27606 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518426.394108:0:27628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27628:1876445627576192:0@lo:104: 00010000:00010000:1.0:1789518426.394126:0:27628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518426.394130:0:27598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518426.394137:0:27598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:3282:x1876445627576320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518426.394147:0:27598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518426.394152:0:27598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783ef2 expref: 17 pid: 27606 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394170:0:27598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c783ef2 expref: 17 pid: 27606 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394180:0:27598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b44400/0x631fd8698c783ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c783ef2 expref: 17 pid: 27606 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394189:0:27598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394195:0:27598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789518426.394204:0:27598:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003136568s 00010000:00010000:0.0:1789518426.394207:0:27598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394212:0:27598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394217:0:27598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394220:0:27598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394223:0:27598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518426.394226:0:27598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394230:0:27598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394247:0:27598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518426.394256:0:27598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518426.394265:0:27628:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.394272:0:27628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518426.394278:0:27628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c783f8c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518426.394305:0:27598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:3282:x1876445627576320:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518426.394312:0:27598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518426.394358:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627576320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518426.397739:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:28294:x1876445627576064:12345-0@lo:253:mount.lustre.0 Request processed in 25904us (26696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518426.397755:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518426.397811:0:28294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:28294:1876445627576064:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789518426.397829:0:28294:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789518426.397833:0:28294:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518426.397835:0:28294:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518426.397837:0:28294:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518426.397838:0:28294:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518426.397839:0:28294:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518426.397841:0:28294:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518426.397843:0:28294:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518426.397844:0:28294:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518426.397846:0:28294:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789518426.397860:0:28294:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789518426.398316:0:28294:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789518426.398485:0:28294:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789518426.398754:0:28294:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789518426.398910:0:28294:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789518426.399024:0:28294:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789518426.399143:0:28294:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789518426.400530:0:28294:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836480 00002000:00080000:0.0:1789518426.420883:0:28294:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789518426.420892:0:28294:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789518426.420923:0:28294:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789518426.420977:0:28294:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789518426.421153:0:28294:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789518426.421179:0:28294:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789518426.995895:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789518427.895121:0:27609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518427.895128:0:27609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99fffbb6a000 from 16 10000000:01000000:3.0:1789518427.895132:0:27609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518427.895172:0:27609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518427.895184:0:27609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518427.895195:0:27609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518427.895225:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627576448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518427.895288:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518427.895319:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627576448 00000100:00100000:0.0:1789518427.895327:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627576448 00000100:00100000:3.0:1789518427.895340:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518427.895373:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789518427.895383:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+15:27609:x1876445627576448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518427.895395:0:27607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518427.895409:0:27607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c783f93 expref: -99 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518427.895431:0:27607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c783f93 expref: 16 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518427.895442:0:27607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783f93 expref: 16 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518427.895450:0:27607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28dc00, rc 0) 00000100:00100000:3.0:1789518427.895512:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627576448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518427.895513:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:27609:x1876445627576448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518427.895527:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1789518427.895711:0:27609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518427.895723:0:27609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518427.895770:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627576576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518427.895803:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518427.895836:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518427.895913:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627576576 00000100:00100000:0.0:1789518427.895918:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627576576 00000100:00100000:0.0:1789518427.895944:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789518427.895950:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:27609:x1876445627576576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789518427.895962:0:27605:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518427.895976:0:27605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518427.895979:0:27605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 16 00000100:00100000:0.0:1789518427.896081:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:27609:x1876445627576576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518427.896091:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627576576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789518427.896091:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 10000000:01000000:3.0:1789518427.896150:0:27609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518427.896156:0:27609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518427.896165:0:27609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.019020:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518428.403322:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518418/real 1789518418] req@ffff99ffffe5a300 x1876445627570048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518428 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518428.403354:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffffe5a300 x1876445627570048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518428 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518428.403381:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518418/real 1789518418] req@ffff99ffd100aa00 x1876445627569920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518428 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518428.403395:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffd100aa00 x1876445627569920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518428 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518428.403413:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffedb76000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518428.403942:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789518428.403946:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627570048:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789518428.403952:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bdb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518428.404008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518428.404013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789518428.404016:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bdb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518428.404021:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00100000:2.0:1789518428.404032:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627576704:0@lo:400:kworker.0 00000100:00080000:3.0:1789518428.404033:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789518428.404043:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffc6bdb800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518428.404063:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffefff1500 x1876445627576832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518428.404072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518428.404075:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789518428.404076:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ffedb76000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518428.404079:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:3.0:1789518428.404081:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789518428.404084:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffedb76000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518428.404090:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518428.404093:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffefff2680 x1876445627576960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518428.404130:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627577088:0@lo:400:kworker.0 00000100:00100000:3.0:1789518428.404159:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518428.404165:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627576704 00000100:00100000:2.0:1789518428.404172:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627576704 00000100:00100000:3.0:1789518428.404178:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518428.404183:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627577216:0@lo:400:kworker.0 00000100:00100000:3.0:1789518428.404201:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518428.404213:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518428.404221:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:3283:x1876445627576704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518428.404223:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627577088 00000100:00100000:3.0:1789518428.404226:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627577088 00000100:00100000:3.0:1789518428.404247:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627577216 00000100:00100000:3.0:1789518428.404250:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627577216 00000100:00100000:2.0:1789518428.404265:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:3283:x1876445627576704:12345-0@lo:400:kworker.0 Request processed in 45us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518428.404271:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518428.404276:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627577088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518428.404280:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518428.404308:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627577088:12345-0@lo:400:kworker.0 Request processed in 31us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518428.404314:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518428.404321:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627576704:0@lo:400:kworker.0 00000100:00100000:3.0:1789518428.404331:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518428.404337:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627577216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518428.404366:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627577216:12345-0@lo:400:kworker.0 Request processed in 30us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518428.404371:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789518428.404402:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789518428.404421:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffefff0000 x1876445627577216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518428.404432:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627577216:0@lo:400:kworker.0 00010000:00080000:3.0:1789518428.404441:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffefff0a80 x1876445627577088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518428.404449:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627577088:0@lo:400:kworker.0 00000100:00080000:1.0:1789518428.404516:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789518428.404520:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627569920:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789518428.404563:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627576832:0@lo:8:kworker.0 00000100:00100000:1.0:1789518428.404597:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518428.404641:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627576960:0@lo:8:kworker.0 00000100:00100000:1.0:1789518428.404665:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518428.404743:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627576832 00000100:00100000:2.0:1789518428.404748:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627576832 00000100:00100000:2.0:1789518428.404764:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627576960 00000100:00100000:2.0:1789518428.404767:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627576960 00000100:00100000:2.0:1789518428.404778:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518428.404782:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3279:x1876445627576832:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789518428.404803:0:28297:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1789518428.404834:0:28297:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c783fa1 00002000:00100000:2.0:1789518428.404845:0:28297:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99ffee444000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789518428.404850:0:28297:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789518428.404852:0:28297:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789518428.405103:0:28297:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789518428.405119:0:28297:0:(import.c:65:import_set_state_nolock()) ffff99ffee441000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518428.405167:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627576832:12345-0@lo:8:kworker.0 Request processed in 383us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518428.405174:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789518428.405185:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffefff1500 x1876445627576832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518428.405187:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518428.405192:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3279:x1876445627576960:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789518428.405194:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518428.405200:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 5 00010000:00020000:2.0:1789518428.405202:0:28297:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1789518428.405206:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789518428.405211:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789518428.405213:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bdb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789518428.405235:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789518428.405239:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627576832:0@lo:8:kworker.0 00000004:00080000:1.0:1789518428.405265:0:27634:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789518428.405468:0:27634:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 482401853342ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789518428.405590:0:27635:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x62:0x0] 00000100:00100000:3.0:1789518428.405607:0:27635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:27635:1876445627577472:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789518428.405661:0:27635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518428.405679:0:27635:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518428.405862:0:28295:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789518428.405870:0:28295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789518428.405979:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627577472 00000100:00100000:3.0:1789518428.405984:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627577472 00000100:00080000:3.0:1789518428.406020:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518428.406082:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518428.406090:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:27635:x1876445627577472:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789518428.407459:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627577344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518428.407509:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518428.407573:0:28299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627577344 00000100:00100000:1.0:1789518428.407579:0:28299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627577344 00000100:00100000:1.0:1789518428.407639:0:28299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518428.407648:0:28299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627577344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518428.407673:0:28299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518428.407861:0:28299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627577344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518428.407868:0:28299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789518428.407908:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffefff0a80 x1876445627577344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518428.407925:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627577344:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1789518428.410746:0:28515:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789518428.410756:0:28515:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -31 00002000:02000040:3.0:1789518428.410761:0:28515:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:99 to 0x240000400:129) 00000100:00100000:1.0:1789518428.420359:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3279:x1876445627576960:12345-0@lo:8:kworker.0 Request processed in 15156us (15683us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789518428.420385:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789518428.420455:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffedb76000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518428.420993:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789518428.421015:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627576960:0@lo:8:kworker.0 00002000:00010000:3.0:1789518428.425070:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.425083:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.425102:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x81:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.425108:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.425127:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.425149:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.425161:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.425169:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.425201:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518428.425804:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518428.425818:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.425832:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518428.425847:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.425859:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.425889:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.425897:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c783fa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518428.425906:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.425916:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.425921:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.425928:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.425931:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x80:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1789518428.425934:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.426117:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.426123:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.426151:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.426160:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.426168:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.426188:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518428.426203:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518428.426211:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.426219:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518428.426225:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.426235:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.426250:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.426258:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c783faf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.426287:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.426289:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.426292:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.427922:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.427933:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.427948:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7f:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.428455:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.428462:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.428479:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.428491:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.428500:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.428525:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518428.428540:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518428.428546:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.428581:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518428.428587:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.428597:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.428670:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.428679:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c783fb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.428709:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.428712:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.428714:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.429723:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.429730:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.429742:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7e:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.429747:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.429751:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.429762:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.429781:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.429790:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.430121:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.430192:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.430208:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.430221:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.430226:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.430241:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.430268:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.430276:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.430314:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.430316:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.430319:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.431483:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.431491:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431504:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7d:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.431508:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.431513:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431524:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431534:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431542:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431603:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518428.431639:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518428.431644:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431653:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518428.431658:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431669:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431690:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431697:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c783fc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.431725:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.431728:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.431730:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.433651:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.433664:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.433679:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7c:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.433690:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.433697:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.433710:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.433720:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.433728:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.433751:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518428.434095:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518428.434108:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.434122:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518428.434128:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.434141:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.434165:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.434183:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c783fcb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.434214:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.434217:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.434220:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.434295:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.434304:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434315:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7b:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.434318:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.434322:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434333:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434342:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434356:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434380:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518428.434396:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518428.434402:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434411:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518428.434417:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434428:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434444:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434451:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c783fd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.434476:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.434479:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.434481:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.435424:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.435445:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.435458:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7a:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.435463:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.435469:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.435481:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.435490:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.435499:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.435590:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.435820:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.435834:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.435846:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.435852:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.435865:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.435886:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.435893:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c783fd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.435915:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.435917:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.435918:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.436110:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.436268:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.436280:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x79:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.436283:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.436287:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.436298:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.436315:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.436322:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.436401:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.436433:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.436441:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.436464:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.436470:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.436479:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.436495:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.436503:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c783fe0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.436526:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.436529:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.436533:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.437043:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.437050:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.437060:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x78:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.437063:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.437068:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.437078:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.437086:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.437095:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.437128:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.437172:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.437180:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.437190:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.437195:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.437205:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.437228:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.437236:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c783fe7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.437255:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.437257:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.437259:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789518428.437786:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789518428.437946:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.438017:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.438029:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x77:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.438033:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.438038:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.438049:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.438059:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.438066:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.438093:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.438298:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.438306:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.438314:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.438319:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.438329:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.438360:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.438369:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c783fee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.438402:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.438405:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.438407:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.438919:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.438927:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.438936:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x76:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.438947:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.439009:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.439020:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.439028:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.439036:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.439091:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.439466:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.439481:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.439495:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.439501:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.439513:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518428.439525:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.439533:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.439543:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x75:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.439546:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.439550:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.439573:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.439581:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.439594:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.439634:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.439640:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.439653:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5b9c7b0/0x631fd8698c783ff5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.439684:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.439688:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.439696:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.439712:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.439722:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.439739:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.439748:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c783ffc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.439777:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.439782:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.439785:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.439835:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.440144:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.440151:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440160:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x74:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.440163:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.440167:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440176:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440184:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440191:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440215:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518428.440602:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.440608:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440664:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.440668:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.440672:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440681:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440688:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440695:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.440711:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789518428.440762:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518428.440773:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.440895:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518428.440905:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.440916:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.440934:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.440942:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c784003 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.440964:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518428.440968:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.440984:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518428.440988:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.440996:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.441007:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.441014:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c78400a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.441029:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.441031:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.441033:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.441588:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.441803:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.441809:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.441819:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.441822:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.441838:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.441849:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.441869:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.441877:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.441904:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.441994:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.442005:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442015:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.442021:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442038:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442060:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442076:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078dfac31/0x631fd8698c784011 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442112:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.442115:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.442123:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.442367:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.442373:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442381:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x71:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.442384:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x71:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.442388:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442398:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442405:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442412:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442445:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.442471:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.442476:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442483:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.442486:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442494:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442517:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442525:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf0ae8bc/0x631fd8698c784018 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.442542:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.442546:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.442548:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.442923:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.442929:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442938:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x70:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.442941:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.442946:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442955:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442963:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442970:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.442994:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.443313:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.443318:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443327:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.443331:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443339:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443352:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443360:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b50340b/0x631fd8698c78401f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443373:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.443375:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.443377:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518428.443377:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.443382:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443390:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6f:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.443399:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.443404:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443413:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443418:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443423:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443437:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.443451:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.443456:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443464:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.443467:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443485:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443497:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443504:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ecff79/0x631fd8698c784026 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443517:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.443518:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.443520:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.443879:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.443883:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443889:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6e:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.443890:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.443894:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443900:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443905:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443924:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.443935:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.443955:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.443960:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443967:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.443971:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443979:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.443991:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.444009:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c78402d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.444024:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.444026:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.444028:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.444326:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.444332:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444340:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6d:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.444343:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.444347:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444357:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444364:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444372:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444395:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.444484:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.444492:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.444503:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.444507:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.444518:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.444533:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.444542:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c784034 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.444579:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.444582:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.444585:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518428.444881:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.444887:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444901:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6c:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.444904:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.444908:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444916:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444923:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444930:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.444953:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518428.445322:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518428.445327:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.445335:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6b:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1789518428.445338:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518428.445342:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.445351:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.445370:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.445375:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.445395:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789518428.445604:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518428.445609:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445637:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.445642:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445651:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445666:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445673:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c78403b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445690:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.445694:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445701:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.445704:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445713:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445735:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445745:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c784042 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.445759:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.445762:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.445764:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.446313:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518428.446917:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518428.446927:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.446938:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6a:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1789518428.446941:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518428.446946:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.446956:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.446964:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.446972:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.447051:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.447051:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518428.447064:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.447075:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518428.447079:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.447101:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.447116:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.447124:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049b03855/0x631fd8698c784049 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.447142:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.447144:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.447146:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518428.448329:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518428.448341:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.448359:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x69:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1789518428.448364:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518428.448371:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.448386:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.448397:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.448404:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.448443:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518428.448509:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518428.448518:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.448529:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518428.448534:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.448545:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.448574:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.448597:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb70a4c9/0x631fd8698c784050 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.448649:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.448651:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.448653:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518428.451077:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518428.451086:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451104:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x68:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1789518428.451109:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518428.451116:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451143:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451153:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451162:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451189:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.451223:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.451237:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.451250:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.451266:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.451277:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.451300:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.451308:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062625cd/0x631fd8698c784057 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.451332:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.451335:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.451338:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518428.451842:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518428.451855:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451866:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x67:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1789518428.451869:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518428.451874:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451884:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451893:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451900:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.451926:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518428.452220:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.452228:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.452236:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.452241:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.452251:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.452267:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.452282:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bfb84fa/0x631fd8698c78405e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.452300:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.452302:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.452304:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518428.452518:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518428.452525:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.452533:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x66:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1789518428.452537:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518428.452542:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.452551:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.452577:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.452585:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.452690:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789518428.453088:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518428.453095:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.453106:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x65:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1789518428.453110:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518428.453115:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.453126:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.453148:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.453155:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453300:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518428.453307:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453315:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.453320:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453328:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453340:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453348:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e776192/0x631fd8698c784065 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453363:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.453367:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453380:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.453384:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453392:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453403:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.453411:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.453413:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518428.453415:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518428.453471:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789518428.453477:0:28515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c78406c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518428.453916:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518428.453922:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.453932:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x64:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1789518428.453936:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518428.453940:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.453950:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.453959:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.453967:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.454069:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518428.454076:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.454083:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518428.454087:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.454094:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518428.454106:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.454266:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789518428.454271:0:28515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062f828f2/0x631fd8698c784073 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518428.454788:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518428.454794:0:28515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.454803:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1789518428.454807:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518428.454811:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.454821:0:28515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.454829:0:28515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.454837:0:28515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518428.454845:0:28515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789518428.455028:0:28515:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:98 00010000:00010000:3.0:1789518428.455036:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518428.455044:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.455055:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518428.455060:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.455069:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.455084:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.455092:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b8987d/0x631fd8698c78407a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518428.455112:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.455122:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518428.455136:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518428.455186:0:27635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:27635:1876445627577472:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789518428.455205:0:27635:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x81:0x0] from OST, last_created [0x240000400:0x81:0x0]last_used is [0x240000400:0x62:0x0] 00010000:00010000:0.0:1789518428.455233:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518428.455263:0:27635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:27635:1876445627577600:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789518428.455277:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:27635:x1876445627577472:12345-0@lo:5:osp-pre-0-0.0 Request processed in 49185us (49613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518428.455290:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518428.455391:0:27635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518428.455447:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627577600 00000100:00100000:3.0:1789518428.455448:0:27635:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518428.455457:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627577600 00000100:00100000:3.0:1789518428.455546:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518428.455574:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:27635:x1876445627577600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789518428.455637:0:28295:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 130 00000100:00100000:3.0:1789518428.459045:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:27635:x1876445627577600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3482us (3648us total) trans 21474836481 rc 0/0 00000100:00100000:3.0:1789518428.459059:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518428.459225:0:27635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:27635:1876445627577600:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789518428.459243:0:27635:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x81:0x0]-[0x240000400:0xa1:0x0] 00010000:00010000:1.0:1789518429.042956:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518429.599954:0:28663:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789518430.066766:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518431.090771:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518431.283244:0:27646:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1789518431.283262:0:27646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518431.283813:0:27646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 3 00000040:00080000:1.0:1789518431.283821:0:27646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000001:00100000:0.0:1789518431.898664:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789518431.898687:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836481 is committed 00010000:00010000:0.0:1789518432.116281:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518433.138952:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789518433.460906:0:29012:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789518433.460910:0:29012:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789518433.460995:0:29012:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffed824800 00000020:01000004:3.0:1789518433.461007:0:29012:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789518433.461018:0:29012:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789518433.461030:0:29012:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99ffc6513380) 00000020:00000080:3.0:1789518433.461045:0:29012:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789518433.474037:0:29012:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789518433.474303:0:29012:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789518433.475017:0:29012:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789518433.475256:0:29012:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789518433.475483:0:29012:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xd:0x0] (8/32) 00100000:10000000:3.0:1789518433.475902:0:29012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 495: rc = 0 00100000:10000000:3.0:1789518433.475970:0:29012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 495: rc = 0 00100000:10000000:3.0:1789518433.476084:0:29012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 495: rc = 0 00100000:10000000:3.0:1789518433.476579:0:29012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1789518433.477050:0:29012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:3.0:1789518433.477296:0:29012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:3.0:1789518433.477520:0:29012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1789518433.477907:0:29012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:3.0:1789518433.478150:0:29012:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 770: rc = 0 00000020:00000080:3.0:1789518433.479572:0:29012:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789518433.479583:0:29012:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789518433.479593:0:29012:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c784088 00000020:01000004:3.0:1789518433.479600:0:29012:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789518433.479787:0:29012:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789518433.479791:0:29012:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789518433.479796:0:29012:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789518433.479816:0:29012:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789518433.479820:0:29012:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789518433.488335:0:29012:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789518433.488376:0:29012:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.151@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789518433.488380:0:29012:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789518433.488382:0:29012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518433.488383:0:29012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518433.488384:0:29012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518433.488385:0:29012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518433.488387:0:29012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518433.488388:0:29012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518433.488390:0:29012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518433.488391:0:29012:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518433.488394:0:29012:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789518433.488396:0:29012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789518433.488398:0:29012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518433.488399:0:29012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518433.488400:0:29012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518433.488401:0:29012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518433.488407:0:29012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518433.488408:0:29012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518433.488409:0:29012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518433.488410:0:29012:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518433.488433:0:29012:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789518433.488450:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627577728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789518433.488512:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518433.488669:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518433.488854:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627577728 00000100:00100000:0.0:1789518433.488862:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627577728 00000100:00100000:0.0:1789518433.488913:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789518433.488922:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:29012:x1876445627577728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789518433.488948:0:27607:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789518433.488951:0:27607:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789518433.488954:0:27607:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789518433.518986:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:29012:x1876445627577728:12345-0@lo:253:mount.lustre.0 Request processed in 30054us (30463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518433.519000:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789518433.519110:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627577728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789518433.519124:0:29012:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789518433.519127:0:29012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518433.519128:0:29012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518433.519130:0:29012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518433.519131:0:29012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518433.519132:0:29012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518433.519133:0:29012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518433.519135:0:29012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518433.519136:0:29012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518433.519138:0:29012:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789518433.519155:0:29012:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffed824800 from lustre-OST0001 10000000:01000000:3.0:1789518433.519180:0:29012:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789518433.519183:0:29012:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789518433.519190:0:29012:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99fec2aa3380 local copy 00010000:00010000:3.0:1789518433.519199:0:29012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518433.519409:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627577856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518433.519440:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518433.519474:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518433.519589:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627577856 00000100:00100000:2.0:1789518433.519595:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627577856 00000100:00100000:2.0:1789518433.519673:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789518433.519681:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:29012:x1876445627577856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518433.519814:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:29012:x1876445627577856:12345-0@lo:501:mount.lustre.0 Request processed in 134us (373us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518433.519821:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789518433.519896:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627577856:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789518433.519909:0:29012:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789518433.520057:0:29012:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789518433.520063:0:29012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.520072:0:29012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518433.520101:0:29012:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffed824800 10000000:01000000:1.0:1789518433.520105:0:29012:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789518433.520111:0:29012:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789518433.520113:0:29012:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518433.520116:0:29012:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789518433.520119:0:29012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789518433.520138:0:29012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.520145:0:29012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.520153:0:29012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518433.520171:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627577984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518433.520197:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.520227:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789518433.520323:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627577984 00000100:00100000:2.0:1789518433.520328:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627577984 00000100:00100000:2.0:1789518433.520360:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789518433.520367:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:29012:x1876445627577984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518433.520376:0:27607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518433.520386:0:27607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c784096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78408f expref: -99 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518433.520404:0:27607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c784096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78408f expref: 17 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518433.520413:0:27607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c784096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78408f expref: 17 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518433.520420:0:27607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16a00, rc 0) 00000100:00100000:2.0:1789518433.520446:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627577984:12345-0@lo:101:mount.lustre.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518433.520451:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789518433.520521:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627577984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518433.520545:0:29012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.520553:0:29012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518433.521265:0:29012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 11 count 11 00000040:00080000:1.0:1789518433.521961:0:29012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518433.522229:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:1.0:1789518433.522274:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:1.0:1789518433.522310:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:1.0:1789518433.522358:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:1.0:1789518433.522391:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:1.0:1789518433.522421:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:1.0:1789518433.522464:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:1.0:1789518433.522494:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:1.0:1789518433.522579:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 120 off9752 00000040:00080000:1.0:1789518433.522668:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9976 00000040:00080000:1.0:1789518433.522677:0:29012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 11 00000100:00100000:1.0:1789518433.522741:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518433.522792:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518433.522863:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627578112 00000100:00100000:2.0:1789518433.522869:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627578112 00000100:00100000:1.0:1789518433.522871:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518433.522906:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518433.522915:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627578112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518433.523445:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518433.523475:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627578112:12345-0@lo:501:mount.lustre.0 Request processed in 560us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518433.523484:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518433.523488:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789518433.523517:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.523594:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518433.523748:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627578240 00000100:00100000:3.0:1789518433.523753:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627578240 00000100:00100000:3.0:1789518433.523814:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789518433.523821:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627578240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518433.524079:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627578240:12345-0@lo:503:mount.lustre.0 Request processed in 248us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518433.524093:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789518433.524178:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789518433.524811:0:29012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518433.524870:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518433.524910:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518433.524984:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518433.525016:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627578368 00000100:00100000:1.0:1789518433.525021:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627578368 00000100:00100000:1.0:1789518433.525049:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789518433.525057:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627578368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518433.525343:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627578368:12345-0@lo:502:mount.lustre.0 Request processed in 286us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518433.525350:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789518433.525410:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518433.525657:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:2.0:1789518433.525694:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:2.0:1789518433.525712:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:2.0:1789518433.525736:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:2.0:1789518433.525755:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:2.0:1789518433.525771:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:2.0:1789518433.525793:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:2.0:1789518433.525811:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:2.0:1789518433.525833:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 120 off9752 00000100:00100000:2.0:1789518433.525850:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518433.525875:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518433.525898:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518433.525922:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627578496 00000100:00100000:3.0:1789518433.525926:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627578496 00000100:00100000:3.0:1789518433.525950:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789518433.525957:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627578496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518433.526196:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627578496:12345-0@lo:502:mount.lustre.0 Request processed in 239us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518433.526203:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789518433.526282:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518433.526338:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9976 00000040:00080000:2.0:1789518433.526347:0:29012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789518433.527047:0:29013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518433.527054:0:29013:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789518433.527060:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518433.527062:0:29013:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789518433.527068:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518433.527080:0:29013:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99fffee2b380) 00000020:00000080:0.0:1789518433.527112:0:29013:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789518433.527119:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789518433.527171:0:29013:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffed824800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789518433.527178:0:29013:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789518433.527193:0:29013:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c7840a4 00010000:00010000:0.0:1789518433.531444:0:29013:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789518433.531885:0:29013:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 17179869195 00080000:10000000:0.0:1789518433.534519:0:29013:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xe:0x0] (8/8/4) registered 00000020:00000080:0.0:1789518433.536415:0:29013:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789518433.536429:0:29013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518433.536438:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518433.536441:0:29013:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789518433.536446:0:29013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518433.536452:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518433.536453:0:29013:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789518433.536458:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789518433.536460:0:29013:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789518433.536463:0:29013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518433.536466:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518433.536468:0:29013:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789518433.536470:0:29013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518433.536471:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518433.536472:0:29013:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789518433.536475:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789518433.536522:0:29013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518433.536526:0:29013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518433.536528:0:29013:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789518433.536543:0:29013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000020:01000000:1.0:1789518433.537691:0:29012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789518433.537718:0:29012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789518433.537730:0:29012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.537740:0:29012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518433.537746:0:29012:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffed824800 from 1 10000000:01000000:1.0:1789518433.537747:0:29012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518433.537777:0:29012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.537783:0:29012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.537971:0:29012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518433.538000:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518433.538060:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.538106:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518433.538221:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627578624 00000100:00100000:0.0:1789518433.538228:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627578624 00000100:00100000:0.0:1789518433.538267:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789518433.538275:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:29012:x1876445627578624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518433.538293:0:27607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518433.538306:0:27607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7840ab expref: -99 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.538328:0:27607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7840ab expref: 18 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.538350:0:27607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7840ab expref: 18 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.538358:0:27607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d800, rc 0) 00000100:00100000:0.0:1789518433.538408:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627578624:12345-0@lo:101:mount.lustre.0 Request processed in 134us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518433.538415:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518433.538499:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518433.538513:0:29012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.538522:0:29012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518433.539028:0:29012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000040:00080000:1.0:1789518433.540089:0:29012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518433.540345:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:1.0:1789518433.540388:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:1.0:1789518433.540431:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:1.0:1789518433.540469:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:1.0:1789518433.540585:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:1.0:1789518433.540665:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:1.0:1789518433.540703:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:1.0:1789518433.540738:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:1.0:1789518433.540804:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:1.0:1789518433.540812:0:29012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 9 count 10 00000100:00100000:1.0:1789518433.540879:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518433.540931:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.540972:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518433.541002:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627578752 00000100:00100000:3.0:1789518433.541009:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627578752 00000100:00100000:3.0:1789518433.541053:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518433.541062:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627578752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518433.541271:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627578752:12345-0@lo:501:mount.lustre.0 Request processed in 209us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518433.541278:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789518433.541504:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518433.541548:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518433.541588:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.541636:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518433.541836:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627578880 00000100:00100000:2.0:1789518433.541841:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627578880 00000100:00100000:2.0:1789518433.541878:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789518433.541886:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627578880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518433.542097:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627578880:12345-0@lo:503:mount.lustre.0 Request processed in 212us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518433.542104:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789518433.542404:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627578880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789518433.543371:0:29012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518433.543437:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518433.543490:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518433.543528:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb558480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518433.544229:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627579008 00000100:00100000:0.0:1789518433.544235:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627579008 00000100:00100000:0.0:1789518433.544273:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789518433.544281:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627579008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518433.544455:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627579008:12345-0@lo:502:mount.lustre.0 Request processed in 175us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518433.544462:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518433.544469:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518433.544845:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:1.0:1789518433.544889:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:1.0:1789518433.544916:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:1.0:1789518433.544935:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:1.0:1789518433.544952:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:1.0:1789518433.544975:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:1.0:1789518433.545004:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:1.0:1789518433.545021:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:1.0:1789518433.545041:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518433.545069:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518433.545106:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627579136 00000100:00100000:0.0:1789518433.545111:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627579136 00000100:00100000:1.0:1789518433.545165:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518433.545211:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789518433.545219:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627579136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518433.545450:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627579136:12345-0@lo:502:mount.lustre.0 Request processed in 232us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518433.545457:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518433.545840:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518433.545935:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:1.0:1789518433.545945:0:29012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789518433.546866:0:29017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518433.546876:0:29017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518433.546878:0:29017:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789518433.546884:0:29017:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffed824800 00000020:00000080:3.0:1789518433.546887:0:29017:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518433.546893:0:29017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518433.546895:0:29017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518433.546896:0:29017:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789518433.546899:0:29017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518433.546906:0:29017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518433.546908:0:29017:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789518433.546913:0:29017:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffed824800 00000020:00000080:3.0:1789518433.546915:0:29017:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518433.546971:0:29017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518433.546974:0:29017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518433.546975:0:29017:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789518433.546977:0:29017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518433.546979:0:29017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518433.546980:0:29017:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518433.546984:0:29017:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffed824800 00000020:00000080:3.0:1789518433.546986:0:29017:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518433.547021:0:29017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518433.547025:0:29017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518433.547026:0:29017:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789518433.547029:0:29017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000020:01000000:1.0:1789518433.547813:0:29012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789518433.547838:0:29012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518433.547891:0:29012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.547903:0:29012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518433.547944:0:29012:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789518433.547948:0:29012:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffed824800 10000000:01000000:1.0:1789518433.547950:0:29012:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffed824800 10000000:01000000:1.0:1789518433.547957:0:29012:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518433.547964:0:29012:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffed824800 from 1 10000000:01000000:1.0:1789518433.547966:0:29012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518433.547992:0:29012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.548000:0:29012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.548010:0:29012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518433.548030:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518433.548096:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.548130:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518433.548262:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627579264 00000100:00100000:0.0:1789518433.548269:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627579264 00000100:00100000:0.0:1789518433.548306:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789518433.548314:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627579264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518433.548326:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518433.548342:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28d000/0x631fd8698c7840c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7840b9 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.548360:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28d000/0x631fd8698c7840c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7840b9 expref: 19 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.548367:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28d000/0x631fd8698c7840c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7840b9 expref: 19 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.548373:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d000, rc 0) 00000100:00100000:0.0:1789518433.548423:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627579264:12345-0@lo:101:mount.lustre.0 Request processed in 109us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518433.548429:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789518433.548440:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518433.548452:0:29012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.548460:0:29012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518433.549260:0:29012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000040:00080000:1.0:1789518433.549551:0:29012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518433.549953:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:1.0:1789518433.549996:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:1.0:1789518433.550028:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:1.0:1789518433.550192:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:1.0:1789518433.550235:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:1.0:1789518433.550281:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:1.0:1789518433.550324:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:1.0:1789518433.550355:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:1.0:1789518433.550430:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:1.0:1789518433.550468:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:1.0:1789518433.550499:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:1.0:1789518433.550558:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:1.0:1789518433.550595:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:1.0:1789518433.550705:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:1.0:1789518433.550936:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:1.0:1789518433.550976:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:1.0:1789518433.551009:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:1.0:1789518433.551057:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:1.0:1789518433.551586:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:1.0:1789518433.551645:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:1.0:1789518433.551711:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:1.0:1789518433.551880:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:1.0:1789518433.551926:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:1.0:1789518433.551981:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:1.0:1789518433.552027:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 128 off12440 00000040:00080000:1.0:1789518433.552065:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12664 00000040:00080000:1.0:1789518433.552129:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12888 00000040:00080000:1.0:1789518433.552166:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off12968 00000040:00080000:1.0:1789518433.552201:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13192 00000040:00080000:1.0:1789518433.552256:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13416 00000040:00080000:1.0:1789518433.552292:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13504 00000040:00080000:1.0:1789518433.552324:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13632 00000040:00080000:1.0:1789518433.552355:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13776 00000040:00080000:1.0:1789518433.552399:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13904 00000040:00080000:1.0:1789518433.552436:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14128 00000040:00080000:1.0:1789518433.553777:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14352 00000040:00080000:1.0:1789518433.553820:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14432 00000040:00080000:1.0:1789518433.553853:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14656 00000040:00080000:1.0:1789518433.553899:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14880 00000040:00080000:1.0:1789518433.553942:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 120 off15000 00000040:00080000:1.0:1789518433.554045:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 224 off15224 00000040:00080000:1.0:1789518433.554052:0:29012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 41 count 42 00000100:00100000:1.0:1789518433.554268:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518433.554328:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.554403:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518433.554451:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627579392 00000100:00100000:3.0:1789518433.554458:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627579392 00000100:00100000:3.0:1789518433.554550:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518433.554559:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627579392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518433.554784:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627579392:12345-0@lo:501:mount.lustre.0 Request processed in 226us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518433.554792:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789518433.554886:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518433.554918:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518433.554952:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518433.554974:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627579520 00000100:00100000:1.0:1789518433.554976:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518433.554978:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627579520 00000100:00100000:0.0:1789518433.555000:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789518433.555016:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627579520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518433.555411:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627579520:12345-0@lo:503:mount.lustre.0 Request processed in 398us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518433.557520:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789518433.557562:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518433.558090:0:29012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518433.558162:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518433.558221:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.558262:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518433.558468:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627579648 00000100:00100000:0.0:1789518433.558474:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627579648 00000100:00100000:0.0:1789518433.558516:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789518433.558525:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627579648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518433.558784:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627579648:12345-0@lo:502:mount.lustre.0 Request processed in 259us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518433.558792:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789518433.558835:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518433.559047:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:0.0:1789518433.559108:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:0.0:1789518433.559158:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:0.0:1789518433.559207:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:0.0:1789518433.559245:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:0.0:1789518433.559296:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:0.0:1789518433.559333:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:0.0:1789518433.559370:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:0.0:1789518433.559419:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:0.0:1789518433.559457:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:0.0:1789518433.559505:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:0.0:1789518433.559571:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:0.0:1789518433.559607:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:0.0:1789518433.559666:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:0.0:1789518433.559715:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:0.0:1789518433.559755:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:0.0:1789518433.559790:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:0.0:1789518433.559840:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:0.0:1789518433.559875:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:0.0:1789518433.559905:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:0.0:1789518433.559949:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:0.0:1789518433.559984:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:0.0:1789518433.560018:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:0.0:1789518433.560065:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:0.0:1789518433.560101:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 128 off12440 00000040:00080000:0.0:1789518433.560135:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12664 00000040:00080000:0.0:1789518433.560199:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12888 00000040:00080000:0.0:1789518433.560236:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off12968 00000040:00080000:0.0:1789518433.560270:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13192 00000040:00080000:0.0:1789518433.560319:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13416 00000040:00080000:0.0:1789518433.560356:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13504 00000040:00080000:0.0:1789518433.560387:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13632 00000040:00080000:0.0:1789518433.560431:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13776 00000040:00080000:0.0:1789518433.560479:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13904 00000040:00080000:0.0:1789518433.560511:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14128 00000040:00080000:0.0:1789518433.560575:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14352 00000040:00080000:0.0:1789518433.560629:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14432 00000040:00080000:0.0:1789518433.560667:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14656 00000040:00080000:0.0:1789518433.560711:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14880 00000040:00080000:0.0:1789518433.560744:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 120 off15000 00000100:00100000:0.0:1789518433.560794:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518433.560850:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518433.560901:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627579776 00000100:00100000:0.0:1789518433.560908:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627579776 00000100:00100000:0.0:1789518433.560956:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789518433.560965:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627579776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518433.561141:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627579776:12345-0@lo:502:mount.lustre.0 Request processed in 177us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518433.561148:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789518433.561195:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518433.561212:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627579776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518433.561272:0:29012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 224 off15224 00000040:00080000:0.0:1789518433.561281:0:29012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789518433.563731:0:29022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789518433.563745:0:29022:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99ffc6510000) 00000020:00000080:3.0:1789518433.563766:0:29022:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789518433.563830:0:29022:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffed824800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789518433.563834:0:29022:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffed824800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789518433.563836:0:29022:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffed824800 3 00010000:00080000:3.0:1789518433.563874:0:29022:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fec1f34800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518433.566867:0:29022:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789518433.567076:0:29022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789518433.567345:0:29022:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518433.567356:0:29022:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x631fd8698c7840ce 00000100:00080000:3.0:1789518433.567365:0:29022:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518433.567374:0:29022:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fec1f34800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518433.567405:0:29022:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffefff3b80 x1876445627579904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518433.567428:0:29022:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518433.567458:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627579904:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789518433.567464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518433.567469:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789518433.567471:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ffedb76000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518433.567475:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1789518433.567480:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789518433.567484:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffedb76000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518433.567499:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffefff1880 x1876445627580160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518433.567522:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518433.567557:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627580288:0@lo:400:kworker.0 00000100:00100000:0.0:1789518433.567669:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518433.567681:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627580032:0@lo:400:kworker.0 00000100:00100000:3.0:1789518433.567748:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518433.567773:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518433.567779:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627580416:0@lo:400:kworker.0 00000100:00100000:3.0:1789518433.567800:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518433.567838:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627579904 00000100:00100000:3.0:1789518433.567843:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627579904 00000100:00100000:3.0:1789518433.567860:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627580288 00000100:00100000:3.0:1789518433.567862:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627580288 00000100:00100000:3.0:1789518433.567879:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627580416 00000100:00100000:3.0:1789518433.567881:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627580416 00000100:00100000:3.0:1789518433.567913:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518433.567920:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627580288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518433.567980:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627580288:12345-0@lo:400:kworker.0 Request processed in 60us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518433.567987:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518433.568001:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518433.568007:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627580416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518433.568039:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627580416:12345-0@lo:400:kworker.0 Request processed in 26us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518433.568044:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518433.568055:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518433.568059:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627579904:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789518433.568076:0:27614:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1789518433.568246:0:27614:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x631fd8698c7840d5 00000004:00100000:3.0:1789518433.568260:0:27614:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789518433.568286:0:27614:0:(import.c:65:import_set_state_nolock()) ffff99ffeabfd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518433.568318:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876445627579904:12345-0@lo:38:llog_process_th.0 Request processed in 257us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518433.568324:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789518433.568344:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789518433.568364:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffefff2680 x1876445627580416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518433.568376:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627580416:0@lo:400:kworker.0 00010000:00080000:3.0:1789518433.568386:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffefff1c00 x1876445627580288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518433.568404:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627580288:0@lo:400:kworker.0 00000100:00100000:0.0:1789518433.568563:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789518433.568736:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffefff3b80 x1876445627579904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518433.568745:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518433.568751:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 5 00000100:00080000:1.0:1789518433.568758:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789518433.568762:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518433.568764:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec1f34800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518433.568770:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627579904:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518433.568793:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627580160:0@lo:8:kworker.0 00000100:00100000:1.0:1789518433.568820:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.570680:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627580032 00000100:00100000:1.0:1789518433.570687:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627580032 00000100:00100000:1.0:1789518433.570730:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627580160 00000100:00100000:1.0:1789518433.570733:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627580160 00000100:00100000:1.0:1789518433.570751:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518433.570760:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627580032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518433.570816:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627580032:12345-0@lo:400:kworker.0 Request processed in 56us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518433.570822:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518433.570837:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518433.570841:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3279:x1876445627580160:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789518433.570880:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3279:x1876445627580160:12345-0@lo:8:kworker.0 Request processed in 37us (2060us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789518433.570886:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789518433.570900:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518433.570924:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836481 gen 2 00000100:00100000:1.0:1789518433.570938:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627580032:0@lo:400:kworker.0 00000100:00100000:1.0:1789518433.570960:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518433.570964:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffedb76000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518433.570968:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789518433.570972:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627580160:0@lo:8:kworker.0 00000040:00080000:3.0:1789518433.571960:0:29022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000020:01000000:1.0:1789518433.572320:0:29012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789518433.572351:0:29012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518433.572369:0:29012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.572387:0:29012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518433.572427:0:29012:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518433.572429:0:29012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518433.572431:0:29012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518433.572432:0:29012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518433.572433:0:29012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518433.572434:0:29012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518433.572435:0:29012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518433.572437:0:29012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518433.572438:0:29012:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518433.572441:0:29012:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789518433.572443:0:29012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518433.572445:0:29012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518433.572446:0:29012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518433.572447:0:29012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518433.572448:0:29012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518433.572449:0:29012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518433.572450:0:29012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518433.572451:0:29012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518433.572452:0:29012:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518433.572470:0:29012:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789518433.572485:0:29012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627580544:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518433.572548:0:29012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518433.572574:0:29012:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518433.572643:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627580544 00000100:00100000:3.0:1789518433.572649:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627580544 00000100:00100000:3.0:1789518433.572681:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789518433.572689:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:29012:x1876445627580544:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518433.572708:0:27606:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789518433.572720:0:27606:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789518433.595822:0:27606:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518433.595834:0:27606:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789518433.595846:0:27628:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789518433.595852:0:27628:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789518433.595871:0:27628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.595898:0:27628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783f93 expref: 19 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.595923:0:27628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.595956:0:27628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c783f93 expref: 19 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.595969:0:27628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c783f93 expref: 19 pid: 27607 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518433.595983:0:27628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27628:1876445627580672:0@lo:104: 00000100:00100000:1.0:1789518433.596054:0:27628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518433.596103:0:27596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627580672 00000100:00100000:1.0:1789518433.596105:0:27628:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518433.596120:0:27596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627580672 00000100:00100000:3.0:1789518433.596174:0:27596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518433.596197:0:27596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:27628:x1876445627580672:12345-0@lo:104: 00010000:00010000:3.0:1789518433.596214:0:27596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518433.596277:0:27596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518433.596284:0:27596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:27628:x1876445627580672:12345-0@lo:104: Request processed in 103us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518433.596292:0:27596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789518433.596303:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518433.596311:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.596329:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518433.596333:0:27601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.596341:0:27601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518433.596347:0:27601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518433.596352:0:27601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518433.596380:0:27601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.596387:0:27601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518433.596413:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.596420:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc200/0x631fd8698c783f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783f9a expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.596436:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518433.596438:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518433.596439:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518433.596446:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518433.596456:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627580800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518433.596466:0:27628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27628:1876445627580672:0@lo:104: 00010000:00010000:1.0:1789518433.596483:0:27628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518433.596483:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518433.596520:0:27598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627580800 00000100:00100000:0.0:1789518433.596524:0:27598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627580800 00010000:00010000:0.0:1789518433.596557:0:27598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783f93 expref: 20 pid: 27607 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518433.596580:0:27598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518433.598338:0:27598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+20:3283:x1876445627580800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518433.598355:0:27598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518433.598363:0:27598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783f93 expref: 20 pid: 27607 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598377:0:27598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c783f93 expref: 20 pid: 27607 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598392:0:27598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28dc00/0x631fd8698c783f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c783f93 expref: 20 pid: 27607 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598405:0:27598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598424:0:27598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789518433.598439:0:27598:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003136568s 00010000:00010000:0.0:1789518433.598444:0:27598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598451:0:27598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598458:0:27598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598465:0:27598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598480:0:27598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518433.598485:0:27598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598493:0:27598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598512:0:27598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518433.598523:0:27598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518433.598572:0:27628:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.598581:0:27628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518433.598588:0:27628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b44c00/0x631fd8698c7840dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518433.598605:0:27598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3283:x1876445627580800:12345-0@lo:103:ldlm_bl.0 Request processed in 281us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518433.598627:0:27598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518433.598689:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627580800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518433.602095:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:29012:x1876445627580544:12345-0@lo:253:mount.lustre.0 Request processed in 29389us (29529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518433.602109:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789518433.602325:0:29012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:29012:1876445627580544:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518433.602340:0:29012:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789518433.602343:0:29012:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518433.602356:0:29012:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518433.602357:0:29012:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518433.602359:0:29012:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518433.602360:0:29012:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518433.602361:0:29012:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518433.602362:0:29012:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518433.602364:0:29012:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518433.602365:0:29012:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789518433.602378:0:29012:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789518433.602862:0:29012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518433.603328:0:29012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518433.603479:0:29012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518433.603597:0:29012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518433.603806:0:29012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518433.604031:0:29012:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789518433.604984:0:29012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836480 00002000:00080000:3.0:1789518433.650700:0:29012:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789518433.650709:0:29012:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789518433.650740:0:29012:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789518433.650810:0:29012:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789518433.650822:0:29012:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789518433.650845:0:29012:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1789518433.907027:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518433.907115:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627580928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518433.907186:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518433.907376:0:28300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627580928 00000100:00100000:2.0:1789518433.907383:0:28300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627580928 00000100:00100000:2.0:1789518433.907420:0:28300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518433.907427:0:28300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627580928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518433.907459:0:28300:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518433.907553:0:28300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627580928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518433.907559:0:28300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518433.907643:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627580928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789518434.162704:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518435.186753:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789518435.378869:0:27609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518435.378877:0:27609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99fffbb6a000 from 17 10000000:01000000:3.0:1789518435.378882:0:27609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518435.378916:0:27609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518435.378925:0:27609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518435.378933:0:27609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518435.378953:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627581056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518435.379078:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518435.379180:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518435.379311:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627581056 00000100:00100000:0.0:1789518435.379318:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627581056 00000100:00100000:0.0:1789518435.379361:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789518435.379371:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:27609:x1876445627581056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518435.379383:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518435.379400:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28d200/0x631fd8698c7840ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7840e3 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518435.379432:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28d200/0x631fd8698c7840ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7840e3 expref: 19 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518435.379442:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28d200/0x631fd8698c7840ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7840e3 expref: 19 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518435.379451:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d200, rc 0) 00000100:00100000:0.0:1789518435.379503:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:27609:x1876445627581056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518435.379510:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518435.379530:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627581056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518435.379545:0:27609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518435.379552:0:27609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518435.379594:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627581184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518435.379671:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518435.379698:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627581184 00000100:00100000:3.0:1789518435.379701:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518435.379704:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627581184 00000100:00100000:0.0:1789518435.379738:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518435.379745:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:27609:x1876445627581184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789518435.379757:0:27606:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518435.379772:0:27606:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518435.379775:0:27606:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 17 00000100:00100000:0.0:1789518435.379859:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:27609:x1876445627581184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518435.379867:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627581184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789518435.379868:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 10000000:01000000:3.0:1789518435.379919:0:27609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518435.379924:0:27609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518435.379931:0:27609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518436.212271:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518436.935066:0:29367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789518437.234758:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518438.261303:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518438.409120:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.409234:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617177088 00000100:00100000:0.0:1789518438.409249:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617177088 00000100:00100000:0.0:1789518438.409312:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1789518438.409323:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2341:x1876445617177088:12345-192.168.206.51@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789518438.409369:0:27605:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from aa3cece6-566d-43f3-ac47-832f8444672f@192.168.206.51@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1789518438.409414:0:27605:0:(genops.c:1384:class_connect()) connect: client aa3cece6-566d-43f3-ac47-832f8444672f, cookie 0x631fd8698c7840f1 00000100:00080000:0.0:1789518438.409556:0:27605:0:(import.c:65:import_set_state_nolock()) ffff99fec1e9c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518438.409722:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+5:2341:x1876445617177088:12345-192.168.206.51@tcp:250:mount.lustre.0 Request processed in 400us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.409730:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1789518438.412159:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.412285:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617177216 00000100:00100000:0.0:1789518438.412294:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617177216 00000100:00100000:0.0:1789518438.412343:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1789518438.412351:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+5:24071:x1876445617177216:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518438.412366:0:27606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518438.412385:0:27606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c800/0x631fd8698c7840f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd2ff expref: -99 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.412412:0:27606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c800/0x631fd8698c7840f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ff expref: 6 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.412422:0:27606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c800/0x631fd8698c7840f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ff expref: 6 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.412430:0:27606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c800, rc 0) 00000100:00100000:0.0:1789518438.412478:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+6:24071:x1876445617177216:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 127us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.412485:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1789518438.414736:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.414915:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617177344 00000100:00100000:0.0:1789518438.414927:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617177344 00000100:00100000:0.0:1789518438.415033:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1789518438.415079:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+6:24071:x1876445617177344:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518438.415480:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+6:24071:x1876445617177344:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 419us (756us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518438.415488:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:3.0:1789518438.419055:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.419227:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617177472 00000100:00100000:0.0:1789518438.419238:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617177472 00000100:00100000:0.0:1789518438.419341:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:0.0:1789518438.419360:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+6:24071:x1876445617177472:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518438.419382:0:27606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518438.419404:0:27606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c400/0x631fd8698c7840ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd306 expref: -99 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.419449:0:27606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c400/0x631fd8698c7840ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd306 expref: 7 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.419461:0:27606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c400/0x631fd8698c7840ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd306 expref: 7 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.419472:0:27606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c400, rc 0) 00000100:00100000:0.0:1789518438.419552:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+7:24071:x1876445617177472:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 202us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.419560:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:2.0:1789518438.428555:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.428752:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617177600 00000100:00100000:0.0:1789518438.428765:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617177600 00000100:00100000:0.0:1789518438.428826:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1789518438.428837:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+7:24071:x1876445617177600:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518438.429271:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+8:24071:x1876445617177600:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 434us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.429289:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1789518438.431487:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.431668:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617177728 00000100:00100000:0.0:1789518438.431678:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617177728 00000100:00100000:0.0:1789518438.431776:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:0.0:1789518438.431789:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+8:24071:x1876445617177728:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789518438.432248:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+8:24071:x1876445617177728:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 458us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.433149:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518438.436840:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.436954:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617177856 00000100:00100000:0.0:1789518438.436966:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617177856 00000100:00100000:0.0:1789518438.437036:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1789518438.437048:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+8:24089:x1876445617177856:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518438.437753:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+8:24089:x1876445617177856:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 705us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.437762:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:2.0:1789518438.452862:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.453274:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617177984 00000100:00100000:0.0:1789518438.453286:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617177984 00000100:00100000:0.0:1789518438.453361:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1789518438.453373:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+8:24089:x1876445617177984:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518438.453836:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+8:24089:x1876445617177984:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 464us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.453846:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:1.0:1789518438.461717:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.461983:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617178112 00000100:00100000:0.0:1789518438.462005:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617178112 00000100:00100000:0.0:1789518438.462087:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1789518438.462099:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+8:24071:x1876445617178112:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518438.462119:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518438.462140:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28dc00/0x631fd8698c784106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd330 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.462175:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28dc00/0x631fd8698c784106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd330 expref: 9 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.462187:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28dc00/0x631fd8698c784106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd330 expref: 9 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.462196:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28dc00, rc 0) 00000100:00100000:0.0:1789518438.462446:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+9:24071:x1876445617178112:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 348us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.462454:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1789518438.466382:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518438.466702:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617178240 00000100:00100000:3.0:1789518438.466713:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617178240 00000100:00100000:3.0:1789518438.466793:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1789518438.466801:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+9:24071:x1876445617178240:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789518438.466829:0:27607:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789518438.466854:0:27607:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789518438.466857:0:27607:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789518438.466859:0:27607:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789518438.466861:0:27607:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 17 00000100:00100000:0.0:1789518438.469975:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+9:24071:x1876445617178240:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 3162us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.469991:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1789518438.473340:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.473595:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617178368 00000100:00100000:0.0:1789518438.473606:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617178368 00000100:00100000:0.0:1789518438.473690:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:0.0:1789518438.473699:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+9:24071:x1876445617178368:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518438.473717:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518438.473736:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd337 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.473766:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd337 expref: 10 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.473791:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd337 expref: 10 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518438.473802:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c600, rc 0) 00000100:00100000:0.0:1789518438.473882:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+10:24071:x1876445617178368:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 182us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.473890:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518438.479261:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.479334:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617178496 00000100:00100000:0.0:1789518438.479346:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617178496 00000100:00100000:0.0:1789518438.479413:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1789518438.479424:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+10:24071:x1876445617178496:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518438.479827:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+10:24071:x1876445617178496:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 402us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.479836:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:2.0:1789518438.482399:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.482522:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617178624 00000100:00100000:0.0:1789518438.482533:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617178624 00000100:00100000:0.0:1789518438.482596:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:0.0:1789518438.482607:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+10:24071:x1876445617178624:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789518438.483431:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+10:24071:x1876445617178624:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 824us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.483441:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1789518438.486731:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.486886:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617178752 00000100:00100000:0.0:1789518438.486898:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617178752 00000100:00100000:0.0:1789518438.486960:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:0.0:1789518438.486972:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+10:24091:x1876445617178752:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518438.487724:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+10:24091:x1876445617178752:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 751us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.487741:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1789518438.490905:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.491142:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617178880 00000100:00100000:0.0:1789518438.491154:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617178880 00000100:00100000:0.0:1789518438.491254:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:0.0:1789518438.491266:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+10:24091:x1876445617178880:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518438.491582:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+10:24091:x1876445617178880:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 313us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.491591:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:2.0:1789518438.495331:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.495599:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617179008 00000100:00100000:0.0:1789518438.495610:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617179008 00000100:00100000:0.0:1789518438.495784:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1789518438.495795:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2341:x1876445617179008:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518438.495832:0:27614:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 17243dca-1507-4dd5-aeba-e5e161042040@192.168.206.51@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1789518438.495897:0:27614:0:(genops.c:1384:class_connect()) connect: client 17243dca-1507-4dd5-aeba-e5e161042040, cookie 0x631fd8698c784114 00000004:00100000:0.0:1789518438.496315:0:27614:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789518438.496325:0:27614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836480 00000100:00080000:2.0:1789518438.533588:0:27614:0:(import.c:65:import_set_state_nolock()) ffff99ffee440800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518438.533681:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+6:2341:x1876445617179008:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 37885us (38360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518438.533702:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518438.535570:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.535962:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617179136 00000100:00100000:0.0:1789518438.535971:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617179136 00000100:00080000:1.0:1789518438.536018:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518438.536040:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518438.536052:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+6:0:x1876445617179136:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518438.536104:0:27613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789518438.536189:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+6:0:x1876445617179136:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 139us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518438.536211:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518438.536600:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518438.536721:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617179264 00000100:00100000:2.0:1789518438.536731:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617179264 00000100:00100000:2.0:1789518438.536759:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518438.536767:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+6:24071:x1876445617179264:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789518438.536781:0:27614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789518438.536826:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+6:24071:x1876445617179264:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518438.536832:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518438.539799:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518438.540577:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617179392 00000100:00100000:0.0:1789518438.540587:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617179392 00000100:00100000:0.0:1789518438.540686:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518438.540916:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+6:24071:x1876445617179392:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789518438.541031:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+6:24071:x1876445617179392:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 228us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518438.541052:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518438.543456:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518438.543483:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518438.543546:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617179520 00000100:00100000:3.0:1789518438.543555:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617179520 00000100:00100000:1.0:1789518438.543564:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518438.543586:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617179648 00000100:00100000:3.0:1789518438.543590:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617179648 00000100:00100000:3.0:1789518438.543693:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518438.543703:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876445617179520:12345-192.168.206.51@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789518438.543717:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518438.543725:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445617179648:12345-192.168.206.51@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789518438.543729:0:27615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617179776 00010000:00080000:3.0:1789518438.543734:0:28297:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 17243dca-1507-4dd5-aeba-e5e161042040@192.168.206.51@tcp t0 exp 0000000000000000 cur 492 last 0 00000100:00100000:0.0:1789518438.543735:0:27615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617179776 00010000:00080000:1.0:1789518438.543746:0:28295:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 17243dca-1507-4dd5-aeba-e5e161042040@192.168.206.51@tcp t0 exp 0000000000000000 cur 492 last 0 00000100:00100000:0.0:1789518438.543763:0:27615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000020:00000080:3.0:1789518438.543769:0:28297:0:(genops.c:1384:class_connect()) connect: client 17243dca-1507-4dd5-aeba-e5e161042040, cookie 0x631fd8698c78411b 00000100:00100000:0.0:1789518438.543771:0:27615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+6:24071:x1876445617179776:12345-192.168.206.51@tcp:33:mount.lustre.0 00000020:00000080:1.0:1789518438.543781:0:28295:0:(genops.c:1384:class_connect()) connect: client 17243dca-1507-4dd5-aeba-e5e161042040, cookie 0x631fd8698c784122 00002000:00100000:1.0:1789518438.543793:0:28295:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 17243dca-1507-4dd5-aeba-e5e161042040/ffff99ffd8b20800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518438.543798:0:28297:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 17243dca-1507-4dd5-aeba-e5e161042040/ffff99fec1f32800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789518438.543814:0:28295:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:3.0:1789518438.543816:0:28297:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789518438.544137:0:28295:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789518438.544164:0:28295:0:(import.c:65:import_set_state_nolock()) ffff99ffd8b27800 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1789518438.544285:0:28297:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789518438.544289:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17243dca-1507-4dd5-aeba-e5e161042040+6:2341:x1876445617179648:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 561us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518438.544299:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00080000:3.0:1789518438.544303:0:28297:0:(import.c:65:import_set_state_nolock()) ffff99fec1f31000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518438.544329:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+6:2341:x1876445617179520:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 627us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518438.544337:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000004:00080000:0.0:1789518438.546707:0:27615:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2888us 00000004:00200000:2.0:1789518438.555222:0:27615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789518438.555370:0:27615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+6:24071:x1876445617179776:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 11595us (11802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518438.555382:0:27615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518438.711129:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518438.711186:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617179904 00000100:00100000:2.0:1789518438.711196:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617179904 00000100:00100000:2.0:1789518438.711253:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1789518438.711269:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+6:24112:x1876445617179904:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:2.0:1789518438.711290:0:27614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518438.711312:0:27614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd361 expref: -99 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518438.711378:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c784130 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518438.711390:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c784130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518438.711405:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c784130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518438.711459:0:27614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518438.711463:0:27614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518438.711498:0:27614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c784130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518438.711541:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd361 expref: 8 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518438.711558:0:27614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c784130 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd361 expref: 7 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518438.711566:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16000) 00010000:00010000:2.0:1789518438.711569:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518438.711573:0:27614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17600, rc 0) 00000100:00100000:2.0:1789518438.711667:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+7:24112:x1876445617179904:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 401us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518438.711675:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518439.026957:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518439.026977:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627581312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518439.027041:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518439.027087:0:28299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627581312 00000100:00100000:2.0:1789518439.027095:0:28299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627581312 00000100:00080000:1.0:1789518439.027198:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518439.027315:0:28299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518439.027325:0:28299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627581312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518439.027346:0:28299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518439.027390:0:28299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627581312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518439.027397:0:28299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518439.028029:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627581312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518439.029925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518439.029932:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789518439.029937:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ffedb76000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518439.029950:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffedb76000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518439.029973:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff4b1dc00 x1876445627581568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518439.030036:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627581696:0@lo:400:kworker.0 00000100:00100000:3.0:1789518439.030039:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627581568:0@lo:8:kworker.0 00000100:00100000:0.0:1789518439.030398:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518439.030580:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518439.030685:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518439.030692:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627581824:0@lo:400:kworker.0 00000100:00100000:0.0:1789518439.030729:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518439.030779:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627581696 00000100:00100000:0.0:1789518439.030786:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627581696 00000100:00100000:0.0:1789518439.030821:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627581824 00000100:00100000:0.0:1789518439.030825:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627581824 00000100:00100000:2.0:1789518439.030902:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518439.030963:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627581952:0@lo:400:kworker.0 00000100:00100000:0.0:1789518439.031007:0:27613:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789518439.031014:0:27613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1789518439.031044:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518439.031056:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518439.031073:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518439.031079:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3280:1876445627581440:0@lo:400:kworker.0 00000100:00100000:1.0:1789518439.031105:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518439.031196:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627581568 00000100:00100000:1.0:1789518439.031201:0:27614:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789518439.031202:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627581568 00000100:00100000:1.0:1789518439.031209:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627581952 00000100:00100000:1.0:1789518439.031220:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627581952 00000100:00100000:3.0:1789518439.031230:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518439.031236:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3279:x1876445627581568:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789518439.031264:0:28297:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:3.0:1789518439.031290:0:28297:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c784137 00002000:00100000:3.0:1789518439.031302:0:28297:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99fec1f36800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789518439.031320:0:28297:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789518439.031323:0:28297:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789518439.034697:0:28297:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518439.034731:0:28297:0:(import.c:65:import_set_state_nolock()) ffff99fec1f37000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518439.034831:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627581568:12345-0@lo:8:kworker.0 Request processed in 3592us (4249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518439.034853:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789518439.034915:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff4b1dc00 x1876445627581568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789518439.034930:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 5 00000100:00080000:3.0:1789518439.034939:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789518439.034944:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789518439.034946:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffedb76000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789518439.034960:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789518439.034965:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627581568:0@lo:8:kworker.0 00000004:00080000:3.0:1789518439.035024:0:27637:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x63:0x0] 00000100:00100000:3.0:1789518439.035044:0:27637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:27637:1876445627582208:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789518439.035245:0:27637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518439.035265:0:27637:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d02f00 going to sleep for 11 seconds 00000004:00080000:0.0:1789518439.035548:0:27636:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789518439.035929:0:27636:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 493032314358ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789518439.035978:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627581440 00000100:00100000:0.0:1789518439.035986:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627581440 00000100:00100000:0.0:1789518439.036022:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789518439.036032:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3280:x1876445627581440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518439.036122:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3280:x1876445627581440:12345-0@lo:400:kworker.0 Request processed in 91us (5015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518439.036129:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789518439.036288:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627582208 00000100:00100000:1.0:1789518439.036293:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627582208 00000100:00100000:1.0:1789518439.036327:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518439.036336:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:27637:x1876445627582208:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789518439.036451:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3280:1876445627581440:0@lo:400:kworker.0 00000100:00100000:0.0:1789518439.036467:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518439.036478:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627582080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518439.036526:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518439.036573:0:28299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627582080 00000100:00100000:0.0:1789518439.036578:0:28299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627582080 00000100:00100000:0.0:1789518439.036608:0:28299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518439.036639:0:28299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627582080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518439.036654:0:28299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789518439.036697:0:28299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627582080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518439.036704:0:28299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789518439.036739:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffefff1c00 x1876445627582080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518439.036757:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627582080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518439.036794:0:27614:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789518439.036812:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518439.036821:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627581824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518439.036874:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627581824:12345-0@lo:400:kworker.0 Request processed in 56us (6146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518439.036880:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518439.036913:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627581824:0@lo:400:kworker.0 00000100:00100000:0.0:1789518439.036933:0:27614:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789518439.036943:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518439.036950:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627581952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518439.036994:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627581952:12345-0@lo:400:kworker.0 Request processed in 45us (5938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518439.037001:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518439.037036:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627581952:0@lo:400:kworker.0 00000100:00080000:0.0:1789518439.037069:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518439.037073:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1789518439.042170:0:28295:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789518439.042181:0:28295:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -30 00002000:02000040:1.0:1789518439.042186:0:28295:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:129) 00000100:00100000:2.0:1789518439.042709:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627581696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518439.042822:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627581696:12345-0@lo:400:kworker.0 Request processed in 11910us (12424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518439.042832:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518439.042889:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627581696:0@lo:400:kworker.0 00002000:00010000:1.0:1789518439.051420:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518439.051431:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.051448:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1789518439.051452:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518439.051459:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.051475:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.051486:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.051494:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.051524:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789518439.051950:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518439.051962:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.051971:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1789518439.051974:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518439.051978:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.051988:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.051996:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052004:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052026:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789518439.052091:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518439.052106:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052116:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.052121:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052130:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052151:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052159:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f828f2/0x631fd8698c78413e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052185:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.052189:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052198:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.052209:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052217:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052228:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052235:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dada4965/0x631fd8698c784145 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052249:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.052251:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.052253:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518439.052371:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518439.052377:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052385:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1789518439.052388:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518439.052392:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052401:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052414:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052422:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052440:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.052469:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.052476:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052484:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.052487:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052495:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052518:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052534:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c78414c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.052553:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.052555:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.052558:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518439.052853:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518439.052859:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052867:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e:0x0].0x0 since=493s v=(0 0) 00010000:00010000:1.0:1789518439.052871:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518439.052874:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052884:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052892:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052900:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052924:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518439.052933:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518439.052937:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052945:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518439.052949:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052957:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052969:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052976:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c784153 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.052993:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.052995:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.052997:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518439.053465:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.053544:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.053550:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.053558:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.053561:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.053565:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.053576:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.053589:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.053596:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.053632:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518439.054004:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.054010:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054019:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.054022:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.054027:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054037:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054046:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054053:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054077:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789518439.054085:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518439.054089:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054096:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518439.054100:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054108:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054120:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054127:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aed742a/0x631fd8698c78415a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054140:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518439.054143:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054149:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28cc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518439.054152:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054169:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054178:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054185:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4997809/0x631fd8698c784161 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.054196:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518439.054197:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518439.054199:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.055006:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.057146:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.057160:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.057178:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.057182:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.057188:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.057202:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.057213:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.057227:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.057246:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.057656:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.057663:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.057671:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28de00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.057676:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.057685:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.057699:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.057706:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d014bd9/0x631fd8698c784168 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.057723:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.057725:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.057732:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.058372:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.058379:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.058389:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.058393:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.058397:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.058407:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.058415:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.058422:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.058442:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.058896:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.058903:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.058913:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ce00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.058917:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.058926:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.058940:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.058948:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f30fa5b/0x631fd8698c78416f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.058966:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.058968:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.058970:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.059642:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.059650:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.059678:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.059683:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.059688:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.059699:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.059815:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.059823:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.059841:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.059903:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.059911:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.059921:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.059925:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.059946:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.059960:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.059968:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c784176 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.060072:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.060076:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.060080:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.061308:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.061318:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.061330:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.061334:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.061339:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.061352:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.061372:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.061380:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.061397:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.061925:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.061933:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.061948:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.061953:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.061963:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.061978:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518439.062029:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.062035:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.062044:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.062047:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.062051:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.062060:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.062068:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.062076:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.062099:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.062225:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c26b8d2f/0x631fd8698c78417d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.062251:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.062255:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.062261:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.062265:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.062272:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.062282:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.062289:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c784184 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.062318:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.062320:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.062321:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.062327:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.062968:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.062975:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.062985:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.062988:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.062993:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.063003:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.063012:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.063020:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.063031:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.063370:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.063377:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.063391:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.063395:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.063404:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.063417:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.063424:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78418b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.063455:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.063457:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.063459:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.064955:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.064963:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.064975:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.065044:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.065050:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.065062:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.065071:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.065078:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.065098:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.065229:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.065236:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.065244:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.065249:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.065258:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.065278:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.065286:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c784192 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.065303:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.065305:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.065306:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.065934:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.065941:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.065950:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.065953:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.065958:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.065967:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.065975:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.066081:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.066662:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.066773:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.066781:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.066790:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.066795:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.066804:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.066820:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.066827:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c784199 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.067294:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.067298:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.067298:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518439.067301:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518439.067308:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067321:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.067325:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.067330:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067341:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067350:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067358:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067380:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.067403:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.067409:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.067417:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.067421:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.067429:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.067442:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.067449:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c7841a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.067467:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.067470:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.067471:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.067910:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.067917:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067933:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.067937:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.067942:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067953:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067963:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067971:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.067988:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.068311:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.068318:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.068336:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.068341:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.068351:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.068365:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.068372:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c7841a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.068491:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.068494:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.068497:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.069674:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.069685:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.069697:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.069702:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.069707:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.069720:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.069742:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.069750:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.069768:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518439.069823:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518439.069831:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.069840:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518439.069852:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.069861:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.069878:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.069885:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7841ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.069904:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.069907:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.069910:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.070344:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.070351:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.070360:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.070364:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.070368:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.070378:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.070385:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.070393:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.070420:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518439.070429:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.070437:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.070447:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.070451:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.070460:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.070481:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.070488:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c7841b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.070516:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.070520:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.070522:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.071079:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.071086:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.071094:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.071098:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.071103:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.071113:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.071121:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.071128:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.071144:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518439.072251:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.072258:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.072270:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.072281:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.072287:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.072298:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.072306:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.072313:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.072331:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789518439.072539:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518439.072546:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.072555:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518439.072560:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.072569:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.072583:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.072763:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518439.073268:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7841bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.073385:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.073388:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.073391:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.073796:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.073800:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.073802:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518439.073812:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.073824:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518439.073829:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.073848:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.073864:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.073883:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c7841c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.073899:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518439.073900:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518439.073902:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789518439.076035:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17243dca-1507-4dd5-aeba-e5e161042040 00002000:00010000:0.0:1789518439.078401:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.078416:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.078437:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.078442:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.078450:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.078468:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.078481:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.078500:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.078540:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518439.078632:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518439.078648:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.078663:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518439.078670:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.078685:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.078720:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.078730:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c7841ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.078758:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.078759:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.078761:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.080204:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.080216:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.080234:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.080239:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.080246:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.080259:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.080269:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.080277:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.080309:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789518439.081706:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.081717:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.081753:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.081865:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.081873:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.081890:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.081901:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.081909:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083369:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518439.083385:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518439.083386:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083405:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518439.083412:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083423:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083445:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083454:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c7841d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083479:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518439.083483:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083499:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518439.083516:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083633:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083649:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.083657:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c7841d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.083719:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.083723:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.083725:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.085204:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.085216:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.085238:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.085243:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.085251:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.085267:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.085291:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.085300:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.085325:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518439.085359:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518439.085369:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.085381:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518439.085387:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.085398:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.085418:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.085426:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c7841df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.085452:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.085455:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.085457:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.086004:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.086013:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086025:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.086029:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.086034:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086046:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086057:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086065:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086105:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518439.086130:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518439.086140:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.086149:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518439.086154:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.086162:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.086176:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.086195:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7841e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.086231:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518439.086233:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518439.086235:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.086691:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.086698:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086708:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.086712:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.086716:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086726:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086735:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086742:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.086759:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518439.086928:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518439.086938:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.086948:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518439.086952:0:27601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.086974:0:27601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.086989:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.086997:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c7841ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518439.087015:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.087017:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.087018:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518439.088239:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518439.088251:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.088269:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789518439.088286:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518439.088293:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.088307:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.088317:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.088324:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.088412:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789518439.088810:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:1.0:1789518439.088992:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 17243dca-1507-4dd5-aeba-e5e161042040 00010000:00010000:3.0:1789518439.091286:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518439.091303:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.091318:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518439.091324:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.091337:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.091366:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518439.091375:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c7841f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.091488:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.091494:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.091498:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518439.092012:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518439.092021:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092038:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=493s v=(0 0) 00010000:00010000:2.0:1789518439.092042:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518439.092048:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092136:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092147:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092155:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092178:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789518439.092607:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518439.092638:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092647:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=493s v=(0 0) 00010000:00010000:2.0:1789518439.092651:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518439.092655:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092664:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092673:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092691:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092706:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789518439.092716:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518439.092721:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092729:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.092734:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092743:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092759:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092766:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c7841fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092783:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518439.092787:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092803:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518439.092807:0:27600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092814:0:27600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092824:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092832:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784202 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.092842:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.092844:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518439.092846:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.092941:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518439.093422:0:28295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518439.093429:0:28295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.093439:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=493s v=(0 0) 00010000:00010000:2.0:1789518439.093442:0:28295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518439.093447:0:28295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.093456:0:28295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.093469:0:28295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.093477:0:28295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518439.093486:0:28295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789518439.093736:0:28295:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:99 00000100:00100000:2.0:1789518439.093829:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:27637:x1876445627582208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 57492us (58581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518439.093839:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789518439.094104:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518439.094117:0:29484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.094132:0:29484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518439.094138:0:29484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.094151:0:29484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.094172:0:29484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518439.094201:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c00b65d5/0x631fd8698c784209 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518439.095107:0:27637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:27637:1876445627582208:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789518439.095124:0:27637:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x81:0x0] from OST, last_created [0x280000400:0x81:0x0]last_used is [0x280000400:0x63:0x0] 00000100:00100000:1.0:1789518439.095166:0:27637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:27637:1876445627582336:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789518439.095203:0:27637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518439.095310:0:27637:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe0496840 going to sleep for 11 seconds 00010000:00010000:1.0:1789518439.095324:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.095326:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518439.095329:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518439.095381:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627582336 00000100:00100000:3.0:1789518439.095395:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627582336 00000100:00100000:3.0:1789518439.095467:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518439.095489:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:27637:x1876445627582336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789518439.095557:0:28297:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 130 00000100:00100000:2.0:1789518439.100901:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:27637:x1876445627582336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5407us (5690us total) trans 21474836481 rc 0/0 00000100:00100000:2.0:1789518439.100915:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518439.101588:0:27637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:27637:1876445627582336:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789518439.101626:0:27637:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x81:0x0]-[0x280000400:0xa1:0x0] 00010000:00010000:2.0:1789518439.283020:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518440.306913:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518440.414676:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.414793:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617180032 00000100:00100000:0.0:1789518440.414806:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617180032 00000100:00080000:2.0:1789518440.414959:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518440.415134:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518440.415147:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+6:24164:x1876445617180032:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:0.0:1789518440.415203:0:27614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789518440.415323:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+6:24164:x1876445617180032:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 178us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.415332:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518440.419780:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518440.419865:0:28299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617180160 00000100:00100000:2.0:1789518440.419878:0:28299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617180160 00000100:00100000:2.0:1789518440.419980:0:28299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518440.419993:0:28299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17243dca-1507-4dd5-aeba-e5e161042040+6:24164:x1876445617180160:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1789518440.420044:0:28299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518440.420167:0:28299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17243dca-1507-4dd5-aeba-e5e161042040+6:24164:x1876445617180160:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 177us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518440.420176:0:28299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00080000:0.0:1789518440.420197:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518440.422513:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518440.423021:0:28299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617180288 00000100:00100000:2.0:1789518440.423051:0:28299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617180288 00000100:00100000:2.0:1789518440.423133:0:28299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518440.423145:0:28299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17243dca-1507-4dd5-aeba-e5e161042040+5:24164:x1876445617180288:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1789518440.423178:0:28299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00080000:0.0:1789518440.423368:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518440.423412:0:28299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17243dca-1507-4dd5-aeba-e5e161042040+5:24164:x1876445617180288:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 268us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518440.423420:0:28299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518440.521798:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.522315:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617180416 00000100:00100000:0.0:1789518440.522332:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617180416 00000100:00100000:0.0:1789518440.522416:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:0.0:1789518440.522427:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+10:24196:x1876445617180416:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518440.522447:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518440.522470:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0697c00/0x631fd8698c784210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd368 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.522525:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0697c00/0x631fd8698c784210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd368 expref: 11 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.522538:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0697c00/0x631fd8698c784210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd368 expref: 11 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.522565:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697c00, rc 0) 00000100:00100000:0.0:1789518440.522687:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+11:24196:x1876445617180416:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 252us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.522694:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:3.0:1789518440.529821:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.529927:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617180544 00000100:00100000:0.0:1789518440.529936:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617180544 00000100:00100000:0.0:1789518440.529988:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:0.0:1789518440.529997:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+11:24196:x1876445617180544:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518440.531525:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+11:24196:x1876445617180544:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 1519us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.531538:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:1.0:1789518440.536223:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.536313:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617180672 00000100:00100000:0.0:1789518440.536323:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617180672 00000100:00100000:0.0:1789518440.536374:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:0.0:1789518440.536384:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+11:24196:x1876445617180672:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789518440.537528:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+11:24196:x1876445617180672:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 1137us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.537538:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:1.0:1789518440.541528:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.541646:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617180800 00000100:00100000:0.0:1789518440.541656:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617180800 00000100:00100000:0.0:1789518440.541766:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:0.0:1789518440.541775:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+11:24203:x1876445617180800:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518440.542038:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+11:24203:x1876445617180800:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 263us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.542057:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:3.0:1789518440.549964:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.550102:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617180928 00000100:00100000:0.0:1789518440.550114:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617180928 00000100:00100000:0.0:1789518440.550241:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:0.0:1789518440.550254:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+11:24203:x1876445617180928:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518440.550763:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+11:24203:x1876445617180928:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 511us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.550773:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:1.0:1789518440.554047:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.554472:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617181056 00000100:00100000:0.0:1789518440.554485:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617181056 00000100:00100000:0.0:1789518440.554654:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:0.0:1789518440.554666:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+11:24196:x1876445617181056:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518440.554687:0:27606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518440.554711:0:27606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0697e00/0x631fd8698c784217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd392 expref: -99 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.554760:0:27606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0697e00/0x631fd8698c784217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd392 expref: 12 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.554775:0:27606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0697e00/0x631fd8698c784217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd392 expref: 12 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.554788:0:27606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697e00, rc 0) 00000100:00100000:0.0:1789518440.554873:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+12:24196:x1876445617181056:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 209us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.554881:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:1.0:1789518440.559398:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.560128:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617181184 00000100:00100000:0.0:1789518440.560143:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617181184 00000100:00100000:0.0:1789518440.560261:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:0.0:1789518440.560272:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+12:24196:x1876445617181184:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789518440.560303:0:27605:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789518440.560333:0:27605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789518440.560338:0:27605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789518440.560342:0:27605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789518440.560344:0:27605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 17 00000100:00100000:0.0:1789518440.564397:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+12:24196:x1876445617181184:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 4116us (4998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.564414:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:1.0:1789518440.567763:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.567857:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617181312 00000100:00100000:0.0:1789518440.567867:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617181312 00000100:00100000:0.0:1789518440.567935:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:0.0:1789518440.567948:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+12:24196:x1876445617181312:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518440.567970:0:27606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518440.567994:0:27606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd399 expref: -99 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.568096:0:27606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd399 expref: 13 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.568113:0:27606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd399 expref: 13 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.568124:0:27606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696000, rc 0) 00000100:00100000:0.0:1789518440.568347:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+13:24196:x1876445617181312:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 401us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.568371:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:1.0:1789518440.569832:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.569893:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617181440 00000100:00100000:0.0:1789518440.569902:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617181440 00000100:00100000:0.0:1789518440.569952:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:0.0:1789518440.569962:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+13:24196:x1876445617181440:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518440.570301:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+13:24196:x1876445617181440:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 340us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.570310:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1789518440.571998:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.572069:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617181568 00000100:00100000:0.0:1789518440.572078:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617181568 00000100:00100000:0.0:1789518440.572133:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:0.0:1789518440.572144:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+13:24196:x1876445617181568:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789518440.572374:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+13:24196:x1876445617181568:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 232us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.572383:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:1.0:1789518440.574007:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.574136:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617181696 00000100:00100000:0.0:1789518440.574145:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617181696 00000100:00100000:0.0:1789518440.574197:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:0.0:1789518440.574208:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+13:24208:x1876445617181696:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518440.574477:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+13:24208:x1876445617181696:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 269us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.574508:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:1.0:1789518440.578972:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.579845:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617181824 00000100:00100000:0.0:1789518440.579860:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617181824 00000100:00100000:0.0:1789518440.579964:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:0.0:1789518440.579978:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+13:24208:x1876445617181824:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518440.580362:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+13:24208:x1876445617181824:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 386us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.580373:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:3.0:1789518440.585987:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.586337:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617181952 00000100:00100000:0.0:1789518440.586349:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617181952 00000100:00100000:0.0:1789518440.586411:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518440.586421:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2341:x1876445617181952:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518440.586458:0:29483:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2b8c6672-a13d-4697-9151-ddc44fea933a@192.168.206.51@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1789518440.586526:0:29483:0:(genops.c:1384:class_connect()) connect: client 2b8c6672-a13d-4697-9151-ddc44fea933a, cookie 0x631fd8698c784225 00000004:00100000:0.0:1789518440.586565:0:29483:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789518440.586917:0:29483:0:(import.c:65:import_set_state_nolock()) ffff99ffdf98f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518440.587016:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+6:2341:x1876445617181952:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 594us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.587025:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518440.595433:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518440.595547:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.597736:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617182208 00000100:00100000:0.0:1789518440.597752:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617182208 00000100:00100000:3.0:1789518440.597815:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617182080 00000100:00100000:3.0:1789518440.597822:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617182080 00000100:00100000:3.0:1789518440.597908:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518440.597923:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+7:0:x1876445617182080:12345-192.168.206.51@tcp:41:mount.lustre.0 00000100:00080000:2.0:1789518440.597946:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1789518440.597966:0:27613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789518440.598044:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518440.598054:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b8c6672-a13d-4697-9151-ddc44fea933a+7:24196:x1876445617182208:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518440.598069:0:27614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789518440.598071:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+7:0:x1876445617182080:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 152us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518440.598081:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518440.598111:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b8c6672-a13d-4697-9151-ddc44fea933a+6:24196:x1876445617182208:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 57us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.598119:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518440.604973:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518440.606382:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617182336 00000100:00100000:3.0:1789518440.606398:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617182336 00000100:00100000:3.0:1789518440.606552:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518440.606565:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+6:24196:x1876445617182336:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789518440.606720:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+6:24196:x1876445617182336:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 157us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518440.606729:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518440.610574:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518440.610674:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518440.610771:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518440.610999:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617182464 00000100:00100000:1.0:1789518440.611012:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617182464 00000100:00100000:1.0:1789518440.611057:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617182592 00000100:00100000:1.0:1789518440.611060:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617182592 00000100:00100000:1.0:1789518440.611082:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518440.611091:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445617182464:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789518440.611132:0:28295:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2b8c6672-a13d-4697-9151-ddc44fea933a@192.168.206.51@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1789518440.611173:0:28295:0:(genops.c:1384:class_connect()) connect: client 2b8c6672-a13d-4697-9151-ddc44fea933a, cookie 0x631fd8698c78422c 00002000:00100000:1.0:1789518440.611188:0:28295:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2b8c6672-a13d-4697-9151-ddc44fea933a/ffff99ffd8b26800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789518440.611202:0:28295:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789518440.611326:0:28295:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1789518440.611344:0:28298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518440.611349:0:28298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876445617182592:12345-192.168.206.51@tcp:8:mount.lustre.0 00000100:00080000:1.0:1789518440.611364:0:28295:0:(import.c:65:import_set_state_nolock()) ffff99ffd8b25000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1789518440.611365:0:28298:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2b8c6672-a13d-4697-9151-ddc44fea933a@192.168.206.51@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1789518440.611386:0:28298:0:(genops.c:1384:class_connect()) connect: client 2b8c6672-a13d-4697-9151-ddc44fea933a, cookie 0x631fd8698c784233 00002000:00100000:3.0:1789518440.611391:0:28298:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2b8c6672-a13d-4697-9151-ddc44fea933a/ffff99ffeabfa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518440.611398:0:28298:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789518440.611446:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b8c6672-a13d-4697-9151-ddc44fea933a+6:2341:x1876445617182464:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 354us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518440.611454:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00002000:00080000:3.0:1789518440.611469:0:28298:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518440.611485:0:28298:0:(import.c:65:import_set_state_nolock()) ffff99ffed824000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518440.611522:0:28298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b8c6672-a13d-4697-9151-ddc44fea933a+6:2341:x1876445617182592:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 171us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518440.611529:0:28298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518440.611660:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617182720 00000100:00100000:0.0:1789518440.611675:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617182720 00000100:00100000:0.0:1789518440.611711:0:27616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518440.611718:0:27616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+6:24196:x1876445617182720:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789518440.611797:0:27616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789518440.611851:0:27616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+6:24196:x1876445617182720:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 133us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.611858:0:27616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:1.0:1789518440.721372:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518440.721492:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617182848 00000100:00100000:0.0:1789518440.721515:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617182848 00000100:00100000:0.0:1789518440.721599:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518440.721647:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+6:24229:x1876445617182848:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:0.0:1789518440.721674:0:29483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518440.721706:0:29483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78423a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd3c3 expref: -99 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.721784:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.721802:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.721814:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518440.721857:0:29483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518440.721862:0:29483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518440.721917:0:29483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.721946:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78423a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3c3 expref: 8 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.721973:0:29483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3c3 expref: 7 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518440.721982:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16000) 00010000:00010000:0.0:1789518440.721985:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518440.721989:0:29483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696800, rc 0) 00000100:00100000:0.0:1789518440.722065:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+7:24229:x1876445617182848:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 456us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518440.722072:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00010000:00010000:1.0:1789518441.331888:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518441.523147:0:27646:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1789518441.523157:0:27646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518441.523759:0:27646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 4 count 1 00000040:00080000:0.0:1789518441.523831:0:27646:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518441.523860:0:27646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 1 00000001:00100000:0.0:1789518442.140985:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b8c6672-a13d-4697-9151-ddc44fea933a 00000001:00100000:0.0:1789518442.141135:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 17243dca-1507-4dd5-aeba-e5e161042040 00000001:02000400:2.0:1789518442.352145:0:29570:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789518442.355123:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518443.379727:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518444.146760:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518444.146788:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627582464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518444.146876:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518444.146956:0:28300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627582464 00000100:00100000:3.0:1789518444.146971:0:28300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627582464 00000100:00100000:3.0:1789518444.147056:0:28300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518444.147066:0:28300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627582464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518444.147108:0:28300:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518444.147153:0:28300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627582464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518444.147161:0:28300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789518444.147187:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518444.147244:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627582464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518444.151841:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627582720:0@lo:400:kworker.0 00000100:00100000:0.0:1789518444.151945:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518444.152025:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627582848:0@lo:400:kworker.0 00000100:00100000:0.0:1789518444.152046:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627583232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518444.152083:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518444.152089:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518444.152144:0:28298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627582720 00000100:00100000:3.0:1789518444.152154:0:28298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627582720 00000100:00100000:3.0:1789518444.152235:0:28298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518444.152247:0:28298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627582720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518444.152309:0:28298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627582720:12345-0@lo:400:kworker.0 Request processed in 65us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518444.152317:0:28298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518444.152345:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627582848 00000100:00100000:3.0:1789518444.152348:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627582848 00000100:00100000:3.0:1789518444.152390:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518444.152409:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627582848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518444.152449:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627582848:12345-0@lo:400:kworker.0 Request processed in 53us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518444.152457:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518444.152669:0:28300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627583232 00000100:00100000:2.0:1789518444.152675:0:28300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627583232 00000100:00100000:2.0:1789518444.152711:0:28300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518444.152720:0:28300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627583232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518444.152751:0:28300:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789518444.152792:0:28300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627583232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518444.152799:0:28300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518444.152822:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627582592:0@lo:400:kworker.0 00000100:00080000:3.0:1789518444.152848:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518444.152863:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518444.152884:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627582848:0@lo:400:kworker.0 00000100:00100000:2.0:1789518444.152894:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627583104:0@lo:400:kworker.0 00000100:00100000:2.0:1789518444.152929:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518444.152941:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627583232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518444.152955:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518444.152956:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627582720:0@lo:400:kworker.0 00000100:00100000:2.0:1789518444.152966:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627582976:0@lo:400:kworker.0 00000100:00100000:2.0:1789518444.152995:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518444.153031:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627583104 00000100:00100000:2.0:1789518444.153044:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627583104 00000100:00100000:2.0:1789518444.153076:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627582976 00000100:00100000:2.0:1789518444.153079:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627582976 00000100:00100000:2.0:1789518444.153099:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518444.153105:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627583104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518444.153138:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627583104:12345-0@lo:400:kworker.0 Request processed in 33us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518444.153145:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518444.153159:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518444.153167:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627582976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518444.153197:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627582976:12345-0@lo:400:kworker.0 Request processed in 31us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518444.153203:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789518444.153266:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518444.153373:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627582976:0@lo:400:kworker.0 00000100:00100000:2.0:1789518444.153384:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627583104:0@lo:400:kworker.0 00000100:00100000:0.0:1789518444.154013:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627582592 00000100:00100000:0.0:1789518444.154022:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627582592 00000100:00100000:0.0:1789518444.154063:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789518444.154073:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3283:x1876445627582592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518444.154156:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3283:x1876445627582592:12345-0@lo:400:kworker.0 Request processed in 85us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518444.154173:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789518444.154266:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627582592:0@lo:400:kworker.0 00000001:00080000:1.0:1789518444.204180:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 21474836481 is committed 00000001:00100000:1.0:1789518444.204208:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b8c6672-a13d-4697-9151-ddc44fea933a 00000001:00100000:1.0:1789518444.204217:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789518444.214403:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b8c6672-a13d-4697-9151-ddc44fea933a 00010000:00010000:1.0:1789518444.402822:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789518444.562776:0:29720:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd02eb8d80 20000000:00000080:2.0:1789518444.562796:0:29720:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fec3540000 uarg=0000000000000000 20000000:01000000:2.0:1789518444.562837:0:29720:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518444.562843:0:29720:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518444.562848:0:29720:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789518444.563499:0:29721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789518444.563690:0:29720:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789518444.563697:0:29720:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789518444.563719:0:29720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.563739:0:29720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783f0e expref: 18 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.563760:0:29720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c783f5b expref: 18 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.563767:0:29720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7840ab expref: 18 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.563777:0:29720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd337 expref: 12 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.563784:0:29720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd399 expref: 12 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.563792:0:29720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.563838:0:29720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd399 expref: 12 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.563854:0:29720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd399 expref: 12 pid: 27606 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.563872:0:29720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583360:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518444.564019:0:29720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd337 expref: 12 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.564027:0:29720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd337 expref: 12 pid: 27605 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.564036:0:29720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583488:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518444.564069:0:29720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c7840ab expref: 18 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.564077:0:29720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c7840ab expref: 18 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.564087:0:29720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583616:0@lo:104: 00000100:00100000:2.0:1789518444.564125:0:29720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518444.564159:0:29720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c783f5b expref: 18 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.564166:0:29720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c783f5b expref: 18 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.564174:0:29720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583744:0@lo:104: 00000100:00100000:2.0:1789518444.564189:0:29720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518444.564208:0:29720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c783f0e expref: 18 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.564216:0:29720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c783f0e expref: 18 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.564223:0:29720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583872:0@lo:104: 00000100:00100000:2.0:1789518444.564241:0:29720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518444.564255:0:29720:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfffbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518444.564510:0:28321:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789518444.564527:0:28321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627583616 00000100:00100000:0.0:1789518444.564534:0:28321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627583616 00000100:00100000:0.0:1789518444.564568:0:28321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627583744 00000100:00100000:0.0:1789518444.564570:0:28321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627583744 00000100:00100000:0.0:1789518444.564578:0:28321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627583872 00000100:00100000:0.0:1789518444.564580:0:28321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627583872 00000100:00100000:0.0:1789518444.564592:0:28321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518444.564600:0:28321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+5:29720:x1876445627583616:12345-0@lo:104: 00010000:00010000:0.0:1789518444.564635:0:28321:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.564721:0:28321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518444.564727:0:28321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+5:29720:x1876445627583616:12345-0@lo:104: Request processed in 128us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518444.564734:0:28321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518444.564750:0:28321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518444.564755:0:28321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+4:29720:x1876445627583744:12345-0@lo:104: 00010000:00010000:0.0:1789518444.564763:0:28321:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.564793:0:28321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518444.564798:0:28321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+4:29720:x1876445627583744:12345-0@lo:104: Request processed in 43us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518444.564809:0:28321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518444.564821:0:28321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518444.564825:0:28321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0002075450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:29720:x1876445627583872:12345-0@lo:104: 00010000:00010000:0.0:1789518444.564832:0:28321:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.564867:0:28321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789518444.564872:0:28321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0002075450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+3:29720:x1876445627583872:12345-0@lo:104: Request processed in 46us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518444.564877:0:28321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789518444.564917:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789518444.564923:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.564931:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45c00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518444.564935:0:27600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.564944:0:27600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518444.564952:0:27600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518444.564957:0:27600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518444.564988:0:27600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.564993:0:27600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518444.565023:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565030:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45c00/0x631fd8698c7840ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7840b2 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565053:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518444.565057:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565064:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28da00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518444.565067:0:27600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565073:0:27600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518444.565079:0:27600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518444.565084:0:27600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518444.565097:0:27600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565103:0:27600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518444.565117:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565123:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc28da00/0x631fd8698c783f5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783f62 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565141:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518444.565144:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565149:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518444.565151:0:27600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565158:0:27600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518444.565163:0:27600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518444.565169:0:27600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518444.565181:0:27600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565186:0:27600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518444.565192:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565198:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c783f0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c783f15 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565212:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518444.565213:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518444.565215:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518444.565222:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518444.565233:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518444.565255:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3281:1876445627584000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518444.565293:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518444.565333:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627584128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518444.565355:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518444.565381:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518444.565387:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627584256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518444.565401:0:27598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627584000 00000100:00100000:1.0:1789518444.565406:0:27598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627584000 00000100:00100000:0.0:1789518444.565411:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518444.565430:0:27598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7840ab expref: 19 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518444.565445:0:27598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627584256 00000100:00100000:0.0:1789518444.565445:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627584128 00000100:00100000:1.0:1789518444.565448:0:27598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627584256 00000100:00100000:0.0:1789518444.565448:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627584128 00010000:00010000:1.0:1789518444.565459:0:27598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783f0e expref: 21 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.565460:0:27597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783f5b expref: 21 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518444.565471:0:27598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518444.565490:0:27598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+21:3281:x1876445627584000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518444.565502:0:27598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518444.565507:0:27598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7840ab expref: 21 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518444.565517:0:27598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7840ab expref: 21 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518444.565533:0:27598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518444.565563:0:27598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+21:3281:x1876445627584000:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (270us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518444.565633:0:29720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28d800/0x631fd8698c7840b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7840ab expref: 21 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.565644:0:29720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583616:0@lo:104: 00000100:00100000:2.0:1789518444.565653:0:29720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583744:0@lo:104: 00000100:00100000:2.0:1789518444.565666:0:29720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583872:0@lo:104: 00000100:00100000:0.0:1789518444.566388:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518444.566394:0:27598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518444.566396:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8516850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+20:3282:x1876445627584256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518444.566407:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518444.566412:0:27597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783f0e expref: 19 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518444.566414:0:27598:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1789518444.566421:0:27597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c783f0e expref: 19 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518444.566425:0:27598:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789518444.566433:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bce00/0x631fd8698c783f15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c783f0e expref: 19 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.566442:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518444.566851:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627584256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518444.566857:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8516850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:3282:x1876445627584256:12345-0@lo:103:ldlm_bl.0 Request processed in 462us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518444.566864:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518444.566886:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518444.566892:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:3282:x1876445627584128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518444.566900:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518444.566905:0:27597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c783f5b expref: 17 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.566914:0:27597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c783f5b expref: 17 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.566923:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b44600/0x631fd8698c783f62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c783f5b expref: 17 pid: 27607 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518444.566932:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518444.566965:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:3282:x1876445627584128:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518444.566969:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627584128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518444.566972:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518444.567025:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3281:1876445627584000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518444.571876:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518444.572063:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518444.572169:0:27599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617182976 00000100:00100000:2.0:1789518444.572179:0:27599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617182976 00000100:00100000:3.0:1789518444.572205:0:29720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583360:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518444.572225:0:29720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29720:1876445627583488:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518444.572227:0:27599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd399 expref: 13 pid: 27606 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572269:0:29720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.572308:0:27599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617183104 00000100:00100000:2.0:1789518444.572313:0:27599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617183104 00010000:00010000:2.0:1789518444.572328:0:27599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd337 expref: 14 pid: 27605 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.572362:0:27599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518444.572372:0:27599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa3cece6-566d-43f3-ac47-832f8444672f+14:2342:x1876445617182976:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518444.572389:0:27599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518444.572395:0:27599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd399 expref: 14 pid: 27606 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.572408:0:27599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd399 expref: 14 pid: 27606 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518444.572431:0:27599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0696000/0x631fd8698c78421e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd399 expref: 14 pid: 27606 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518444.572436:0:29722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:2.0:1789518444.572453:0:27599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518444.572454:0:29722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa3cece6-566d-43f3-ac47-832f8444672f+13:2343:x1876445617183104:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518444.572465:0:29722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518444.572471:0:29722:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd337 expref: 13 pid: 27605 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572497:0:29722:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd337 expref: 13 pid: 27605 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572511:0:29722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c600/0x631fd8698c78410d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd337 expref: 13 pid: 27605 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.572530:0:27599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa3cece6-566d-43f3-ac47-832f8444672f+12:2342:x1876445617182976:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 156us (663us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518444.572532:0:29722:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.572545:0:27599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00010000:00010000:3.0:1789518444.572547:0:29722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572565:0:29722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572573:0:29722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572581:0:29722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572589:0:29722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572608:0:29722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518444.572644:0:29722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572656:0:29722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572669:0:29722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572685:0:29722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518444.572700:0:29720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572708:0:29720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518444.572714:0:29720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c784248 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 29720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518444.573764:0:29722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa3cece6-566d-43f3-ac47-832f8444672f+11:2343:x1876445617183104:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1311us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518444.573784:0:29722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1789518445.340386:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518445.340534:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617183232 00000100:00100000:2.0:1789518445.340547:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617183232 00000100:00080000:3.0:1789518445.340696:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518445.340703:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518445.340787:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+6:24684:x1876445617183232:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518445.340815:0:27611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518445.340842:0:27611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78424f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd3ca expref: -99 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.340915:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.340934:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.340951:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.340968:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.340976:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.340983:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341654:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784264 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341678:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784264 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341685:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784264 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518445.341715:0:27611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518445.341719:0:27611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518445.341827:0:27611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784264 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341841:0:27611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341848:0:27611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341856:0:27611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341862:0:27611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518445.341866:0:27611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341874:0:27611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341885:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16000) 00010000:00010000:2.0:1789518445.341888:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518445.341893:0:27611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341907:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341921:0:27611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341927:0:27611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341932:0:27611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341935:0:27611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518445.341938:0:27611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341942:0:27611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341948:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99ffd8a16200) 00010000:00010000:2.0:1789518445.341949:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518445.341952:0:27611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341956:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78425d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.341990:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78424f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3ca expref: 8 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.342017:0:27611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784264 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3ca expref: 7 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.342025:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:2.0:1789518445.342027:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518445.342030:0:27611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:2.0:1789518445.342117:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+7:24684:x1876445617183232:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1403us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518445.342126:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518445.351938:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518445.352052:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617183488 00000100:00100000:3.0:1789518445.352074:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617183488 00000100:00100000:3.0:1789518445.352141:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518445.352153:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+7:24684:x1876445617183488:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518445.352190:0:27613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518445.352229:0:27613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c78426b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd3d1 expref: -99 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.352357:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.352376:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.352392:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.352408:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.352415:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.352422:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.352896:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c784280 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.352906:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c784280 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.352912:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c784280 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518445.352922:0:27613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789518445.353159:0:27613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353179:0:27613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353187:0:27613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353194:0:27613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518445.353199:0:27613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353208:0:27613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353222:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:3.0:1789518445.353224:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518445.353229:0:27613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353235:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784272 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353249:0:27613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353254:0:27613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353260:0:27613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353266:0:27613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518445.353275:0:27613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353281:0:27613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353289:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc2d97200) 00010000:00010000:3.0:1789518445.353292:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518445.353294:0:27613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353300:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784279 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353860:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c78426b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3d1 expref: 10 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353873:0:27613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c784280 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3d1 expref: 9 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.353879:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:3.0:1789518445.353880:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518445.353882:0:27613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bde00, rc 0) 00000100:00100000:3.0:1789518445.353954:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+9:24684:x1876445617183488:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1804us (2029us total) trans 21474836481 rc 0/0 00000100:00100000:3.0:1789518445.353960:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518445.357349:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.357448:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617183616 00000100:00100000:0.0:1789518445.357461:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617183616 00000100:00100000:0.0:1789518445.357545:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518445.357556:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+9:24684:x1876445617183616:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789518445.357694:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+9:24684:x1876445617183616:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 139us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.357702:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00010000:00010000:0.0:1789518445.426748:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518445.432232:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.432347:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617183744 00000100:00100000:0.0:1789518445.432365:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617183744 00000100:00100000:0.0:1789518445.432438:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518445.432465:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+9:24693:x1876445617183744:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518445.432500:0:29483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518445.432521:0:29483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78428e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd3d8 expref: -99 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432585:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432600:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432642:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432658:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432666:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432674:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432855:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432863:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432870:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432886:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518445.432891:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432901:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432913:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16000) 00010000:00010000:0.0:1789518445.432917:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518445.432922:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432928:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784295 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432940:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432946:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432952:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432957:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518445.432960:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432967:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432985:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff99ffdfff5f00) 00010000:00010000:0.0:1789518445.432987:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518445.432991:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.432998:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78429c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.433029:0:29483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78428e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3d8 expref: 10 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.433040:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16000) 00010000:00010000:0.0:1789518445.433042:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518445.433046:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78428e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3d8 expref: 10 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.433056:0:29483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697000, rc 0) 00000100:00100000:0.0:1789518445.433130:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+9:24693:x1876445617183744:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 668us (908us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518445.433138:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518445.439407:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518445.439515:0:27621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617183872 00000100:00100000:3.0:1789518445.439525:0:27621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617183872 00000100:00100000:3.0:1789518445.439578:0:27621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518445.439604:0:27621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:17243dca-1507-4dd5-aeba-e5e161042040+9:24693:x1876445617183872:12345-192.168.206.51@tcp:700:lfs.0 00000100:00100000:3.0:1789518445.439772:0:27621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:17243dca-1507-4dd5-aeba-e5e161042040+9:24693:x1876445617183872:12345-192.168.206.51@tcp:700:lfs.0 Request processed in 169us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518445.439780:0:27621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518445.442196:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.442576:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617184128 00000100:00100000:0.0:1789518445.442584:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617184128 00000100:00100000:0.0:1789518445.442692:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1789518445.442702:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+9:24693:x1876445617184128:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:0.0:1789518445.442751:0:27614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518445.442776:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c784130 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd361 expref: 9 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.442812:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16000) 00010000:00010000:0.0:1789518445.442817:0:27614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518445.442981:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.443008:0:27614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3c3 expref: 5 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.443017:0:27614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.443051:0:27614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3c3 expref: 5 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.443063:0:27614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3c3 expref: 5 pid: 29483 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518445.443132:0:27614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:27614:1876445627584384:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518445.443361:0:27614:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518445.447247:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518445.447329:0:27599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617184256 00000100:00100000:3.0:1789518445.447338:0:27599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617184256 00010000:00010000:3.0:1789518445.447408:0:27599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3c3 expref: 6 pid: 29483 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518445.447449:0:27599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518445.447460:0:27599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b8c6672-a13d-4697-9151-ddc44fea933a+6:2342:x1876445617184256:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518445.447482:0:27599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518445.447489:0:27599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3c3 expref: 6 pid: 29483 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.447502:0:27599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3c3 expref: 6 pid: 29483 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.447522:0:27599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16000) 00010000:00010000:3.0:1789518445.447528:0:27599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.447538:0:27599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.447546:0:27599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.447585:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784241 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3c3 expref: 6 pid: 29483 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.447589:0:27599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518445.447606:0:27614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:27614:1876445627584384:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518445.447652:0:27614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518445.447658:0:27599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617184256:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 200us (420us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518445.447662:0:27614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518445.447665:0:27599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00010000:00010000:0.0:1789518445.447673:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.447693:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.447702:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.447710:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518445.447910:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1789518445.449588:0:27614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789518445.449606:0:27614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.449645:0:27614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.449654:0:27614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.449659:0:27614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518445.449663:0:27614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.449670:0:27614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.449684:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16000) 00010000:00010000:0.0:1789518445.449687:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518445.449699:0:27614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.449706:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518445.449727:0:27614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001b74bbc reply state 0000000099121a8f transno 21474836482 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518445.449737:0:27614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518445.449901:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+10:24693:x1876445617184128:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 7196us (7707us total) trans 21474836482 rc 0/0 00000100:00100000:0.0:1789518445.449909:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00010000:00010000:1.0:1789518445.454383:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518445.454402:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518445.454410:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518445.454416:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518445.454420:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518445.454428:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518445.454445:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff99ffdfff5f00) 00010000:00010000:1.0:1789518445.454448:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518445.454453:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518445.454511:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7842aa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518445.467323:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.467505:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617184384 00000100:00100000:0.0:1789518445.467515:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617184384 00000100:00100000:0.0:1789518445.467871:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1789518445.467882:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+9:24694:x1876445617184384:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1789518445.467906:0:27613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518445.467928:0:27613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd3df expref: -99 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.467990:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7842b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.468003:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7842b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.469416:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7842b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518445.469846:0:27613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518445.469865:0:27613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518445.469912:0:27613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7842b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.469945:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7842b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3df expref: 11 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.469965:0:27613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7842b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3df expref: 10 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.469974:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5300) 00010000:00010000:0.0:1789518445.469977:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518445.469980:0:27613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696800, rc 0) 00000100:00100000:0.0:1789518445.470094:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+10:24694:x1876445617184384:12345-192.168.206.51@tcp:101:rm.0 Request processed in 2214us (2782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.470103:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518445.472988:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.473135:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617184512 00000100:00100000:0.0:1789518445.473147:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617184512 00000100:00100000:0.0:1789518445.473214:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1789518445.473225:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+10:24694:x1876445617184512:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1789518445.473249:0:27611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518445.473275:0:27611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7842bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd3e6 expref: -99 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473353:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473370:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473414:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473431:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473439:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473445:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473567:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7842d4 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473576:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7842d4 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473583:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7842d4 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518445.473655:0:27611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518445.473659:0:27611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518445.473680:0:27611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7842d4 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473694:0:27611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473702:0:27611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473719:0:27611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473726:0:27611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518445.473731:0:27611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473740:0:27611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473752:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5300) 00010000:00010000:0.0:1789518445.473755:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518445.473760:0:27611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473766:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473781:0:27611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473787:0:27611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473793:0:27611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473799:0:27611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518445.473802:0:27611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473816:0:27611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473823:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff99ffdfff5e00) 00010000:00010000:0.0:1789518445.473825:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518445.473828:0:27611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473835:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473866:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7842bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3e6 expref: 12 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473881:0:27611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7842d4 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3e6 expref: 11 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.473888:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:0.0:1789518445.473890:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789518445.473893:0:27611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696a00, rc 0) 00000100:00100000:0.0:1789518445.473956:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+11:24694:x1876445617184512:12345-192.168.206.51@tcp:101:rm.0 Request processed in 733us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.473964:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1789518445.476494:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518445.476891:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617184640 00000100:00100000:2.0:1789518445.476903:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617184640 00000100:00100000:2.0:1789518445.477002:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518445.477013:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+11:24694:x1876445617184640:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:2.0:1789518445.477047:0:29483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518445.477073:0:29483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7842db lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd3ed expref: -99 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477144:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477161:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477174:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477214:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477222:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477229:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477332:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477341:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477349:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477356:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518445.477360:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477368:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477419:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:2.0:1789518445.477423:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518445.477441:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477448:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7842e2 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477497:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477504:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477511:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477516:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518445.477519:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477536:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477545:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff99ffd8a16200) 00010000:00010000:2.0:1789518445.477547:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518445.477550:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477557:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c7842e9 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477688:0:29483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7842db lrc: 1/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3ed expref: 12 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477709:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:2.0:1789518445.477712:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518445.477721:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7842db lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3ed expref: 12 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.477741:0:29483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518445.477919:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+11:24694:x1876445617184640:12345-192.168.206.51@tcp:101:rm.0 Request processed in 906us (1433us total) trans 0 rc 301/301 00000100:00100000:2.0:1789518445.477949:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518445.482163:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.482200:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617184768 00000100:00100000:0.0:1789518445.482213:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617184768 00000100:00100000:0.0:1789518445.482280:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:0.0:1789518445.482292:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+11:24694:x1876445617184768:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1789518445.482333:0:27611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518445.482359:0:27611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7842f0 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd3f4 expref: -99 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482437:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482453:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482466:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482496:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482503:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482511:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482571:0:27611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482579:0:27611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482586:0:27611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482593:0:27611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518445.482603:0:27611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482627:0:27611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482642:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:0.0:1789518445.482646:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518445.482652:0:27611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482660:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7842f7 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482674:0:27611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482679:0:27611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482686:0:27611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482691:0:27611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518445.482694:0:27611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482700:0:27611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482707:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff99ffdfff5e00) 00010000:00010000:0.0:1789518445.482709:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518445.482717:0:27611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 2/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482723:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7842fe lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482758:0:27611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7842f0 lrc: 1/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3f4 expref: 12 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482770:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:0.0:1789518445.482772:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518445.482775:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7842f0 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3f4 expref: 12 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.482785:0:27611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:0.0:1789518445.482858:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+11:24694:x1876445617184768:12345-192.168.206.51@tcp:101:rm.0 Request processed in 568us (706us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518445.482866:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1789518445.542528:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.542598:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617184896 00000100:00100000:0.0:1789518445.542611:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617184896 00000100:00100000:0.0:1789518445.542721:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1789518445.542733:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+11:24700:x1876445617184896:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518445.542759:0:27613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518445.542795:0:27613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd3fb expref: -99 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.542887:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78430c lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.542926:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78430c lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.542939:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78430c lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518445.542984:0:27613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518445.542988:0:27613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518445.543007:0:27613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78430c lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.543156:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3fb expref: 13 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.543178:0:27613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78430c lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3fb expref: 12 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.543187:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:0.0:1789518445.543190:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518445.543194:0:27613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697200, rc 0) 00000100:00100000:0.0:1789518445.543735:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+12:24700:x1876445617184896:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1001us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.543744:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:1.0:1789518445.549091:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518445.549192:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617185152 00000100:00100000:3.0:1789518445.549205:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617185152 00000100:00100000:3.0:1789518445.549330:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1789518445.549341:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+12:24700:x1876445617185152:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518445.549369:0:27614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518445.549396:0:27614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd402 expref: -99 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518445.549532:0:27614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789518445.549704:0:27614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784313 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd402 expref: 14 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.549721:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5300) 00010000:00010000:3.0:1789518445.549725:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518445.549731:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd402 expref: 14 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.549748:0:27614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc200, rc 0) 00000100:00100000:3.0:1789518445.549829:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+13:24700:x1876445617185152:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 482us (741us total) trans 21474836483 rc 301/301 00000100:00100000:3.0:1789518445.549837:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518445.552703:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518445.552836:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617185408 00000100:00100000:2.0:1789518445.552848:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617185408 00000100:00100000:2.0:1789518445.552918:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1789518445.552929:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+13:24700:x1876445617185408:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:2.0:1789518445.553230:0:29483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518445.553312:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78430c lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3fb expref: 13 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.553338:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:2.0:1789518445.553344:0:29483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518445.553373:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.553446:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.553460:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518445.553798:0:29483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055b7584e reply state 0000000003195ccf transno 21474836484 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518445.553809:0:29483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789518445.553833:0:29483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789518445.554094:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+14:24700:x1876445617185408:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 1060us (1293us total) trans 21474836484 rc 0/0 00000100:00100000:2.0:1789518445.554104:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00010000:00010000:2.0:1789518445.557569:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.557587:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.557596:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.557603:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518445.557608:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.557648:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.557668:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:2.0:1789518445.557671:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789518445.557676:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.557683:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784321 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518445.559367:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.559668:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617185664 00000100:00100000:0.0:1789518445.559681:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617185664 00000100:00100000:0.0:1789518445.559753:0:27616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1789518445.559766:0:27616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+13:24700:x1876445617185664:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518445.560237:0:27616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+14:24700:x1876445617185664:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 471us (878us total) trans 21474836485 rc 0/0 00000100:00100000:0.0:1789518445.560277:0:27616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518445.566914:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518445.567073:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617185920 00000100:00100000:2.0:1789518445.567084:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617185920 00000100:00100000:2.0:1789518445.567161:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518445.567174:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+14:24700:x1876445617185920:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518445.567498:0:27611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518445.567529:0:27611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c784328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd409 expref: -99 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.567799:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78432f lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.567818:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78432f lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.567832:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78432f lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518445.567845:0:27611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789518445.568002:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c784328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd409 expref: 17 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.568023:0:27611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78432f lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd409 expref: 16 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.568031:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:2.0:1789518445.568035:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518445.568039:0:27611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518445.568160:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+16:24700:x1876445617185920:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 989us (1258us total) trans 21474836486 rc 0/0 00000100:00100000:2.0:1789518445.568168:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1789518445.576502:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.581749:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617186048 00000100:00100000:0.0:1789518445.581770:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617186048 00000100:00100000:0.0:1789518445.581873:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518445.581886:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+16:24700:x1876445617186048:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518445.581919:0:27613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518445.581949:0:27613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78433d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd410 expref: -99 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.582037:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784344 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.582054:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784344 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.582069:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784344 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518445.582116:0:27613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518445.582121:0:27613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518445.582140:0:27613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784344 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.582168:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78433d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd410 expref: 18 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.582190:0:27613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784344 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd410 expref: 17 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.582219:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:0.0:1789518445.582222:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518445.582226:0:27613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696e00, rc 0) 00000100:00100000:0.0:1789518445.582306:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+17:24700:x1876445617186048:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 423us (5816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.582313:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518445.586243:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.586328:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617186176 00000100:00100000:0.0:1789518445.586340:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617186176 00000100:00100000:0.0:1789518445.586407:0:27616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1789518445.586418:0:27616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+17:24700:x1876445617186176:12345-192.168.206.51@tcp:37:lfs.0 00000100:00100000:2.0:1789518445.589901:0:27616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+17:24700:x1876445617186176:12345-192.168.206.51@tcp:37:lfs.0 Request processed in 3474us (3767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518445.589917:0:27616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000040:00080000:1.0:1789518445.619327:0:27646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789518445.856253:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518445.856375:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617186432 00000100:00100000:3.0:1789518445.856389:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617186432 00000100:00100000:3.0:1789518445.856476:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1789518445.856490:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+17:24716:x1876445617186432:12345-192.168.206.51@tcp:101:multiop.0 00010000:00010000:3.0:1789518445.856520:0:27614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518445.856524:0:27614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518445.856557:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784344 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd410 expref: 17 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.856580:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:3.0:1789518445.856587:0:27614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518445.856604:0:27614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c78434b lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd417 expref: -99 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.856798:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 3/0,1 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.856815:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.856827:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.856844:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.856852:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.856859:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858576:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784360 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858592:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784360 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858602:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784360 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518445.858639:0:27614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789518445.858676:0:27614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858684:0:27614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 2/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858692:0:27614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858699:0:27614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518445.858704:0:27614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858715:0:27614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 4/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858728:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:3.0:1789518445.858731:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518445.858736:0:27614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858752:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c784352 lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518445.858768:0:27614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001864521 reply state 00000000053e4820 transno 21474836487 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518445.858777:0:27614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518445.858878:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c78434b lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd417 expref: 19 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858896:0:27614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784360 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd417 expref: 18 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518445.858904:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:3.0:1789518445.858907:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789518445.858910:0:27614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:3.0:1789518445.859122:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+19:24716:x1876445617186432:12345-192.168.206.51@tcp:101:multiop.0 Request processed in 2634us (2878us total) trans 21474836487 rc 0/0 00000100:00100000:3.0:1789518445.859132:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00010000:00010000:2.0:1789518445.860502:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.860518:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.860526:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.860531:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518445.860536:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.860544:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.860558:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff99ffc2d97200) 00010000:00010000:2.0:1789518445.860561:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518445.860566:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.860572:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c784359 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518445.901138:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518445.901290:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617186560 00000100:00100000:2.0:1789518445.901302:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617186560 00000100:00100000:2.0:1789518445.901368:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:2.0:1789518445.901381:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+11:24085:x1876445617186560:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518445.901402:0:27607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518445.901427:0:27607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17800/0x631fd8698c78436e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd41e expref: -99 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.901503:0:27607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17800/0x631fd8698c78436e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd41e expref: 12 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.901517:0:27607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17800/0x631fd8698c78436e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd41e expref: 12 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518445.901528:0:27607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:2.0:1789518445.901607:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+12:24085:x1876445617186560:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 229us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518445.901645:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1789518445.904041:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.904759:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617186688 00000100:00100000:0.0:1789518445.904776:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617186688 00000100:00100000:0.0:1789518445.904850:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:0.0:1789518445.904861:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+12:24085:x1876445617186688:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518445.905698:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+12:24085:x1876445617186688:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 833us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.905712:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:1.0:1789518445.907534:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.907650:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617186816 00000100:00100000:0.0:1789518445.907661:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617186816 00000100:00100000:0.0:1789518445.907811:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:0.0:1789518445.907823:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+12:24085:x1876445617186816:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518445.908108:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+12:24085:x1876445617186816:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 286us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.908116:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:1.0:1789518445.915334:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.915552:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617186944 00000100:00100000:0.0:1789518445.915564:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617186944 00000100:00100000:0.0:1789518445.915660:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:0.0:1789518445.915671:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+12:24085:x1876445617186944:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518445.915691:0:27606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518445.915715:0:27606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0697400/0x631fd8698c784375 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd425 expref: -99 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.915749:0:27606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0697400/0x631fd8698c784375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd425 expref: 13 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.915761:0:27606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0697400/0x631fd8698c784375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd425 expref: 13 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518445.915771:0:27606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697400, rc 0) 00000100:00100000:0.0:1789518445.915843:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+13:24085:x1876445617186944:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 173us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.915851:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1789518445.918565:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518445.918903:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617187072 00000100:00100000:0.0:1789518445.918914:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617187072 00000100:00100000:0.0:1789518445.919011:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:0.0:1789518445.919124:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+13:24085:x1876445617187072:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518445.919674:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3cece6-566d-43f3-ac47-832f8444672f+13:24085:x1876445617187072:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 652us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.919684:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:3.0:1789518445.921866:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518445.922174:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617187200 00000100:00100000:2.0:1789518445.922186:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617187200 00000100:00100000:2.0:1789518445.922327:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:2.0:1789518445.922339:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeaa07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+13:24085:x1876445617187200:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518445.922763:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeaa07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+13:24085:x1876445617187200:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 424us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518445.922772:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:1.0:1789518445.965817:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518445.965862:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518445.965890:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518445.965915:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518445.965944:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518445.965987:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617187456 00000100:00100000:1.0:1789518445.965998:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617187456 00000100:00100000:1.0:1789518445.966057:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617187712 00000100:00100000:1.0:1789518445.966075:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617187712 00000100:00100000:2.0:1789518445.966518:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617187328 00000100:00100000:2.0:1789518445.966523:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617187328 00000100:00100000:2.0:1789518445.966547:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617187840 00000100:00100000:2.0:1789518445.966550:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617187840 00000100:00100000:2.0:1789518445.966568:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518445.966578:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+5:2342:x1876445617187456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518445.966772:0:28298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1789518445.966793:0:28298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17243dca-1507-4dd5-aeba-e5e161042040+5:2342:x1876445617187328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518445.966894:0:28295:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789518445.966907:0:28295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789518445.967026:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617187584 00000100:00100000:0.0:1789518445.967031:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617187584 00000100:00100000:0.0:1789518445.967067:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518445.967076:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617187584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518445.967584:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+5:2342:x1876445617187456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1005us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518445.967603:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518445.967645:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518445.967653:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617187840:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518445.967842:0:28515:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789518445.967853:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518445.967862:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617187712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518445.970552:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617187584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3463us (4621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518445.970568:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00080000:0.0:1789518445.970776:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518445.970782:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518445.970806:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617187840:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3144us (4852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518445.970821:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518445.972451:0:28298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17243dca-1507-4dd5-aeba-e5e161042040+5:2342:x1876445617187328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 5657us (6551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518445.972464:0:28298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1789518445.972580:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617187712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 4717us (6715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518445.972589:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 10000000:01000000:0.0:1789518446.130892:0:27609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518446.130900:0:27609:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffed824800 from 10 10000000:01000000:0.0:1789518446.130906:0:27609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518446.130954:0:27609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518446.130966:0:27609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518446.130977:0:27609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518446.131001:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627584512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518446.131077:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518446.131147:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6154780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518446.131288:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627584512 00000100:00100000:2.0:1789518446.131296:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627584512 00000100:00100000:2.0:1789518446.131350:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789518446.131359:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdacfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:27609:x1876445627584512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518446.131371:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518446.131384:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16e00/0x631fd8698c784383 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78437c expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518446.131407:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16e00/0x631fd8698c784383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78437c expref: 17 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518446.131417:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16e00/0x631fd8698c784383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78437c expref: 17 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518446.131424:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16e00, rc 0) 00000100:00100000:2.0:1789518446.131486:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdacfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:27609:x1876445627584512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518446.131493:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789518446.132546:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627584512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518446.132579:0:27609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518446.132589:0:27609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518446.132691:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627584640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518446.132731:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518446.132767:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518446.132830:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627584640 00000100:00100000:2.0:1789518446.132836:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627584640 00000100:00100000:2.0:1789518446.132882:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789518446.132890:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdacf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:27609:x1876445627584640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518446.133141:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdacf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:27609:x1876445627584640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518446.133149:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789518446.133369:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627584640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518446.133399:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627584768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518446.133437:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518446.133461:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518446.133532:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627584768 00000100:00100000:0.0:1789518446.133537:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627584768 00000100:00100000:0.0:1789518446.133571:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789518446.133578:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:27609:x1876445627584768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518446.133761:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:27609:x1876445627584768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518446.133779:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789518446.133956:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627584768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789518446.136883:0:29735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789518446.137699:0:27609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789518446.137721:0:27609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518446.137732:0:27609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518446.137745:0:27609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518446.137756:0:27609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518446.137759:0:27609:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fff7a53800 from 10 10000000:01000000:1.0:1789518446.137762:0:27609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518446.137798:0:27609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518446.137808:0:27609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518446.137817:0:27609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518446.137840:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627584896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518446.137901:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518446.137957:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518446.138015:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627584896 00000100:00100000:0.0:1789518446.138021:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627584896 00000100:00100000:0.0:1789518446.138079:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789518446.138088:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:27609:x1876445627584896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518446.138101:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518446.138112:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0696c00/0x631fd8698c784391 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78438a expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518446.138132:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0696c00/0x631fd8698c784391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78438a expref: 18 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518446.138141:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0696c00/0x631fd8698c784391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78438a expref: 18 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518446.138148:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696c00, rc 0) 00000100:00100000:0.0:1789518446.138207:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:27609:x1876445627584896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518446.138214:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789518446.138485:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627584896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518446.138508:0:27609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518446.138517:0:27609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518446.138565:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518446.138589:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518446.138632:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518446.138691:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627585024 00000100:00100000:2.0:1789518446.138696:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627585024 00000100:00100000:2.0:1789518446.138726:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789518446.138732:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:27609:x1876445627585024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518446.138951:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:27609:x1876445627585024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518446.138958:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789518446.139406:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518446.139435:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518446.139484:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518446.139517:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518446.139675:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627585152 00000100:00100000:0.0:1789518446.139680:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627585152 00000100:00100000:0.0:1789518446.139714:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789518446.139720:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:27609:x1876445627585152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518446.139878:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:27609:x1876445627585152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518446.139885:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789518446.140034:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789518446.141578:0:29736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789518446.141909:0:27609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789518446.141936:0:27609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518446.141947:0:27609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518446.141957:0:27609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518446.141967:0:27609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789518446.141970:0:27609:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fffbb6a000 from 10 10000000:01000000:1.0:1789518446.141973:0:27609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518446.142009:0:27609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518446.142017:0:27609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518446.142027:0:27609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518446.142058:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518446.142106:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518446.142133:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518446.142377:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627585280 00000100:00100000:0.0:1789518446.142388:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627585280 00000100:00100000:0.0:1789518446.142428:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789518446.142435:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:27609:x1876445627585280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518446.142446:0:27605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518446.142457:0:27605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0697800/0x631fd8698c78439f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784398 expref: -99 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518446.142495:0:27605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0697800/0x631fd8698c78439f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784398 expref: 19 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518446.142505:0:27605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0697800/0x631fd8698c78439f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784398 expref: 19 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518446.142513:0:27605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697800, rc 0) 00000100:00100000:0.0:1789518446.142562:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:27609:x1876445627585280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518446.142569:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789518446.142790:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518446.142803:0:27609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518446.142812:0:27609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518446.142854:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518446.142879:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518446.142902:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518446.142966:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627585408 00000100:00100000:2.0:1789518446.142971:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627585408 00000100:00100000:2.0:1789518446.143085:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789518446.143093:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:27609:x1876445627585408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518446.143298:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:27609:x1876445627585408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518446.143306:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789518446.143361:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518446.143384:0:27609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518446.143414:0:27609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518446.152642:0:27609:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518446.152888:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627585536 00000100:00100000:2.0:1789518446.152898:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627585536 00000100:00100000:2.0:1789518446.152945:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789518446.152954:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:27609:x1876445627585536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518446.153180:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:27609:x1876445627585536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (9764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518446.153197:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789518446.153335:0:27609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:27609:1876445627585536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789518446.154299:0:29737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789518446.154579:0:27609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789518446.154605:0:27609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518446.154642:0:27609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518446.154653:0:27609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518446.450771:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518447.475106:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518448.499211:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518448.759960:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518448.760449:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617188096 00000100:00100000:2.0:1789518448.760470:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617188096 00000100:00100000:2.0:1789518448.760604:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1789518448.760643:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+18:24743:x1876445617188096:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518448.760668:0:27611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518448.760689:0:27611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7843a6 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd42c expref: -99 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.760778:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843ad lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.760800:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843ad lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.760811:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843ad lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518448.760821:0:27611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789518448.760948:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7843a6 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd42c expref: 21 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.760965:0:27611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843ad lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd42c expref: 20 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.760973:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518448.760976:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518448.760979:0:27611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:2.0:1789518448.761056:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+20:24743:x1876445617188096:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 443us (1106us total) trans 21474836488 rc 0/0 00000100:00100000:2.0:1789518448.761063:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00080000:0.0:1789518448.763689:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518448.764442:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518448.764585:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617188224 00000100:00100000:2.0:1789518448.764594:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617188224 00000100:00100000:2.0:1789518448.764780:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518448.764791:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+20:24743:x1876445617188224:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1789518448.764850:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.764866:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.764877:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.764899:0:27613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.764905:0:27613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.764912:0:27613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.764918:0:27613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518448.764922:0:27613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.764928:0:27613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.764953:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518448.764961:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518448.764966:0:27613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.764973:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843bb lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518448.765038:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+20:24743:x1876445617188224:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 250us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518448.765046:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1789518448.767701:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518448.768241:0:27615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617188480 00000100:00100000:3.0:1789518448.768251:0:27615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617188480 00000100:00100000:3.0:1789518448.768301:0:27615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518448.768311:0:27615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+20:24743:x1876445617188480:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518448.768808:0:27615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+21:24743:x1876445617188480:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 497us (1115us total) trans 21474836489 rc 0/0 00000100:00100000:3.0:1789518448.768816:0:27615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518448.846030:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518448.846167:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617188736 00000100:00100000:2.0:1789518448.846176:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617188736 00000100:00100000:2.0:1789518448.846233:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1789518448.846243:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+21:24753:x1876445617188736:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:2.0:1789518448.846294:0:27611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518448.846317:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843ad lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd42c expref: 21 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.846335:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518448.846340:0:27611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518448.846533:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.846546:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.846555:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518448.846668:0:27611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836490 00000004:00010000:2.0:1789518448.846695:0:27611:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb3391fb reply state 000000004419801f transno 21474836491 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518448.846705:0:27611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518448.846802:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+23:24753:x1876445617188736:12345-192.168.206.51@tcp:36:bash.0 Request processed in 560us (788us total) trans 21474836491 rc 0/0 00000100:00100000:2.0:1789518448.846809:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000020:00080000:2.0:1789518448.846814:0:27611:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789518448.849982:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518448.850071:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617188864 00000100:00100000:0.0:1789518448.850080:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617188864 00000100:00100000:0.0:1789518448.850139:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1789518448.850148:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+23:24753:x1876445617188864:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518448.850169:0:29483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518448.850187:0:29483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7843c9 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd433 expref: -99 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850272:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850284:0:29483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 2/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850291:0:29483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 4/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850305:0:29483:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850316:0:29483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850404:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850412:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850419:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850424:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518448.850427:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850434:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850447:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518448.850449:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518448.850452:0:3266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850482:0:3266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850489:0:3266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 4/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850516:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.850523:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843c2 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850653:0:29483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850661:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518448.850692:0:29483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789518448.850696:0:29483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518448.850718:0:29483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850741:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7843c9 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd433 expref: 24 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850753:0:29483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd433 expref: 23 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.850767:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518448.850770:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518448.850772:0:29483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:0.0:1789518448.850823:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+23:24753:x1876445617188864:12345-192.168.206.51@tcp:101:bash.0 Request processed in 677us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518448.850830:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1789518448.887021:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518448.887962:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617188992 00000100:00100000:2.0:1789518448.887973:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617188992 00000100:00100000:2.0:1789518448.888032:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1789518448.888042:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+23:24756:x1876445617188992:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518448.888060:0:27611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518448.888080:0:27611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843d7 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd43a expref: -99 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888136:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888149:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888160:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888175:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888193:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888200:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888277:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7843ec lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888286:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7843ec lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888293:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7843ec lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518448.888323:0:27611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789518448.888327:0:27611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518448.888343:0:27611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7843ec lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888353:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7843ec lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888362:0:27611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888368:0:27611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888374:0:27611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888390:0:27611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518448.888394:0:27611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888401:0:27611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888412:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:2.0:1789518448.888415:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518448.888419:0:27611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888425:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7843de lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888438:0:27611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888444:0:27611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888450:0:27611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888466:0:27611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518448.888469:0:27611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888475:0:27611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888492:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff99ffd8a16b00) 00010000:00010000:2.0:1789518448.888494:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518448.888498:0:27611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888504:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c7843e5 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888534:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7843d7 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd43a expref: 25 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888547:0:27611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7843ec lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd43a expref: 24 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518448.888560:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518448.888562:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518448.888565:0:27611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16000, rc 0) 00000100:00100000:2.0:1789518448.889038:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+24:24756:x1876445617188992:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 996us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518448.889046:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1789518448.893394:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518448.893476:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617189120 00000100:00100000:0.0:1789518448.893485:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617189120 00000100:00100000:0.0:1789518448.893544:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518448.893553:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17243dca-1507-4dd5-aeba-e5e161042040+24:2344:x1876445617189120:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518448.893566:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518448.893587:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7843ec lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd43a expref: 24 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518448.893602:0:27597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518448.893649:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518448.893707:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17243dca-1507-4dd5-aeba-e5e161042040+23:2344:x1876445617189120:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 154us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518448.893714:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518449.110565:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.110652:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617189376 00000100:00100000:0.0:1789518449.110664:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617189376 00000100:00100000:0.0:1789518449.110729:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1789518449.110741:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+23:24786:x1876445617189376:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:0.0:1789518449.110766:0:29483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518449.110803:0:29483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7843f3 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd441 expref: -99 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.110979:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7843fa lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.111056:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7843fa lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.111071:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7843fa lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518449.111084:0:29483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789518449.111252:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c7843f3 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd441 expref: 26 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.111273:0:29483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7843fa lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd441 expref: 25 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.111283:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518449.111286:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518449.111291:0:29483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697000, rc 0) 00000100:00100000:0.0:1789518449.111360:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+25:24786:x1876445617189376:12345-192.168.206.51@tcp:101:cat.0 Request processed in 621us (807us total) trans 21474836492 rc 0/0 00000100:00100000:0.0:1789518449.111368:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1789518449.118948:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518449.119048:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518449.119169:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617189760 00000100:00100000:2.0:1789518449.119181:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617189760 00000100:00100000:3.0:1789518449.119273:0:27599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617189504 00000100:00100000:3.0:1789518449.119279:0:27599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617189504 00000100:00100000:0.0:1789518449.119387:0:27615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518449.119401:0:27599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518449.119406:0:27615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+26:24786:x1876445617189760:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:3.0:1789518449.119416:0:27599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17243dca-1507-4dd5-aeba-e5e161042040+26:2342:x1876445617189504:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518449.119441:0:27599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518449.119555:0:27599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7843fa lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd441 expref: 26 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.119572:0:27599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:3.0:1789518449.119577:0:27599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518449.119671:0:27599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17243dca-1507-4dd5-aeba-e5e161042040+26:2342:x1876445617189504:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 259us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.119743:0:27599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518449.119791:0:27615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+25:24786:x1876445617189760:12345-192.168.206.51@tcp:35:cat.0 Request processed in 392us (742us total) trans 21474836493 rc 0/0 00000100:00100000:0.0:1789518449.119815:0:27615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518449.141420:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.141773:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617190016 00000100:00100000:3.0:1789518449.141786:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617190016 00000100:00100000:3.0:1789518449.141890:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518449.141901:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+25:24789:x1876445617190016:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518449.141931:0:27614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518449.141956:0:27614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784408 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd448 expref: -99 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.142069:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78440f lrc: 3/1,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.142086:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78440f lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.142099:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78440f lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518449.142112:0:27614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789518449.142287:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784408 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd448 expref: 28 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.142307:0:27614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78440f lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd448 expref: 27 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.142316:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:3.0:1789518449.142320:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518449.142323:0:27614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:3.0:1789518449.142397:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+27:24789:x1876445617190016:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 498us (987us total) trans 21474836494 rc 0/0 00000100:00100000:3.0:1789518449.142404:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:1.0:1789518449.146474:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.146582:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617190144 00000100:00100000:0.0:1789518449.146595:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617190144 00000100:00100000:0.0:1789518449.146708:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1789518449.146721:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+27:24789:x1876445617190144:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:0.0:1789518449.146804:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.146824:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.146839:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.146872:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.146879:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.146887:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.146894:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518449.146899:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.146909:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.146921:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518449.146942:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518449.146950:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.146957:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c78441d lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518449.147041:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+27:24789:x1876445617190144:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 322us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.147050:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:1.0:1789518449.224359:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518449.224479:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617190272 00000100:00100000:2.0:1789518449.224488:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617190272 00000100:00100000:2.0:1789518449.224584:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1789518449.224595:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+27:24799:x1876445617190272:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518449.224652:0:27611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518449.224673:0:27611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd44f expref: -99 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.224752:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78442b lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.224767:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78442b lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.224778:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78442b lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518449.224815:0:27611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518449.224819:0:27611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518449.224835:0:27611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78442b lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.224860:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd44f expref: 29 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.224879:0:27611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78442b lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd44f expref: 28 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.224888:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:2.0:1789518449.224891:0:27611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518449.224894:0:27611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:2.0:1789518449.224955:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+28:24799:x1876445617190272:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 361us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518449.224972:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1789518449.229702:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.229816:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617190656 00000100:00100000:0.0:1789518449.229829:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617190656 00000100:00100000:0.0:1789518449.229934:0:27616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518449.229946:0:27616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+28:24799:x1876445617190656:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518449.230342:0:27616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+29:24799:x1876445617190656:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 397us (649us total) trans 21474836495 rc 0/0 00000100:00100000:0.0:1789518449.230351:0:27616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518449.232523:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518449.233735:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617190784 00000100:00100000:2.0:1789518449.233749:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617190784 00000100:00100000:2.0:1789518449.234162:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518449.234186:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17243dca-1507-4dd5-aeba-e5e161042040+29:24799:x1876445617190784:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:2.0:1789518449.234205:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789518449.234236:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78440f lrc: 0/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd448 expref: 29 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.234261:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7843d0 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd433 expref: 28 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.234274:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784360 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd417 expref: 27 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.234287:0:27597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518449.234300:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518449.234378:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17243dca-1507-4dd5-aeba-e5e161042040+26:24799:x1876445617190784:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 198us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518449.234386:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518449.236340:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.236470:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617190912 00000100:00100000:0.0:1789518449.236481:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617190912 00000100:00100000:0.0:1789518449.236538:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:0.0:1789518449.236549:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+26:24799:x1876445617190912:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:0.0:1789518449.236769:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.236788:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.236801:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518449.237575:0:29483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518449.237740:0:29483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 64 off8512 00000040:00080000:0.0:1789518449.237799:0:29483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].1, 136 off8328 00000100:00100000:0.0:1789518449.237900:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+26:24799:x1876445617190912:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 1352us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.237910:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518449.240750:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.240842:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617191040 00000100:00100000:3.0:1789518449.240854:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617191040 00000100:00100000:3.0:1789518449.240919:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:3.0:1789518449.240930:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+26:24799:x1876445617191040:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518449.240955:0:27614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518449.240986:0:27614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784439 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd456 expref: -99 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.241066:0:27614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 2/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.241079:0:27614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784439 lrc: 4/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd456 expref: 27 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.241102:0:27614:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.241138:0:27614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784439 lrc: 3/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd456 expref: 27 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.241169:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:3.0:1789518449.241180:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518449.241185:0:27614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784439 lrc: 3/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd456 expref: 27 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.241194:0:27614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc200, rc 0) 00000100:00100000:3.0:1789518449.241259:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+27:24799:x1876445617191040:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 330us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.241267:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:1.0:1789518449.266950:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627585664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518449.267046:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518449.267165:0:28300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627585664 00000100:00100000:2.0:1789518449.267175:0:28300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627585664 00000100:00100000:2.0:1789518449.267252:0:28300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518449.267262:0:28300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627585664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518449.267308:0:28300:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789518449.267336:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627585792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518449.267569:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518449.267643:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3281:1876445627585920:0@lo:400:kworker.0 00000100:00100000:2.0:1789518449.267724:0:28300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627585664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 462us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518449.267733:0:28300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518449.267745:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518449.267776:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627585920 00000100:00100000:2.0:1789518449.267782:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627585920 00000100:00100000:3.0:1789518449.267783:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627586432:0@lo:400:kworker.0 00000100:00100000:2.0:1789518449.267814:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789518449.267825:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518449.267826:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3281:x1876445627585920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518449.267872:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3281:x1876445627585920:12345-0@lo:400:kworker.0 Request processed in 50us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.267879:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3281:1876445627585920:0@lo:400:kworker.0 00000100:00100000:2.0:1789518449.267880:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789518449.267905:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518449.267913:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627586304:0@lo:400:kworker.0 00000100:00100000:3.0:1789518449.267938:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518449.267988:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627586048:0@lo:400:kworker.0 00000100:00100000:3.0:1789518449.268024:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518449.268044:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518449.268057:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627586176:0@lo:400:kworker.0 00000100:00100000:3.0:1789518449.268097:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518449.268125:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627586432 00000100:00100000:3.0:1789518449.268129:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627586432 00000100:00100000:3.0:1789518449.268165:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627586304 00000100:00100000:3.0:1789518449.268168:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627586304 00000100:00100000:3.0:1789518449.268185:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627586176 00000100:00100000:3.0:1789518449.268187:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627586176 00000100:00100000:3.0:1789518449.268203:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518449.268211:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627586432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518449.268257:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627586432:12345-0@lo:400:kworker.0 Request processed in 47us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.268264:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518449.268282:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518449.268289:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627586304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518449.268317:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627586304:12345-0@lo:400:kworker.0 Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.268323:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518449.268341:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518449.268342:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627586048 00000100:00100000:0.0:1789518449.268348:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627586048 00000100:00100000:3.0:1789518449.268350:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627586176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518449.268390:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518449.268392:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627586176:12345-0@lo:400:kworker.0 Request processed in 42us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.268401:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627586048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518449.268402:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789518449.268423:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518449.268428:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518449.268463:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627586176:0@lo:400:kworker.0 00000100:00100000:3.0:1789518449.268477:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627586048:0@lo:400:kworker.0 00000100:00100000:0.0:1789518449.268483:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627586048:12345-0@lo:400:kworker.0 Request processed in 84us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.268494:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518449.268510:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518449.268530:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627586304:0@lo:400:kworker.0 00000100:00100000:3.0:1789518449.268547:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627586432:0@lo:400:kworker.0 00000100:00100000:1.0:1789518449.268563:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 2 00000100:00100000:1.0:1789518449.268586:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627585664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518449.268658:0:28299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627585792 00000100:00100000:0.0:1789518449.268663:0:28299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627585792 00000100:00100000:0.0:1789518449.268825:0:28299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518449.268835:0:28299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627585792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518449.268950:0:28299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518449.269051:0:28299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627585792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 219us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.269059:0:28299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518449.269164:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627585792:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789518449.303988:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836495 is committed 00010000:00010000:0.0:1789518449.522874:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518449.714919:0:27646:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1789518449.714930:0:27646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518449.714979:0:27646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 2 00000040:00080000:1.0:1789518449.714986:0:27646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:1.0:1789518449.715160:0:27646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:27646:1876445627586560:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518449.715483:0:27646:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518449.718904:0:27646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:27646:1876445627586560:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518449.720925:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.721704:0:27623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617191168 00000100:00100000:3.0:1789518449.721715:0:27623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617191168 00000100:00100000:3.0:1789518449.721770:0:27623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518449.721780:0:27623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:17243dca-1507-4dd5-aeba-e5e161042040+12:24800:x1876445617191168:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789518449.721861:0:27623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:17243dca-1507-4dd5-aeba-e5e161042040+12:24800:x1876445617191168:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 Request processed in 82us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.721868:0:27623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518449.723696:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.723829:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617191296 00000100:00100000:3.0:1789518449.723838:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617191296 00000100:00100000:3.0:1789518449.723893:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:3.0:1789518449.723903:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+12:24800:x1876445617191296:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518449.723930:0:27613:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002341:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518449.724034:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+12:24800:x1876445617191296:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 132us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.724042:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518449.726753:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.727005:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617191424 00000100:00100000:0.0:1789518449.727017:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617191424 00000100:00100000:0.0:1789518449.727188:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:0.0:1789518449.727214:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+12:24800:x1876445617191424:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789518449.727298:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727317:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727332:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727347:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727354:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727359:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727382:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727391:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727398:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518449.727442:0:29483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789518449.727446:0:29483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518449.727478:0:29483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727500:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727507:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727515:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727522:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518449.727527:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727535:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727549:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:0.0:1789518449.727552:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518449.727558:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727566:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c784440 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727593:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727600:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727607:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727712:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518449.727716:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727723:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727734:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x29bef300 (ffff99ffdfff5d00) 00010000:00010000:0.0:1789518449.727737:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518449.727740:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727747:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784447 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727765:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727771:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727777:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727782:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518449.727786:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727792:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727812:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:0.0:1789518449.727815:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518449.727820:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.727825:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78444e lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518449.728023:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+12:24800:x1876445617191424:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 810us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.728033:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1789518449.734746:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.735197:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617191680 00000100:00100000:0.0:1789518449.735209:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617191680 00000100:00100000:0.0:1789518449.735288:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1789518449.735300:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+12:24800:x1876445617191680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518449.735327:0:27613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518449.735351:0:27613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784455 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd45d expref: -99 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735474:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735489:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735500:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518449.735510:0:27613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789518449.735755:0:27613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735764:0:27613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735771:0:27613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735777:0:27613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518449.735782:0:27613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735790:0:27613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735804:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:0.0:1789518449.735808:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518449.735813:0:27613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735818:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78445c lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735856:0:27613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784455 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd45d expref: 14 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735863:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:0.0:1789518449.735865:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518449.735867:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784455 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd45d expref: 14 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.735884:0:27613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696400, rc 0) 00000100:00100000:0.0:1789518449.735945:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+13:24800:x1876445617191680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 647us (1211us total) trans 21474836496 rc 301/301 00000100:00100000:0.0:1789518449.735957:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:1.0:1789518449.738349:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.738440:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617191808 00000100:00100000:3.0:1789518449.738463:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617191808 00000100:00100000:3.0:1789518449.738524:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1789518449.738536:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+13:24800:x1876445617191808:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518449.738579:0:27611:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002341:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518449.738805:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+13:24800:x1876445617191808:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 269us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.738833:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1789518449.748625:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.748754:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617192064 00000100:00100000:3.0:1789518449.748767:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617192064 00000100:00100000:3.0:1789518449.748835:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1789518449.748846:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+13:24800:x1876445617192064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518449.748870:0:27614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518449.748873:0:27614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518449.748905:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78442b lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd44f expref: 13 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.748926:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:3.0:1789518449.748932:0:27614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518449.748947:0:27614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78446a lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd464 expref: -99 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518449.750043:0:27614:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x63:0x0], count =31 00000004:00080000:3.0:1789518449.750053:0:27614:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x63:0x0]+31 in llog 00000004:00080000:3.0:1789518449.750103:0:27614:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x82:0x0], index 0: 0 00010000:00010000:3.0:1789518449.750505:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784471 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.750522:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784471 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.750535:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784471 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.750598:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78446a lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd464 expref: 15 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.750823:0:27614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784471 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd464 expref: 14 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.750833:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:3.0:1789518449.750836:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518449.750840:0:27614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bcc00, rc 0) 00000100:00100000:3.0:1789518449.750972:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+14:24800:x1876445617192064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2126us (2368us total) trans 21474836497 rc 0/0 00000100:00100000:3.0:1789518449.750981:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518449.754806:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.754926:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617192320 00000100:00100000:0.0:1789518449.754939:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617192320 00000100:00100000:0.0:1789518449.755151:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:0.0:1789518449.755176:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+14:24800:x1876445617192320:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518449.755249:0:29483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518449.755283:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784471 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd464 expref: 14 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755307:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518449.755320:0:29483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518449.755348:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 3/0,1 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755376:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755388:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755406:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755414:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755440:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755727:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755735:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 2/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755743:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755749:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518449.755754:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755763:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 4/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755773:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:0.0:1789518449.755776:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518449.755781:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755787:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78447f lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755796:0:29483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755803:0:29483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755816:0:29483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755822:0:29483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518449.755825:0:29483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755832:0:29483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755840:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4b370ecf (ffff99ffdfff5d00) 00010000:00010000:0.0:1789518449.755843:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518449.755846:0:29483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.755852:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784486 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x4b370ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518449.755958:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+13:24800:x1876445617192320:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 784us (1162us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518449.755967:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:2.0:1789518449.758794:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.758969:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617192448 00000100:00100000:3.0:1789518449.758981:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617192448 00000100:00100000:3.0:1789518449.759100:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1789518449.759112:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+13:24800:x1876445617192448:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518449.759135:0:27613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518449.759175:0:27613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78448d lrc: 2/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd46b expref: -99 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.759219:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.759235:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.759250:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.759382:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c78448d lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd46b expref: 15 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.759417:0:27613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd46b expref: 14 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.759427:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518449.759431:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518449.759435:0:27613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:3.0:1789518449.759523:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+14:24800:x1876445617192448:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 413us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.759531:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:2.0:1789518449.764199:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.764286:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617192704 00000100:00100000:3.0:1789518449.764298:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617192704 00000100:00100000:3.0:1789518449.764382:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:3.0:1789518449.764394:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+14:24800:x1876445617192704:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518449.764513:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.764534:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.764550:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518449.765193:0:27611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].2, 88 off8344 00000004:00080000:3.0:1789518449.765207:0:27611:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 503761592128ns, next at 504761588928ns, rc = 0 00000004:00010000:3.0:1789518449.765311:0:27611:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000094d459e reply state 00000000b9268a21 transno 21474836498 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518449.765336:0:27611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518449.765682:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+16:24800:x1876445617192704:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1288us (1491us total) trans 21474836498 rc 0/0 00000100:00100000:3.0:1789518449.765692:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00010000:00010000:1.0:1789518449.768520:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.768539:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.768547:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.768553:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518449.768559:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.768568:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.768587:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:1.0:1789518449.768591:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518449.768643:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 2/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.768651:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78449b lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518449.769715:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.769795:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617192832 00000100:00100000:0.0:1789518449.769806:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617192832 00000100:00100000:0.0:1789518449.769864:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:0.0:1789518449.769874:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+15:24800:x1876445617192832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518449.769900:0:29483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518449.769921:0:29483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd472 expref: -99 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.770017:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd472 expref: 16 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.770033:0:29483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd472 expref: 16 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.770054:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518449.770058:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518449.770061:0:29483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:0.0:1789518449.770134:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+16:24800:x1876445617192832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 260us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.770142:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1789518449.772839:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.772993:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617192960 00000100:00100000:0.0:1789518449.773058:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617192960 00000100:00080000:3.0:1789518449.773177:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518449.773223:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518449.773234:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+5:2342:x1876445617192960:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789518449.773841:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+6:2342:x1876445617192960:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 607us (1007us total) trans 21474836482 rc 0/0 00000100:00100000:0.0:1789518449.773851:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1789518449.776231:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.776444:0:27615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617193216 00000100:00100000:3.0:1789518449.776466:0:27615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617193216 00000100:00100000:3.0:1789518449.776540:0:27615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518449.776552:0:27615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+16:24800:x1876445617193216:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518449.776860:0:27615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+17:24800:x1876445617193216:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 310us (638us total) trans 21474836499 rc 0/0 00000100:00100000:3.0:1789518449.776869:0:27615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518449.780545:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.780696:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617193472 00000100:00100000:0.0:1789518449.780710:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617193472 00000100:00100000:0.0:1789518449.780835:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1789518449.780849:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+17:24800:x1876445617193472:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518449.780997:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+17:24800:x1876445617193472:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 139us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.781030:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:2.0:1789518449.782959:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.783130:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617193600 00000100:00100000:3.0:1789518449.783140:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617193600 00000100:00100000:3.0:1789518449.783199:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:3.0:1789518449.783209:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+17:24800:x1876445617193600:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518449.783231:0:29483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518449.783259:0:29483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844a9 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd479 expref: -99 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.783356:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7844b0 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.783385:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7844b0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.783401:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7844b0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518449.783475:0:29483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518449.783499:0:29483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7844b0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.783535:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844a9 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd479 expref: 19 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.783564:0:29483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7844b0 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd479 expref: 18 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.783575:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518449.783579:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789518449.783584:0:29483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc000, rc 0) 00000100:00100000:3.0:1789518449.783702:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+18:24800:x1876445617193600:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 493us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.783710:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:2.0:1789518449.786305:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518449.786416:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617193728 00000100:00100000:1.0:1789518449.786427:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617193728 00000100:00100000:1.0:1789518449.786498:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518449.786509:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17243dca-1507-4dd5-aeba-e5e161042040+6:2345:x1876445617193728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518449.786529:0:28515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518449.786555:0:28515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd480 expref: -99 pid: 28515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518449.786588:0:28515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e272, blocks: 0x1 00010000:00010000:1.0:1789518449.786651:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1789518449.786658:0:28515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518449.786670:0:28515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd480 expref: 7 pid: 28515 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.786693:0:28515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd480 expref: 7 pid: 28515 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.786709:0:28515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45000, rc 0) 00000100:00100000:1.0:1789518449.786780:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17243dca-1507-4dd5-aeba-e5e161042040+7:2345:x1876445617193728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 272us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518449.786788:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518449.789385:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.789580:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617193984 00000100:00100000:3.0:1789518449.789591:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617193984 00000100:00100000:3.0:1789518449.789685:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:3.0:1789518449.789696:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+18:24800:x1876445617193984:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789518449.789830:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+18:24800:x1876445617193984:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 134us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.789837:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:2.0:1789518449.792546:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.792643:0:29734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617194112 00000100:00100000:0.0:1789518449.792653:0:29734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617194112 00000100:00100000:0.0:1789518449.792705:0:29734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518449.792713:0:29734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17243dca-1507-4dd5-aeba-e5e161042040+7:24800:x1876445617194112:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518449.792731:0:29734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518449.792755:0:29734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd487 expref: -99 pid: 29734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.792794:0:29734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd480 expref: 8 pid: 28515 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.792806:0:29734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518449.792811:0:29734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518449.792817:0:29734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 4/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 8 pid: 29734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.792870:0:29734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd480 expref: 8 pid: 28515 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.792888:0:29734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd480 expref: 8 pid: 28515 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518449.792905:0:29734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:29734:1876445627586688:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518449.793018:0:29734:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518449.799019:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.799150:0:29734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:29734:1876445627586688:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518449.799197:0:29734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 3/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 8 pid: 29734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.799225:0:29734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696400, rc 0) 00000100:00100000:1.0:1789518449.799239:0:27598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617194240 00000100:00100000:1.0:1789518449.799277:0:27598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617194240 00010000:00010000:1.0:1789518449.799323:0:27598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd480 expref: 9 pid: 28515 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518449.799370:0:27598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518449.799382:0:27598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8517450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17243dca-1507-4dd5-aeba-e5e161042040+9:2342:x1876445617194240:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518449.799400:0:27598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518449.799428:0:27598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd480 expref: 9 pid: 28515 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.799442:0:27598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd480 expref: 9 pid: 28515 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.799484:0:27598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dada4965/0x631fd8698c7844b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd480 expref: 9 pid: 28515 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.799500:0:27598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518449.799505:0:27598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518449.799514:0:27598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 8 pid: 29734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.799526:0:27598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 8 pid: 29734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.799567:0:27598:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 8 pid: 29734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518449.799597:0:27598:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:27598:1876445627586816:192.168.206.51@tcp:105: 00000100:00100000:0.0:1789518449.799707:0:29734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17243dca-1507-4dd5-aeba-e5e161042040+8:24800:x1876445617194112:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 6992us (7168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.799717:0:29734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518449.799718:0:27598:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518449.802357:0:27598:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:27598:1876445627586816:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518449.802400:0:27598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518449.802517:0:27598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8517450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17243dca-1507-4dd5-aeba-e5e161042040+7:2342:x1876445617194240:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3135us (3507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518449.802529:0:27598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1789518449.805772:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.805885:0:28301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617194368 00000100:00100000:3.0:1789518449.805896:0:28301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617194368 00002000:00100000:3.0:1789518449.805971:0:28301:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x82:0x0] (0->13) req@ffff99ffd846e680 x1876445617194368/t0(0) o4->17243dca-1507-4dd5-aeba-e5e161042040@192.168.206.51@tcp:95/0 lens 504/0 e 0 to 0 dl 1789518460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789518449.806009:0:28301:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846e680 with x1876445617194368 ext(0->13) 00002000:00010000:3.0:1789518449.806017:0:28301:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd846e680 00000100:00100000:3.0:1789518449.806076:0:28301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518449.806088:0:28301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17243dca-1507-4dd5-aeba-e5e161042040+7:2343:x1876445617194368:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789518449.807163:0:28301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17243dca-1507-4dd5-aeba-e5e161042040+9:2343:x1876445617194368:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 1068us (1392us total) trans 21474836483 rc 0/0 00000100:00100000:3.0:1789518449.807173:0:28301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:3.0:1789518449.807182:0:28301:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x82:0x0] (0->13) req@ffff99ffd846e680 x1876445617194368/t21474836483(0) o4->17243dca-1507-4dd5-aeba-e5e161042040@192.168.206.51@tcp:95/0 lens 504/448 e 0 to 0 dl 1789518460 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789518449.807952:0:28301:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846e680 with x1876445617194368 ext(0->13) 00002000:00010000:3.0:1789518449.807959:0:28301:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd846e680 00000100:00100000:2.0:1789518449.810934:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.811062:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617194496 00000100:00100000:0.0:1789518449.811075:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617194496 00000100:00100000:3.0:1789518449.811259:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:3.0:1789518449.811273:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+18:24800:x1876445617194496:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789518449.850721:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836496 is committed 00000001:00080000:1.0:1789518449.850750:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836499 is committed 00000004:00080000:1.0:1789518449.850758:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789518449.850898:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+15:24800:x1876445617194496:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 39617us (39963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518449.850912:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:3.0:1789518449.852157:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627586944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789518449.852226:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518449.852289:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627586944 00000100:00100000:0.0:1789518449.852304:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627586944 00000100:00100000:0.0:1789518449.852372:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518449.852385:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627586944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789518449.852599:0:28297:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 0 -> 14 00002000:00010000:0.0:1789518449.852603:0:28297:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 0 -> 1789518450 00002000:00010000:0.0:1789518449.852605:0:28297:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518449.852607:0:28297:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 1789518450 -> 1789518450 00002000:00010000:0.0:1789518449.852610:0:28297:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518449.852812:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627586944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 430us (584us total) trans 21474836484 rc 0/0 00000100:00100000:0.0:1789518449.852822:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789518449.853995:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffd846ed80/2, rc 0, transno 21474836484 00000100:00100000:3.0:1789518449.854007:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627586944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789518449.854603:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518449.854875:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617194624 00000100:00100000:1.0:1789518449.854889:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617194624 00000100:00100000:1.0:1789518449.854952:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518449.854963:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17243dca-1507-4dd5-aeba-e5e161042040+9:2342:x1876445617194624:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789518449.894739:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836484 is committed 00000001:00080000:0.0:1789518449.894756:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836482 is committed 00000001:00080000:0.0:1789518449.894772:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836483 is committed 00000100:00100000:1.0:1789518449.894928:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17243dca-1507-4dd5-aeba-e5e161042040+6:2342:x1876445617194624:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 39961us (40322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518449.894939:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518449.899089:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518449.899188:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617194880 00000100:00100000:2.0:1789518449.899209:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617194880 00000100:00100000:2.0:1789518449.899327:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:2.0:1789518449.899339:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+14:24800:x1876445617194880:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518449.899403:0:27611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518449.899430:0:27611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7844b0 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd479 expref: 14 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.899467:0:27611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:2.0:1789518449.899473:0:27611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518449.899502:0:27611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.899516:0:27611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.899526:0:27611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518449.899808:0:27611:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004bf1a8e reply state 0000000092b836e0 transno 21474836500 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518449.899819:0:27611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518449.899917:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+15:24800:x1876445617194880:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 580us (947us total) trans 21474836500 rc 0/0 00000100:00100000:2.0:1789518449.899924:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00010000:00010000:3.0:1789518449.901793:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.901820:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.901828:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.901834:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518449.901839:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.901846:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.901859:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518449.901862:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518449.901868:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.901873:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7844c5 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518449.903796:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.903887:0:29734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617195008 00000100:00100000:0.0:1789518449.903896:0:29734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617195008 00000100:00100000:0.0:1789518449.903963:0:29734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518449.903973:0:29734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17243dca-1507-4dd5-aeba-e5e161042040+6:2343:x1876445617195008:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789518449.904208:0:29734:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 14 -> 14 00002000:00010000:0.0:1789518449.904211:0:29734:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 1789518450 -> 1789518449 00002000:00010000:0.0:1789518449.904214:0:29734:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 0 -> 1789518446 00002000:00010000:0.0:1789518449.904216:0:29734:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 1789518450 -> 1789518449 00002000:00010000:0.0:1789518449.904218:0:29734:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789518449.904279:0:29734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17243dca-1507-4dd5-aeba-e5e161042040+7:2343:x1876445617195008:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 307us (494us total) trans 21474836485 rc 0/0 00000100:00100000:0.0:1789518449.904287:0:29734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518449.906971:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.907066:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617195264 00000100:00100000:3.0:1789518449.907075:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617195264 00000100:00100000:3.0:1789518449.907164:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:3.0:1789518449.907174:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+14:24800:x1876445617195264:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789518449.907234:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.907250:0:27613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd46b expref: 14 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.907270:0:27613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 4/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.907303:0:27613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd46b expref: 14 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.907316:0:27613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd46b expref: 14 pid: 27613 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518449.907329:0:27613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:27613:1876445627587072:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518449.907424:0:27613:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518449.911732:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518449.911821:0:27613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:27613:1876445627587072:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518449.911848:0:27613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518449.912066:0:29722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617195392 00000100:00100000:0.0:1789518449.912074:0:29722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617195392 00010000:00010000:0.0:1789518449.912174:0:29722:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd46b expref: 15 pid: 27613 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518449.912216:0:29722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518449.912227:0:29722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17243dca-1507-4dd5-aeba-e5e161042040+15:2343:x1876445617195392:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518449.912244:0:29722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518449.912251:0:29722:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd46b expref: 15 pid: 27613 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.912265:0:29722:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd46b expref: 15 pid: 27613 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.912286:0:29722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784494 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd46b expref: 15 pid: 27613 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.912322:0:29722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518449.912328:0:29722:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.912338:0:29722:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.912346:0:29722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 4/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.912423:0:29722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518449.912500:0:29722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17243dca-1507-4dd5-aeba-e5e161042040+14:2343:x1876445617195392:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 275us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.912508:0:29722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00010000:00010000:3.0:1789518449.912711:0:27613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.912721:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.912797:0:27613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.912804:0:27613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.912810:0:27613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.912823:0:27613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518449.912827:0:27613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.912834:0:27613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.912844:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518449.912846:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789518449.912850:0:27613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 2/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.912856:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844cc lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518449.912963:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+13:24800:x1876445617195264:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 5790us (6003us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789518449.912971:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:2.0:1789518449.918220:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.918429:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617195520 00000100:00100000:0.0:1789518449.918439:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617195520 00000100:00100000:0.0:1789518449.918537:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518449.918548:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+7:2342:x1876445617195520:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789518449.918590:0:28297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.918611:0:28297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 7 pid: 29734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.918651:0:28297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518449.918655:0:28297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518449.918659:0:28297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.918703:0:28297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 7 pid: 29734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.918717:0:28297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 7 pid: 29734 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518449.918731:0:28297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:28297:1876445627587200:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518449.918819:0:28297:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518449.922254:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.922358:0:28297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:28297:1876445627587200:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518449.922392:0:28297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518449.922647:0:27599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617195648 00000100:00100000:2.0:1789518449.922654:0:27599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617195648 00010000:00010000:2.0:1789518449.922687:0:27599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 8 pid: 29734 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518449.922738:0:27599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1789518449.922753:0:27599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17243dca-1507-4dd5-aeba-e5e161042040+8:2342:x1876445617195648:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518449.922767:0:27599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518449.922787:0:27599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 8 pid: 29734 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.923351:0:27599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 8 pid: 29734 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.923385:0:27599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c7844be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd487 expref: 8 pid: 29734 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.923400:0:27599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518449.923405:0:27599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518449.923410:0:27599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.923420:0:27599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518449.923496:0:27599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518449.923552:0:27599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17243dca-1507-4dd5-aeba-e5e161042040+7:2342:x1876445617195648:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 805us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518449.923560:0:27599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00010000:00010000:0.0:1789518449.924972:0:28297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.924992:0:28297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.925170:0:28297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.925180:0:28297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.925188:0:28297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.925209:0:28297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518449.925213:0:28297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.925222:0:28297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.925239:0:28297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.925245:0:28297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7844d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518449.925440:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+6:2342:x1876445617195520:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 6892us (7227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518449.925458:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518449.928194:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518449.928249:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617195904 00000100:00100000:1.0:1789518449.928258:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617195904 00000100:00100000:1.0:1789518449.928314:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:1.0:1789518449.928323:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+13:24800:x1876445617195904:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518449.928411:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 3/0,1 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.928428:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.928465:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.928701:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.928712:0:27614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd472 expref: 14 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.928720:0:27614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 4/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.928751:0:27614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd472 expref: 14 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.928763:0:27614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd472 expref: 14 pid: 29483 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518449.928776:0:27614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:27614:1876445627587328:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518449.929162:0:27614:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518449.931313:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518449.931333:0:27614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:27614:1876445627587328:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518449.931495:0:27614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518449.931564:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617196032 00000100:00100000:0.0:1789518449.931570:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617196032 00010000:00010000:0.0:1789518449.931600:0:27597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd472 expref: 15 pid: 29483 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518449.931651:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518449.931672:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17243dca-1507-4dd5-aeba-e5e161042040+15:2343:x1876445617196032:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518449.931690:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518449.931697:0:27597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd472 expref: 15 pid: 29483 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.931710:0:27597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd472 expref: 15 pid: 29483 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.931733:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7844a2 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd472 expref: 15 pid: 29483 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.931748:0:27597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518449.931753:0:27597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.931760:0:27597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.931767:0:27597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 4/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.931835:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518449.931877:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17243dca-1507-4dd5-aeba-e5e161042040+14:2343:x1876445617196032:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 206us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.931884:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00010000:00010000:3.0:1789518449.932194:0:27614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518449.932203:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518449.932504:0:27614:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836501 00000001:00080000:3.0:1789518449.932745:0:27614:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836502 00000001:00080000:3.0:1789518449.932802:0:27614:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836503 00000100:00100000:3.0:1789518449.932874:0:27614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:27614:1876445627587456:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789518449.932960:0:27614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518449.933091:0:27614:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518449.933142:0:27617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627587456 00000100:00100000:0.0:1789518449.933148:0:27617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627587456 00000100:00100000:0.0:1789518449.933213:0:27617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518449.933221:0:27617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:27614:x1876445627587456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518449.933357:0:27617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:27614:x1876445627587456:12345-0@lo:1000:mdt00_002.0 Request processed in 136us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.933364:0:27617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518449.933599:0:27614:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836484 gen 2 00000004:00080000:1.0:1789518449.933604:0:27614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffd846ed80, transno 21474836484 00000100:00100000:1.0:1789518449.933644:0:27614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:27614:1876445627587456:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789518449.934937:0:27614:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836504 00000100:00100000:1.0:1789518449.935008:0:27614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:27614:1876445627587584:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789518449.935062:0:27614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518449.935162:0:27614:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe1f63180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518449.935223:0:27618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627587584 00000100:00100000:0.0:1789518449.935230:0:27618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627587584 00000100:00100000:0.0:1789518449.935373:0:27618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518449.935383:0:27618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:27614:x1876445627587584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518449.935583:0:27618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:27614:x1876445627587584:12345-0@lo:1000:mdt00_002.0 Request processed in 202us (520us total) trans 21474836486 rc 0/0 00000100:00100000:0.0:1789518449.935591:0:27618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518449.935672:0:27614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:27614:1876445627587584:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789518449.935701:0:27614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935709:0:27614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 2/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935716:0:27614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935722:0:27614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518449.935726:0:27614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935733:0:27614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 4/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935747:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:1.0:1789518449.935750:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518449.935755:0:27614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 2/0,0 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935762:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b44600/0x631fd8698c7844e1 lrc: 0/0,0 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935807:0:27614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935822:0:27614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 2/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935828:0:27614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935843:0:27614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518449.935846:0:27614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935852:0:27614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 4/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935861:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:1.0:1789518449.935863:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518449.935870:0:27614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784439 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd456 expref: 17 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935881:0:27614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784439 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd456 expref: 17 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935906:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784439 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd456 expref: 17 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.935932:0:27614:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784439 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd456 expref: 17 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518449.935943:0:27614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:27614:1876445627587712:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518449.936004:0:27614:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518449.940019:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518449.940249:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617196160 00000100:00100000:2.0:1789518449.940257:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617196160 00000100:00100000:2.0:1789518449.940310:0:27616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1789518449.940321:0:27616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+18:24799:x1876445617196160:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:2.0:1789518449.940477:0:27616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+18:24799:x1876445617196160:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 158us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518449.940484:0:27616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1789518449.940939:0:27614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:27614:1876445627587712:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518449.940967:0:27614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 2/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.940977:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c784432 lrc: 0/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941062:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941075:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941085:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941094:0:27614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941100:0:27614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 2/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941105:0:27614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941111:0:27614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518449.941114:0:27614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941120:0:27614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 4/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941149:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:1.0:1789518449.941152:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518449.941156:0:27614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 2/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941162:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45c00/0x631fd8698c7844e8 lrc: 0/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941173:0:27614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941180:0:27614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941186:0:27614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941192:0:27614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518449.941196:0:27614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941202:0:27614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941208:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:1.0:1789518449.941210:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518449.941213:0:27614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 2/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.941219:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff5b45000/0x631fd8698c7844da lrc: 0/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518449.941583:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+17:24800:x1876445617195904:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 13260us (13397us total) trans 21474836505 rc 0/0 00000100:00100000:1.0:1789518449.941592:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000020:00080000:1.0:1789518449.941596:0:27614:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789518449.942163:0:27646:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1789518449.942168:0:27646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518449.942194:0:27646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 2 00000040:00080000:0.0:1789518449.942199:0:27646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1789518449.946716:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.946805:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617196416 00000100:00100000:0.0:1789518449.946814:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617196416 00000100:00100000:0.0:1789518449.946868:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:0.0:1789518449.946878:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+17:24799:x1876445617196416:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:0.0:1789518449.947201:0:29483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].2, 136 off8464 00000100:00100000:0.0:1789518449.947428:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+17:24799:x1876445617196416:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 551us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518449.947436:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:2.0:1789518449.950776:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518449.951058:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617196672 00000100:00100000:0.0:1789518449.951067:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617196672 00000100:00100000:0.0:1789518449.951121:0:27616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518449.951130:0:27616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+17:24800:x1876445617196672:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789518449.952032:0:27616:0:(mdd_object.c:4014:mdd_close()) Object [0x200002341:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789518449.952142:0:27616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836506 00010000:00010000:0.0:1789518449.952186:0:27616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.952202:0:27616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.952214:0:27616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.952223:0:27616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 4/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.952229:0:27616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 4/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.953839:0:27616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518449.953880:0:27616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518449.954286:0:27616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+19:24800:x1876445617196672:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 3149us (3511us total) trans 21474836507 rc 0/0 00000100:00100000:0.0:1789518449.954298:0:27616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000020:00080000:0.0:1789518449.954304:0:27616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518449.954380:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518449.954388:0:29484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.954399:0:29484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518449.954403:0:29484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.954413:0:29484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.954427:0:29484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff99ffdfff5600) 00010000:00010000:1.0:1789518449.954431:0:29484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518449.954436:0:29484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 1/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.954442:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7844ef lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 27616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518449.954471:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518449.954473:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518449.954474:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518450.054263:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518450.054354:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617196928 00000100:00100000:2.0:1789518450.054363:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617196928 00000100:00100000:2.0:1789518450.054553:0:27616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1789518450.054561:0:27616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+19:24716:x1876445617196928:12345-192.168.206.51@tcp:35:multiop.0 00000100:00080000:3.0:1789518450.054808:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518450.055021:0:27616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+20:24716:x1876445617196928:12345-192.168.206.51@tcp:35:multiop.0 Request processed in 458us (766us total) trans 21474836508 rc 0/0 00000100:00100000:2.0:1789518450.055028:0:27616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00010000:00010000:0.0:1789518450.546781:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518450.995908:0:27646:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1789518450.995919:0:27646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518450.995959:0:27646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:0.0:1789518450.995973:0:27646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1789518450.996082:0:27646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:27646:1876445627587840:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518450.996168:0:27646:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff40473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518450.998398:0:27646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:27646:1876445627587840:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518450.998830:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518450.998897:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617197056 00000100:00100000:2.0:1789518450.998905:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617197056 00000100:00100000:2.0:1789518450.998963:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1789518450.998973:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+20:24945:x1876445617197056:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518450.999010:0:27611:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002341:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518450.999127:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+20:24945:x1876445617197056:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 155us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518450.999135:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:0.0:1789518451.002858:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518451.002929:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617197312 00000100:00100000:3.0:1789518451.002938:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617197312 00000100:00100000:3.0:1789518451.002992:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1789518451.003008:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+20:24945:x1876445617197312:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518451.003026:0:27613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518451.003045:0:27613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd48e expref: -99 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518451.003150:0:27613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7844fd lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518451.003164:0:27613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7844fd lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518451.003176:0:27613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7844fd lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518451.003187:0:27613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 14 00010000:00010000:3.0:1789518451.003319:0:27613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c7844f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd48e expref: 23 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518451.003346:0:27613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7844fd lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd48e expref: 22 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518451.003361:0:27613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:3.0:1789518451.003363:0:27613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518451.003366:0:27613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:3.0:1789518451.003409:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17243dca-1507-4dd5-aeba-e5e161042040+22:24945:x1876445617197312:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 408us (556us total) trans 21474836509 rc 0/0 00000100:00100000:3.0:1789518451.003416:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1789518451.005948:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518451.005985:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617197568 00000100:00100000:0.0:1789518451.005995:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617197568 00000100:00100000:0.0:1789518451.006055:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:0.0:1789518451.006065:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+22:24945:x1876445617197568:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518451.006353:0:27614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 3/0,1 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518451.006369:0:27614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518451.006381:0:27614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518451.006592:0:27614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518451.006601:0:27614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518451.006633:0:27614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518451.006641:0:27614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518451.006645:0:27614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518451.006665:0:27614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518451.006679:0:27614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:0.0:1789518451.006682:0:27614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518451.006687:0:27614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 2/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518451.006693:0:27614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78450b lrc: 0/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518451.006833:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+23:24945:x1876445617197568:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 769us (896us total) trans 21474836510 rc 0/0 00000100:00100000:0.0:1789518451.006842:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000040:00080000:0.0:1789518451.007038:0:27646:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1789518451.007043:0:27646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518451.007070:0:27646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:0.0:1789518451.007076:0:27646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1789518451.010122:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518451.010184:0:27615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617197824 00000100:00100000:3.0:1789518451.010193:0:27615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617197824 00000100:00100000:3.0:1789518451.010247:0:27615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518451.010257:0:27615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+23:24945:x1876445617197824:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518451.010476:0:27615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17243dca-1507-4dd5-aeba-e5e161042040+24:24945:x1876445617197824:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 219us (362us total) trans 21474836511 rc 0/0 00000100:00100000:3.0:1789518451.011941:0:27615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518451.085843:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518451.085896:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518451.085920:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518451.085948:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617197952 00000100:00100000:0.0:1789518451.085957:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518451.085958:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617198208 00000100:00100000:3.0:1789518451.085959:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617197952 00000100:00100000:1.0:1789518451.085966:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617198208 00000100:00100000:0.0:1789518451.085992:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518451.085994:0:29734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617198464 00000100:00100000:2.0:1789518451.086001:0:29734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617198464 00000100:00100000:3.0:1789518451.086026:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:1.0:1789518451.086027:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617198080 00000100:00100000:1.0:1789518451.086034:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617198080 00000100:00100000:0.0:1789518451.086034:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518451.086043:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+13:2342:x1876445617197952:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518451.086043:0:29734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617198592 00000100:00100000:2.0:1789518451.086051:0:29734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617198592 00000100:00100000:0.0:1789518451.086061:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1789518451.086073:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17243dca-1507-4dd5-aeba-e5e161042040+5:2342:x1876445617198208:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518451.086085:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1789518451.086094:0:29734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518451.086099:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617198464:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518451.086120:0:29734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17243dca-1507-4dd5-aeba-e5e161042040+6:2342:x1876445617198080:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518451.086132:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+13:2342:x1876445617197952:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518451.086132:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17243dca-1507-4dd5-aeba-e5e161042040+5:2342:x1876445617198208:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 58us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518451.086141:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617198464:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518451.086146:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:0.0:1789518451.086155:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518451.086163:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1789518451.086166:0:29734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17243dca-1507-4dd5-aeba-e5e161042040+6:2342:x1876445617198080:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 48us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518451.086177:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1789518451.086186:0:29734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00080000:3.0:1789518451.086191:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518451.086191:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617198592:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:3.0:1789518451.086198:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518451.086222:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617198592:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 37us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518451.086229:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518451.086251:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617198336 00000100:00100000:0.0:1789518451.086255:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617198336 00000100:00100000:0.0:1789518451.086304:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00080000:3.0:1789518451.086313:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518451.086314:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617198336:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518451.086342:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2342:x1876445617198336:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518451.086348:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00010000:00010000:0.0:1789518451.572372:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518452.596560:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518452.979351:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518452.979483:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617198720 00000100:00100000:3.0:1789518452.979492:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617198720 00000100:00080000:0.0:1789518452.979549:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518452.979578:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1789518452.979589:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+24:24684:x1876445617198720:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789518452.979900:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17243dca-1507-4dd5-aeba-e5e161042040+24:24684:x1876445617198720:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 311us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518452.979909:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:2.0:1789518452.986845:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518452.988490:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617198976 00000100:00100000:0.0:1789518452.988503:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617198976 00000100:00100000:0.0:1789518452.988562:0:27616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518452.988571:0:27616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+24:24684:x1876445617198976:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518452.988794:0:27616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+25:24684:x1876445617198976:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 223us (1962us total) trans 21474836512 rc 0/0 00000100:00100000:0.0:1789518452.988802:0:27616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00010000:00010000:0.0:1789518453.618826:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518454.129385:0:29928:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2b: Test multi remote open when creating ========================================================== 20:27:33 (1789518453) 00000100:00100000:3.0:1789518454.387062:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627588352:0@lo:400:kworker.0 00000100:00100000:0.0:1789518454.387081:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627588224:0@lo:400:kworker.0 00000100:00100000:1.0:1789518454.387110:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627587968:0@lo:400:kworker.0 00000100:00100000:3.0:1789518454.387150:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518454.387150:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518454.387160:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518454.387244:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627588096:0@lo:400:kworker.0 00000100:00100000:1.0:1789518454.387273:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627588480:0@lo:400:kworker.0 00000100:00100000:1.0:1789518454.387312:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518454.387333:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627588736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518454.387341:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518454.387344:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627588224 00000100:00100000:1.0:1789518454.387351:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627588864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518454.387352:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627588224 00000100:00100000:3.0:1789518454.387369:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518454.387411:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518454.387420:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627588224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518454.388243:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518454.388264:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627588608:0@lo:400:kworker.0 00000100:00100000:2.0:1789518454.388363:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518454.388400:0:29734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627588096 00000100:00100000:2.0:1789518454.388405:0:29734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627588096 00000100:00100000:0.0:1789518454.388416:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627588224:12345-0@lo:400:kworker.0 Request processed in 995us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518454.388437:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518454.388468:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627588352 00000100:00100000:0.0:1789518454.388472:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627588352 00000100:00100000:3.0:1789518454.388481:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627588224:0@lo:400:kworker.0 00000100:00100000:0.0:1789518454.388506:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627588480 00000100:00100000:0.0:1789518454.388511:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627588480 00000100:00100000:3.0:1789518454.388517:0:28300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627588736 00000100:00100000:3.0:1789518454.388522:0:28300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627588736 00000100:00100000:0.0:1789518454.388540:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627588608 00000100:00100000:0.0:1789518454.388545:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627588608 00000100:00100000:0.0:1789518454.388568:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518454.388575:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627588352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518454.388650:0:29734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518454.388660:0:29734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627588096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518454.388681:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627588352:12345-0@lo:400:kworker.0 Request processed in 104us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518454.388686:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627587968 00000100:00100000:0.0:1789518454.388691:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789518454.388694:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627587968 00000100:00100000:2.0:1789518454.388708:0:29734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627588096:12345-0@lo:400:kworker.0 Request processed in 48us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518454.388713:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518454.388720:0:29734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518454.388738:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789518454.388738:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627588480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518454.388753:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789518454.388753:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3283:x1876445627587968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518454.388766:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627588608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518454.388781:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627588480:12345-0@lo:400:kworker.0 Request processed in 59us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518454.388791:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518454.388806:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3283:x1876445627587968:12345-0@lo:400:kworker.0 Request processed in 56us (1645us total) trans 0 rc 0/0 00000100:00080000:0.0:1789518454.388813:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518454.388815:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1789518454.388821:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518454.388825:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518454.388827:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627588608:12345-0@lo:400:kworker.0 Request processed in 63us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518454.388834:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518454.388872:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627588096:0@lo:400:kworker.0 00000100:00100000:2.0:1789518454.388881:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627588608:0@lo:400:kworker.0 00000100:00100000:1.0:1789518454.388950:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518454.388984:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627587968:0@lo:400:kworker.0 00000100:00100000:3.0:1789518454.388988:0:28300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518454.389004:0:28300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627588736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518454.389012:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627588480:0@lo:400:kworker.0 00002000:00000024:3.0:1789518454.389034:0:28300:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789518454.389076:0:28300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627588736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518454.389173:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627588352:0@lo:400:kworker.0 00000100:00100000:2.0:1789518454.389248:0:28299:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789518454.389257:0:28299:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789518454.389320:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627588736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518454.389820:0:28299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627588864 00000100:00100000:2.0:1789518454.389825:0:28299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627588864 00000100:00100000:3.0:1789518454.389931:0:28300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518454.389938:0:29940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518454.389954:0:29940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627588864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518454.389980:0:29940:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518454.390027:0:29940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627588864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518454.390062:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627588864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518454.390154:0:29940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789518454.642775:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789518454.930316:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836486 is committed 00000001:00080000:1.0:1789518454.930329:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836485 is committed 00000001:00080000:2.0:1789518454.954363:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836512 is committed 00000020:00080000:2.0:1789518454.954397:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc8186cc0 refcount 2 committed 0 result 0 batchid 17179869275 00000020:00080000:2.0:1789518454.954402:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffee48b500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd81163c0 00000020:00080000:2.0:1789518454.954405:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffee48bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffe60ff000 00000020:00080000:2.0:1789518454.954450:0:27651:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 17179869275 committed batchid 12884902055 00000020:00080000:2.0:1789518454.954634:0:27651:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902055 00000001:02000400:0.0:1789518455.159222:0:29979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_2b Need 2 or more clients, have 1 00010000:00010000:1.0:1789518455.666919:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518456.174086:0:30027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2c: Test multi open on different mount points when creating ========================================================== 20:27:35 (1789518455) 00000100:00100000:0.0:1789518456.207946:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518456.207999:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518456.208031:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518456.208044:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617199232 00000100:00100000:2.0:1789518456.208057:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617199232 00000100:00100000:0.0:1789518456.208069:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518456.208098:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518456.208152:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518456.208165:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+12:2345:x1876445617199232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518456.208186:0:27606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617199104 00000100:00100000:1.0:1789518456.208200:0:27606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617199104 00000100:00100000:1.0:1789518456.208259:0:27606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:2.0:1789518456.208269:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17243dca-1507-4dd5-aeba-e5e161042040+12:2345:x1876445617199232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518456.208274:0:27606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+13:2345:x1876445617199104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518456.208294:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518456.208409:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617199488 00000100:00100000:3.0:1789518456.208416:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617199488 00000100:00100000:3.0:1789518456.208474:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617199744 00000100:00100000:3.0:1789518456.208478:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617199744 00000100:00100000:3.0:1789518456.208504:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617199360 00000100:00100000:3.0:1789518456.208508:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617199360 00000100:00100000:3.0:1789518456.208582:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518456.208589:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17243dca-1507-4dd5-aeba-e5e161042040+5:2345:x1876445617199488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518456.208658:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518456.208671:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2345:x1876445617199744:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518456.208710:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17243dca-1507-4dd5-aeba-e5e161042040+5:2345:x1876445617199488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 117us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518456.208717:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2345:x1876445617199744:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518456.208732:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518456.208753:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518456.208764:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518456.208775:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+5:2345:x1876445617199360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518456.208808:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+5:2345:x1876445617199360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518456.208815:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518456.209119:0:27606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3cece6-566d-43f3-ac47-832f8444672f+13:2345:x1876445617199104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 848us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518456.209386:0:27606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00080000:3.0:1789518456.209497:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518456.209531:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518456.209918:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518456.211089:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518456.211166:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518456.211218:0:28295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617199872 00000100:00100000:1.0:1789518456.211229:0:28295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617199872 00000100:00100000:1.0:1789518456.211295:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518456.211306:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2345:x1876445617199872:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518456.211458:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2345:x1876445617199872:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 153us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518456.211467:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518456.211523:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617199616 00000100:00100000:3.0:1789518456.211528:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617199616 00000100:00100000:3.0:1789518456.211560:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518456.211567:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2345:x1876445617199616:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518456.211596:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2345:x1876445617199616:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518456.211602:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00080000:1.0:1789518456.213761:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518456.213770:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789518456.691867:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518457.422574:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518457.422780:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617200000 00000100:00100000:0.0:1789518457.422791:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617200000 00000100:00100000:0.0:1789518457.422841:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:0.0:1789518457.422852:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+5:25759:x1876445617200000:12345-192.168.206.51@tcp:101:lsof.0 00010000:00010000:0.0:1789518457.422872:0:29483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518457.422892:0:29483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd495 expref: -99 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518457.422953:0:29483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784519 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518457.422967:0:29483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518457.422992:0:29483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518457.423025:0:29483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518457.423029:0:29483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518457.423065:0:29483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518457.423096:0:29483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd495 expref: 7 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518457.423111:0:29483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784519 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd495 expref: 6 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518457.423120:0:29483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5300) 00010000:00010000:0.0:1789518457.423123:0:29483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518457.423127:0:29483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696000, rc 0) 00000100:00100000:0.0:1789518457.423176:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+6:25759:x1876445617200000:12345-192.168.206.51@tcp:101:lsof.0 Request processed in 326us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518457.423183:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00010000:00010000:0.0:1789518457.714787:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518457.909756:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518457.911986:0:27616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617200256 00000100:00100000:0.0:1789518457.912137:0:27616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617200256 00000100:00100000:0.0:1789518457.912384:0:27616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518457.912396:0:27616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+12:25761:x1876445617200256:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:0.0:1789518457.912687:0:27616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17243dca-1507-4dd5-aeba-e5e161042040+13:25761:x1876445617200256:12345-192.168.206.51@tcp:35:umount.0 Request processed in 293us (2940us total) trans 21474836513 rc 0/0 00000100:00100000:0.0:1789518457.912697:0:27616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518457.915963:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518457.915998:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518457.916026:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518457.916090:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518457.916116:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617200512 00000100:00100000:1.0:1789518457.916127:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617200512 00000100:00100000:1.0:1789518457.916187:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617200384 00000100:00100000:1.0:1789518457.916190:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617200384 00000100:00100000:1.0:1789518457.916204:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617200640 00000100:00100000:1.0:1789518457.916206:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617200640 00000100:00100000:1.0:1789518457.916221:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1789518457.916230:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+15:2344:x1876445617200512:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518457.916245:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518457.916262:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28dc00/0x631fd8698c784106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd330 expref: 15 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.916278:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518457.916323:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+14:2344:x1876445617200512:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 93us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518457.916329:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1789518457.916344:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518457.916350:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+13:2344:x1876445617200384:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518457.916356:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518457.916363:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c400/0x631fd8698c7840ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd306 expref: 13 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.916372:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518457.916386:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+12:2344:x1876445617200384:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 37us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518457.916391:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518457.916400:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518457.916438:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+11:2344:x1876445617200640:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518457.916446:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518457.916455:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697400/0x631fd8698c784375 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd425 expref: 11 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.916464:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518457.916481:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+10:2344:x1876445617200640:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 45us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518457.916487:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518457.916866:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617200768 00000100:00100000:2.0:1789518457.916872:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617200768 00000100:00100000:2.0:1789518457.916956:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518457.916965:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+5:2341:x1876445617200768:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:2.0:1789518457.916986:0:28297:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784122 00000100:00080000:2.0:1789518457.916999:0:28297:0:(import.c:65:import_set_state_nolock()) ffff99ffd8b27800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518457.917039:0:28297:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836481 00000100:00100000:2.0:1789518457.917272:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17243dca-1507-4dd5-aeba-e5e161042040+2:2341:x1876445617200768:12345-192.168.206.51@tcp:9:umount.0 Request processed in 309us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518457.917277:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00010000:00010000:1.0:1789518457.917317:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518457.922776:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518457.922880:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617200896 00000100:00100000:1.0:1789518457.922890:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617200896 00000100:00100000:1.0:1789518457.922945:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518457.922956:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17243dca-1507-4dd5-aeba-e5e161042040+5:2341:x1876445617200896:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:1.0:1789518457.922988:0:28515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78411b 00000100:00080000:1.0:1789518457.923003:0:28515:0:(import.c:65:import_set_state_nolock()) ffff99fec1f31000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518457.923036:0:28515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836486 00010000:00010000:0.0:1789518457.923341:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518457.923392:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17243dca-1507-4dd5-aeba-e5e161042040+2:2341:x1876445617200896:12345-192.168.206.51@tcp:9:umount.0 Request processed in 438us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518457.923399:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518457.930376:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518457.930545:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617201664 00000100:00100000:2.0:1789518457.930555:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617201664 00000100:00100000:2.0:1789518457.930685:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:2.0:1789518457.930705:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+13:2341:x1876445617201664:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:2.0:1789518457.930734:0:27611:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784114 00000020:00010000:2.0:1789518457.930746:0:27611:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fec1e9f800: total 0 00000100:00080000:2.0:1789518457.930750:0:27611:0:(import.c:65:import_set_state_nolock()) ffff99ffee440800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518457.930785:0:27611:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836513 00000100:00100000:2.0:1789518457.931135:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17243dca-1507-4dd5-aeba-e5e161042040+12:2341:x1876445617201664:12345-192.168.206.51@tcp:39:umount.0 Request processed in 430us (770us total) trans 21474836514 rc 0/0 00000100:00100000:2.0:1789518457.931143:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000020:00010000:1.0:1789518457.931562:0:27601:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fec1e9f800: total 0 00010000:00010000:1.0:1789518457.931610:0:27601:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fec1e9f800, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1789518457.931661:0:27601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:1.0:1789518457.931665:0:27601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518457.931673:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c784280 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3d1 expref: 11 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.931714:0:27601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:1.0:1789518457.931718:0:27601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518457.931722:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7844fd lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd48e expref: 10 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.931734:0:27601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5300) 00010000:00010000:1.0:1789518457.931737:0:27601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518457.931740:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7842b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3df expref: 9 pid: 27613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.931753:0:27601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:1.0:1789518457.931756:0:27601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518457.931760:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784264 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3ca expref: 8 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.931775:0:27601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:1.0:1789518457.931778:0:27601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789518457.931782:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78432f lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd409 expref: 7 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.931793:0:27601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff99ffdfff5800) 00010000:00010000:1.0:1789518457.931795:0:27601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518457.931800:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7842d4 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd3e6 expref: 6 pid: 27611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.931813:0:27601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff99ffdfff5200) 00010000:00010000:1.0:1789518457.931815:0:27601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518457.931826:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c784439 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd456 expref: 5 pid: 27614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518457.931839:0:27601:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fec1e9f800, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1789518457.931853:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518457.931855:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518457.931857:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518458.598117:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518458.598265:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518458.598345:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518458.598416:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617201920 00000100:00100000:0.0:1789518458.598426:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617201920 00000100:00100000:0.0:1789518458.598490:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617202048 00000100:00100000:0.0:1789518458.598494:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617202048 00000100:00100000:0.0:1789518458.598519:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518458.598528:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8516050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+11:2342:x1876445617201920:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518458.598561:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518458.598578:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697e00/0x631fd8698c784217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd392 expref: 11 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518458.598593:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518458.598666:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8516050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+10:2342:x1876445617201920:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 138us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518458.598672:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518458.598899:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1789518458.598907:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+9:2342:x1876445617202048:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518458.598915:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518458.598924:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17800/0x631fd8698c78436e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd41e expref: 9 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518458.598934:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518458.598953:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+8:2342:x1876445617202048:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 46us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518458.598959:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518458.599472:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518458.599729:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617201792 00000100:00100000:0.0:1789518458.599735:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617201792 00000100:00100000:0.0:1789518458.599772:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518458.599779:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+8:2344:x1876445617201792:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518458.599802:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518458.599814:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697c00/0x631fd8698c784210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd368 expref: 8 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518458.599824:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518458.599854:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3cece6-566d-43f3-ac47-832f8444672f+7:2344:x1876445617201792:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 75us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518458.599860:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1789518458.600108:0:28298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617202176 00000100:00100000:2.0:1789518458.600114:0:28298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617202176 00000100:00100000:2.0:1789518458.600187:0:28298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518458.600194:0:28298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2341:x1876445617202176:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:2.0:1789518458.600220:0:28298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784233 00000100:00080000:2.0:1789518458.600228:0:28298:0:(import.c:65:import_set_state_nolock()) ffff99ffed824000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518458.600260:0:28298:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836481 00000100:00100000:2.0:1789518458.600434:0:28298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b8c6672-a13d-4697-9151-ddc44fea933a+2:2341:x1876445617202176:12345-192.168.206.51@tcp:9:umount.0 Request processed in 239us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518458.600441:0:28298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00080000:0.0:1789518458.601660:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789518458.601947:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518458.604877:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518458.605138:0:28297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617202304 00000100:00100000:2.0:1789518458.605148:0:28297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617202304 00000100:00100000:2.0:1789518458.605209:0:28297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518458.605231:0:28297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2341:x1876445617202304:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:2.0:1789518458.605266:0:28297:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78422c 00000100:00080000:2.0:1789518458.605275:0:28297:0:(import.c:65:import_set_state_nolock()) ffff99ffd8b25000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518458.605313:0:28297:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836486 00000100:00080000:0.0:1789518458.605424:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518458.605522:0:28297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b8c6672-a13d-4697-9151-ddc44fea933a+2:2341:x1876445617202304:12345-192.168.206.51@tcp:9:umount.0 Request processed in 304us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518458.605541:0:28297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00010000:00010000:1.0:1789518458.607083:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518458.614428:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518458.614501:0:29483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617202560 00000100:00100000:0.0:1789518458.614510:0:29483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617202560 00000100:00100000:0.0:1789518458.614591:0:29483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1789518458.614601:0:29483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+6:2341:x1876445617202560:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:0.0:1789518458.614666:0:29483:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784225 00000020:00010000:0.0:1789518458.614673:0:29483:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ffdf98c800: total 0 00000100:00080000:0.0:1789518458.614678:0:29483:0:(import.c:65:import_set_state_nolock()) ffff99ffdf98f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518458.614708:0:29483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836514 00000100:00100000:0.0:1789518458.614888:0:29483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b8c6672-a13d-4697-9151-ddc44fea933a+5:2341:x1876445617202560:12345-192.168.206.51@tcp:39:umount.0 Request processed in 288us (484us total) trans 21474836515 rc 0/0 00000100:00100000:0.0:1789518458.614896:0:29483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00080000:1.0:1789518458.614999:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789518458.615260:0:27601:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ffdf98c800: total 0 00010000:00010000:3.0:1789518458.615300:0:27601:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ffdf98c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789518458.615329:0:27601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5300) 00010000:00010000:3.0:1789518458.615333:0:27601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518458.615341:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784519 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd495 expref: 4 pid: 29483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518458.615361:0:27601:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ffdf98c800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789518458.615371:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518458.615373:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518458.615374:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518458.637182:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518458.637350:0:27607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617202816 00000100:00100000:1.0:1789518458.637366:0:27607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617202816 00000100:00100000:1.0:1789518458.637679:0:27607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1789518458.637692:0:27607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff494a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+7:2341:x1876445617202816:12345-192.168.206.51@tcp:251:umount.0 00000020:00000080:1.0:1789518458.637736:0:27607:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7840f1 00000020:00010000:1.0:1789518458.637744:0:27607:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fec1e9b800: total 0 00000100:00080000:1.0:1789518458.637748:0:27607:0:(import.c:65:import_set_state_nolock()) ffff99fec1e9c800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1789518458.637820:0:29484:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fec1e9b800: total 0 00010000:00010000:3.0:1789518458.637829:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518458.637833:0:27607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff494a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3cece6-566d-43f3-ac47-832f8444672f+3:2341:x1876445617202816:12345-192.168.206.51@tcp:251:umount.0 Request processed in 141us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518458.637844:0:27607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00010000:00010000:3.0:1789518458.637903:0:29484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fec1e9b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789518458.637951:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28c800/0x631fd8698c7840f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd2ff expref: 2 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518458.638011:0:29484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fec1e9b800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789518458.638031:0:29484:0:(genops.c:885:class_export_put()) final put ffff99fec1e9b800/aa3cece6-566d-43f3-ac47-832f8444672f 00010000:00010000:3.0:1789518458.638053:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518458.638056:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518458.638058:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789518458.638090:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec1e9b800/aa3cece6-566d-43f3-ac47-832f8444672f for MGS 00000020:00000080:0.0:1789518458.638557:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec1e9c800 for MGS 00010000:00010000:1.0:1789518458.740443:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518459.507373:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518459.507397:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627588992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518459.507472:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518459.507522:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627589120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518459.507535:0:28299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627588992 00000100:00100000:2.0:1789518459.507544:0:28299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627588992 00000100:00100000:0.0:1789518459.507564:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518459.507576:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627589504:0@lo:400:kworker.0 00000100:00100000:2.0:1789518459.507599:0:28299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627589120 00000100:00100000:2.0:1789518459.507605:0:28299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627589120 00000100:00100000:0.0:1789518459.507637:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627589632:0@lo:400:kworker.0 00000100:00100000:3.0:1789518459.507638:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518459.507655:0:28299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518459.507667:0:28299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627588992:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518459.507679:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518459.507683:0:28300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518459.507694:0:28300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627589120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518459.507698:0:28299:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518459.507715:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00002000:00000024:3.0:1789518459.507716:0:28300:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789518459.507725:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3280:1876445627589248:0@lo:400:kworker.0 00000100:00100000:2.0:1789518459.507750:0:28299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627588992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518459.507758:0:28299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518459.507775:0:28300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627589120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518459.507779:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518459.507788:0:28300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518459.507795:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627589504 00000100:00100000:2.0:1789518459.507801:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627589504 00000100:00100000:0.0:1789518459.507825:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627589760:0@lo:400:kworker.0 00000100:00080000:3.0:1789518459.507829:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518459.507834:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518459.507836:0:27614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627589632 00000100:00100000:2.0:1789518459.507841:0:27614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627589632 00000100:00100000:0.0:1789518459.507856:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518459.507869:0:27611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627589760 00000100:00100000:3.0:1789518459.507874:0:27611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627589760 00000100:00100000:2.0:1789518459.507879:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789518459.507890:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627589504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518459.507903:0:27611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518459.507908:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627589120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518459.507915:0:27611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627589632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518459.507939:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627589504:12345-0@lo:400:kworker.0 Request processed in 51us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518459.507940:0:29483:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789518459.507950:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518459.507951:0:29483:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789518459.507968:0:27614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518459.507972:0:27613:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789518459.507977:0:27614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627589760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518459.508016:0:27614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627589760:12345-0@lo:400:kworker.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518459.508023:0:27614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789518459.508125:0:27608:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518459.508159:0:27611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627589632:12345-0@lo:400:kworker.0 Request processed in 247us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518459.508167:0:27611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518459.508201:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627589504:0@lo:400:kworker.0 00000100:00100000:0.0:1789518459.508231:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627589760:0@lo:400:kworker.0 00000100:00100000:0.0:1789518459.508248:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627589632:0@lo:400:kworker.0 00000100:00100000:0.0:1789518459.508298:0:27605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627589248 00000100:00100000:0.0:1789518459.508302:0:27605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627589248 00000100:00100000:0.0:1789518459.508329:0:27605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789518459.508337:0:27605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3280:x1876445627589248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518459.508493:0:27605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3280:x1876445627589248:12345-0@lo:400:kworker.0 Request processed in 157us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518459.508501:0:27605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789518459.508715:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627589376:0@lo:400:kworker.0 00000100:00100000:1.0:1789518459.508758:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518459.508792:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 2 00000004:00080000:1.0:1789518459.508797:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836486 committed transno 21474836486 00000100:00100000:1.0:1789518459.508817:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627588992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518459.508840:0:28515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627589376 00000100:00100000:1.0:1789518459.508844:0:28515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627589376 00000100:00100000:1.0:1789518459.508873:0:28515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518459.508881:0:28515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627589376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518459.508918:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3280:1876445627589248:0@lo:400:kworker.0 00000100:00100000:1.0:1789518459.508920:0:28515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627589376:12345-0@lo:400:kworker.0 Request processed in 39us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518459.508930:0:28515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518459.508962:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627589376:0@lo:400:kworker.0 00000001:00100000:1.0:1789518459.535053:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b8c6672-a13d-4697-9151-ddc44fea933a 00000020:00000080:1.0:1789518459.535063:0:7607:0:(genops.c:885:class_export_put()) final put ffff99ffeabfa800/2b8c6672-a13d-4697-9151-ddc44fea933a 00000001:00100000:1.0:1789518459.535084:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17243dca-1507-4dd5-aeba-e5e161042040 00000020:00000080:1.0:1789518459.535087:0:7607:0:(genops.c:885:class_export_put()) final put ffff99ffd8b20800/17243dca-1507-4dd5-aeba-e5e161042040 00000020:00000080:3.0:1789518459.539412:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffeabfa800/2b8c6672-a13d-4697-9151-ddc44fea933a for lustre-OST0001 00000020:00000080:3.0:1789518459.539470:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd8b20800/17243dca-1507-4dd5-aeba-e5e161042040 for lustre-OST0001 00000020:00000080:3.0:1789518459.539494:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffed824000 for lustre-OST0001 00000020:00000080:3.0:1789518459.539498:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffd8b27800 for lustre-OST0001 00010000:00010000:3.0:1789518459.763554:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518459.777978:0:30224:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789518459.783860:0:30224:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789518459.783906:0:30224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518459.783920:0:30224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518459.783937:0:30224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518459.783943:0:30224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518459.783968:0:30224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789518459.783973:0:30224:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789518459.783996:0:30224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518459.783999:0:30224:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789518459.784004:0:30224:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789518459.784025:0:30224:0:(import.c:65:import_set_state_nolock()) ffff99fff4013000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789518459.784033:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518459.784041:0:29484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.784049:0:29484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518459.784052:0:29484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.784060:0:29484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518459.784066:0:29484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518459.784072:0:29484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518459.784075:0:29484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789518459.784077:0:29484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789518459.784102:0:29484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.784108:0:29484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518459.784137:0:29484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518459.784144:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789518459.784145:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc28c000/0x631fd8698c783ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783ed6 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518459.784161:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627590016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518459.784170:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518459.784180:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627589888:0@lo:39:umount.0 00010000:00010000:3.0:1789518459.784181:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518459.784184:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518459.784230:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518459.784234:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518459.784272:0:27598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627590016 00000100:00100000:3.0:1789518459.784279:0:27598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627590016 00000100:00100000:0.0:1789518459.784290:0:27613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627589888 00000100:00100000:0.0:1789518459.784296:0:27613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627589888 00000100:00100000:3.0:1789518459.784326:0:27598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518459.784337:0:27598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3283:x1876445627590016:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518459.784345:0:27613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1789518459.784349:0:27598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789518459.784356:0:27613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876445627589888:12345-0@lo:39:umount.0 00010000:00010000:3.0:1789518459.784365:0:27598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28ca00/0x631fd8698c783ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783ecf expref: 19 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789518459.784377:0:27613:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783f07 00010000:00010000:3.0:1789518459.784378:0:27598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1789518459.784388:0:27613:0:(import.c:65:import_set_state_nolock()) ffff99ffd1032000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789518459.786183:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fff4013000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789518459.786188:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627590016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518459.786189:0:27613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3279:x1876445627589888:12345-0@lo:39:umount.0 Request processed in 1831us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518459.786198:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627589888:0@lo:39:umount.0 00000100:00100000:3.0:1789518459.786203:0:27598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:3283:x1876445627590016:12345-0@lo:103:ldlm_bl.0 Request processed in 1866us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518459.786207:0:27613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518459.786215:0:27598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:00000080:0.0:1789518459.786227:0:27613:0:(genops.c:885:class_export_put()) final put ffff99ffd1033800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789518459.786256:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518459.786262:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd1033800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1789518459.786287:0:30224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789518459.786291:0:30224:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789518459.786294:0:30224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518459.786416:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffd1032000 for lustre-MDT0000 00010000:00010000:3.0:1789518459.787443:0:30224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.787456:0:30224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.787464:0:30224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.787470:0:30224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.787491:0:30224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518459.787512:0:30224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.787519:0:30224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.787525:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518459.787527:0:30224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.787534:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.787554:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518459.787558:0:27601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.787568:0:27601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518459.787576:0:27601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518459.787582:0:27601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518459.787585:0:27601:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789518459.787628:0:27601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.787634:0:27601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518459.787661:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.787668:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc600/0x631fd8698c783e35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783e3c expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.787680:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518459.787681:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518459.787683:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518459.787725:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518459.787737:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627590144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518459.787775:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518459.787817:0:29722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627590144 00000100:00100000:1.0:1789518459.787826:0:29722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627590144 00000100:00100000:1.0:1789518459.787869:0:29722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518459.787878:0:29722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+18:3282:x1876445627590144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518459.787897:0:29722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518459.787908:0:29722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17200/0x631fd8698c783e3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783e35 expref: 18 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.787919:0:29722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518459.787954:0:29722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:3282:x1876445627590144:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518459.787963:0:29722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518459.787970:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627590144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518459.788150:0:30224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.788178:0:30224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518459.788185:0:30224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.788193:0:30224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.788196:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518459.788204:0:29484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.788205:0:30224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.788220:0:29484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1b17c20) 00010000:00010000:3.0:1789518459.788223:0:30224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518459.788226:0:29484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.788243:0:29484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.788249:0:30224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:1.0:1789518459.788251:0:29484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.788256:0:30224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518459.788260:0:29484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518459.788266:0:29484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789518459.788270:0:29484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789518459.788272:0:30224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518459.788274:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518459.788281:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.788287:0:29484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.788293:0:30224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.788295:0:29484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518459.788309:0:30224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518459.788309:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518459.788316:0:27600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518459.788327:0:27600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.788328:0:29484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.788332:0:30224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:0.0:1789518459.788339:0:27600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518459.788340:0:30224:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789518459.788345:0:30224:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:0.0:1789518459.788351:0:27600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789518459.788352:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd200/0x631fd8698c7840e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7840ea expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518459.788355:0:27600:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789518459.788359:0:27600:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1789518459.788374:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3280:1876445627590272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518459.788377:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518459.788380:0:27600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.788383:0:29484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518459.788391:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518459.788392:0:27600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518459.788398:0:29484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518459.788415:0:29484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789518459.788416:0:30224:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789518459.788421:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:0.0:1789518459.788422:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.788426:0:29484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789518459.788428:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518459.788436:0:30224:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00010000:00010000:0.0:1789518459.788441:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b44400/0x631fd8698c784398 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78439f expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518459.788444:0:29484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789518459.788446:0:30224:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99fec1f35800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:1.0:1789518459.788462:0:29484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:3.0:1789518459.788464:0:30224:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99ffed5a6800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:1.0:1789518459.788467:0:29484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1789518459.788468:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789518459.788471:0:29484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789518459.788473:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789518459.788477:0:30224:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99ffdf98c800 2b8c6672-a13d-4697-9151-ddc44fea933a 192.168.206.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1789518459.788478:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789518459.788484:0:30224:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99fec1e9f800 17243dca-1507-4dd5-aeba-e5e161042040 192.168.206.51@tcp 3 (0 3 0) 1 0 0 0: 0000000000000000 21474836512 stale:0 00010000:00010000:1.0:1789518459.788487:0:29484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789518459.788496:0:30224:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff99fec18c99c0) has exports, disconnecting them 00000100:00100000:0.0:1789518459.788497:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3281:1876445627590400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518459.788499:0:29484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1789518459.788506:0:30224:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99fec1f35800), last request at 1789518459 00000020:00000080:3.0:1789518459.788515:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7840d5 00010000:00010000:1.0:1789518459.788517:0:29484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518459.788526:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bc400/0x631fd8698c783e27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783e2e expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518459.788531:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518459.788533:0:30224:0:(import.c:65:import_set_state_nolock()) ffff99ffeabfd000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789518459.788553:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518459.788557:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518459.788560:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518459.788572:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627590528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518459.788588:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789518459.788601:0:30224:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fec1f35800): rc 0 00000020:00000080:3.0:1789518459.788604:0:30224:0:(genops.c:885:class_export_put()) final put ffff99fec1f35800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:0.0:1789518459.788626:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789518459.788646:0:30224:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ffed5a6800), last request at 1789518459 00000100:00100000:2.0:1789518459.788658:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789518459.788659:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783f85 00000100:00100000:0.0:1789518459.788666:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627590400 00000100:00080000:3.0:1789518459.788667:0:30224:0:(import.c:65:import_set_state_nolock()) ffff99ffed5a6000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789518459.788683:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627590400 00000020:00080000:3.0:1789518459.788686:0:30224:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffed5a6800): rc 0 00000020:00000080:3.0:1789518459.788696:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffed5a6800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1789518459.788704:0:30224:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa50843a3bae0 00000100:00100000:0.0:1789518459.788717:0:27597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627590528 00000100:00100000:0.0:1789518459.788721:0:27597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627590528 00000100:00080000:3.0:1789518459.788722:0:30224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789518459.788726:0:30224:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 3 00000100:00100000:2.0:1789518459.788736:0:29722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627590272 00000004:00080000:3.0:1789518459.788739:0:30224:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789518459.788739:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518459.788740:0:29722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627590272 00000100:00100000:0.0:1789518459.788745:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3281:x1876445627590400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518459.788752:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789518459.788758:0:29722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789518459.788762:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697800/0x631fd8698c78439f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c784398 expref: 19 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518459.788764:0:29722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+19:3282:x1876445627590528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518459.788770:0:29722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518459.788772:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518459.788777:0:29722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17400/0x631fd8698c783e2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783e27 expref: 18 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518459.788789:0:29722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518459.788803:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+17:3281:x1876445627590400:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518459.788810:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518459.788823:0:27597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518459.788824:0:29722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:3282:x1876445627590528:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518459.788829:0:27597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc8514850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+16:3280:x1876445627590272:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518459.788830:0:29722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789518459.788836:0:27597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518459.788844:0:27597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28d200/0x631fd8698c7840ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c7840e3 expref: 15 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518459.788854:0:27597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1789518459.788865:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec1f35800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1789518459.788884:0:27597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc8514850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5+14:3280:x1876445627590272:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518459.788892:0:27597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00000080:1.0:1789518459.788912:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed5a6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789518459.788941:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffeabfd000 for lustre-MDT0000 00000020:00000080:1.0:1789518459.788947:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffed5a6000 for lustre-MDT0000 00000100:00100000:0.0:1789518459.788960:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3281:1876445627590400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518459.788981:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3280:1876445627590272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518459.789045:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3282:1876445627590528:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789518459.789071:0:30224:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789518459.789085:0:30224:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bdb800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789518459.789101:0:30224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789518459.789103:0:30224:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 3 00000004:00080000:3.0:1789518459.789117:0:30224:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1789518459.789129:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518459.789227:0:30224:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789518459.789236:0:30224:0:(import.c:65:import_set_state_nolock()) ffff99ffedb76000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789518459.789260:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99fec18c99c0) has no exports 00000100:00100000:1.0:1789518459.789356:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627590656:0@lo:9:umount.0 00000100:00100000:1.0:1789518459.789386:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518459.789421:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627590784:0@lo:9:umount.0 00000100:00100000:2.0:1789518459.789424:0:29734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627590656 00000100:00100000:2.0:1789518459.789429:0:29734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627590656 00000100:00100000:1.0:1789518459.789448:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518459.789522:0:29734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627590784 00000100:00100000:2.0:1789518459.789525:0:29734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627590784 00000100:00100000:3.0:1789518459.789599:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518459.789608:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876445627590656:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789518459.789699:0:28295:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783fa1 00000100:00080000:3.0:1789518459.789707:0:28295:0:(import.c:65:import_set_state_nolock()) ffff99ffee441000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789518459.789772:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789518459.789801:0:28295:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836486 00000100:00100000:3.0:1789518459.789981:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3279:x1876445627590656:12345-0@lo:9:umount.0 Request processed in 374us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518459.789988:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518459.790002:0:28295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518459.790009:0:28295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1876445627590784:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789518459.790020:0:28295:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784137 00000100:00080000:3.0:1789518459.790026:0:28295:0:(import.c:65:import_set_state_nolock()) ffff99fec1f37000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518459.790051:0:28295:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836481 00000100:00080000:1.0:1789518459.790231:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bdb800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789518459.790244:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789518459.790246:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789518459.790250:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627590656:0@lo:9:umount.0 00000100:00100000:3.0:1789518459.790465:0:28295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3279:x1876445627590784:12345-0@lo:9:umount.0 Request processed in 456us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518459.790471:0:28295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789518459.790487:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518459.790532:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffedb76000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789518459.790742:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789518459.790812:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789518459.790818:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627590784:0@lo:9:umount.0 00000001:00100000:2.0:1789518460.044609:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b8c6672-a13d-4697-9151-ddc44fea933a 00000001:00080000:2.0:1789518460.044645:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836515 is committed 00000020:00000080:2.0:1789518460.044650:0:5833:0:(genops.c:885:class_export_put()) final put ffff99ffdf98c800/2b8c6672-a13d-4697-9151-ddc44fea933a 00000001:00080000:2.0:1789518460.044665:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836513 is committed 00000001:00100000:2.0:1789518460.044671:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 17243dca-1507-4dd5-aeba-e5e161042040 00000001:00080000:2.0:1789518460.044686:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836514 is committed 00000020:00000080:2.0:1789518460.044689:0:5833:0:(genops.c:885:class_export_put()) final put ffff99fec1e9f800/17243dca-1507-4dd5-aeba-e5e161042040 00000020:00080000:2.0:1789518460.044695:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 17179869275 batchid updated 00000020:00080000:2.0:1789518460.044710:0:27651:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc8186cc0 refcount 1 committed 1 result 0 batchid 17179869275 00000020:00080000:2.0:1789518460.044715:0:27651:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffee48b500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd81163c0 00000020:00080000:2.0:1789518460.044719:0:27651:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffee48bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffe60ff000 00000020:00000080:2.0:1789518460.044784:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffdf98c800/2b8c6672-a13d-4697-9151-ddc44fea933a for lustre-MDT0000 00000020:00000080:2.0:1789518460.044842:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec1e9f800/17243dca-1507-4dd5-aeba-e5e161042040 for lustre-MDT0000 00000020:00000080:2.0:1789518460.044878:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffdf98f800 for lustre-MDT0000 00000020:00000080:2.0:1789518460.044884:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffee440800 for lustre-MDT0000 00000001:00100000:1.0:1789518460.048231:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 17243dca-1507-4dd5-aeba-e5e161042040 00000020:00000080:1.0:1789518460.048238:0:6674:0:(genops.c:885:class_export_put()) final put ffff99fec1f32800/17243dca-1507-4dd5-aeba-e5e161042040 00000001:00100000:1.0:1789518460.048266:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b8c6672-a13d-4697-9151-ddc44fea933a 00000020:00000080:1.0:1789518460.048268:0:6674:0:(genops.c:885:class_export_put()) final put ffff99ffd8b26800/2b8c6672-a13d-4697-9151-ddc44fea933a 00000001:00100000:1.0:1789518460.048279:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789518460.048281:0:6674:0:(genops.c:885:class_export_put()) final put ffff99ffee444000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789518460.048374:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec1f32800/17243dca-1507-4dd5-aeba-e5e161042040 for lustre-OST0000 00000020:00000080:0.0:1789518460.048428:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd8b26800/2b8c6672-a13d-4697-9151-ddc44fea933a for lustre-OST0000 00000020:00000080:0.0:1789518460.048443:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffee444000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789518460.048459:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec1f31000 for lustre-OST0000 00000020:00000080:0.0:1789518460.048465:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffd8b25000 for lustre-OST0000 00000020:00000080:0.0:1789518460.048469:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffee441000 for lustre-OST0000 00000020:00080000:3.0:1789518460.052857:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99fec18c99c0) has no exports 00000020:00000080:3.0:1789518460.083381:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e82 00000020:00000080:3.0:1789518460.083412:0:30224:0:(genops.c:885:class_export_put()) final put ffff99fff4010800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789518460.083435:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789518460.083444:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518460.083454:0:30224:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789518460.083457:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff99fffee299c0) has no exports 00000020:00000080:2.0:1789518460.083609:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4010800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789518460.083725:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e7b 00000020:00000080:1.0:1789518460.083731:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffd9259000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789518460.083770:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd9259000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789518460.083795:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518460.083803:0:30224:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789518460.083806:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffc4f47000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789518460.083808:0:30224:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc4f47000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789518460.083816:0:30224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1789518460.083926:0:30224:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc2d3bf60 - data ffff99ffd7bb4438/ffff99ffe60ff400 00000020:01000000:1.0:1789518460.084078:0:30224:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffe6e641e0 - data ffff99fff7ff1510/ffff99ffee0be800 00000001:00000004:1.0:1789518460.101757:0:30224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836515 00000100:00080000:0.0:1789518460.136299:0:30224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789518460.136308:0:30224:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 4 00000004:00080000:0.0:1789518460.136384:0:30224:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789518460.136386:0:30224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789518460.136928:0:27634:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789518460.136933:0:27634:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1c:0x0] index 2 count 1 00000040:00080000:3.0:1789518460.136942:0:27634:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 5 count 2 00000100:00080000:0.0:1789518460.137701:0:30224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789518460.137704:0:30224:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 4 00000004:00080000:0.0:1789518460.137711:0:30224:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789518460.137712:0:30224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789518460.138946:0:27636:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789518460.138951:0:27636:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 1 count 1 00000040:00080000:2.0:1789518460.138960:0:27636:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 5 count 2 00000020:00000080:2.0:1789518460.169790:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e4a 00000020:00000080:2.0:1789518460.169801:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffc5115000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518460.169839:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5115000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789518460.170394:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e5f 00000020:00000080:2.0:1789518460.170478:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffc6bdf000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789518460.170488:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789518460.170493:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518460.170501:0:30224:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789518460.170505:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff99fec18c8000) has no exports 00000020:00000080:0.0:1789518460.170515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6bdf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1789518460.170835:0:30224:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789518460.170843:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783eac 00000020:00000080:2.0:1789518460.170847:0:30224:0:(genops.c:885:class_export_put()) final put ffff99fff7a53000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789518460.170861:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789518460.170865:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518460.170869:0:30224:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789518460.170879:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff99ffee060000) has no exports 00000020:00000080:2.0:1789518460.170884:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783ea5 00000020:00000080:2.0:1789518460.170887:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffc4f40800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518460.171183:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff7a53000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789518460.171191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc4f40800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789518460.171350:0:30224:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789518460.171354:0:30224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789518460.171365:0:30224:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 5 00000004:00080000:2.0:1789518460.171370:0:30224:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789518460.171372:0:30224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518460.171395:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffedb76000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789518460.171418:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518460.171424:0:30224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789518460.171427:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffeaa81800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789518460.171430:0:30224:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffeaa81800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789518460.171435:0:30224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789518460.171498:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e97 00000020:00000080:2.0:1789518460.171502:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffeaa83800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789518460.171517:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789518460.171520:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518460.171523:0:30224:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789518460.171526:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff99ffee0619c0) has no exports 00000020:00000080:2.0:1789518460.171529:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e90 00000020:00000080:2.0:1789518460.171532:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffc6bde000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518460.171642:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffeaa83800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789518460.171648:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6bde000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789518460.172092:0:30224:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789518460.172095:0:30224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789518460.172097:0:30224:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 5 00000004:00080000:2.0:1789518460.172101:0:30224:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789518460.172102:0:30224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789518460.172132:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518460.172140:0:30224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789518460.172165:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518460.172168:0:30224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518460.172194:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc6bdb800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789518460.172206:0:8:0:(genops.c:885:class_export_put()) final put ffff99fff4016000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789518460.172209:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4016000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789518460.172214:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789518460.172328:0:30224:0:(genops.c:885:class_export_put()) final put ffff99fffc79f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789518460.172337:0:30224:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffc79f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789518460.172341:0:30224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789518460.172460:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e66 00000020:00000080:2.0:1789518460.172466:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffc6bdd800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789518460.172471:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789518460.172474:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518460.172482:0:30224:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789518460.172485:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff99fec18ccd40) has no exports 00000020:00000080:2.0:1789518460.172502:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518460.172505:0:30224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789518460.172509:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e6d 00000020:00000080:2.0:1789518460.172512:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffc6bda800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789518460.172518:0:30224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fffbb6a000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789518460.172550:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6bdd800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789518460.172606:0:8:0:(genops.c:885:class_export_put()) final put ffff99ffeaa81000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789518460.172608:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffeaa81000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:2.0:1789518460.172701:0:30224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fffbb6a000 3 00000020:01000004:2.0:1789518460.172706:0:30224:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99fffbb6a000 from lustre-MDT0000 00000020:00000080:2.0:1789518460.172728:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518460.172733:0:30224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789518460.172735:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffc5114800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789518460.172738:0:30224:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5114800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789518460.172744:0:30224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789518460.172772:0:30224:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1789518460.172775:0:30224:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789518460.172778:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789518460.172781:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518460.172783:0:30224:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789518460.172789:0:30224:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff99fffbb6e800 ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518460.172795:0:30224:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff99fff783cd40) has exports, disconnecting them 00000020:00080000:2.0:1789518460.172799:0:30224:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99fffbb6e800), last request at 1789518418 00000020:00000080:2.0:1789518460.172813:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e12 00000020:00010000:2.0:1789518460.172817:0:30224:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fffbb6e800: total 2 00000100:00080000:2.0:1789518460.172821:0:30224:0:(import.c:65:import_set_state_nolock()) ffff99fffbb6c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789518460.172842:0:30224:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fffbb6e800): rc 0 00000020:00080000:2.0:1789518460.172854:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff99fff783cd40) has no exports 00000020:01000000:0.0:1789518460.172879:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00010000:3.0:1789518460.172957:0:27600:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fffbb6e800: total 2 00010000:00010000:3.0:1789518460.172986:0:27600:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fffbb6e800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789518460.173011:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b44e00/0x631fd8698c783e20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783e19 expref: 9 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518460.173029:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16e00/0x631fd8698c784383 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c78437c expref: 8 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518460.173040:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c784096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c78408f expref: 7 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518460.173052:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd000/0x631fd8698c783f38 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783f31 expref: 6 pid: 27607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518460.173068:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0696c00/0x631fd8698c784391 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c78438a expref: 5 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518460.173093:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd600/0x631fd8698c783f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783f3f expref: 4 pid: 27606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518460.173105:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc28d000/0x631fd8698c7840c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c7840b9 expref: 3 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518460.173116:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd800/0x631fd8698c783f70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c783f69 expref: 2 pid: 27605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518460.173129:0:27600:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fffbb6e800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789518460.173148:0:27600:0:(genops.c:885:class_export_put()) final put ffff99fffbb6e800/ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5 00010000:00010000:3.0:1789518460.173163:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518460.173165:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518460.173167:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789518460.173239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6bda800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518460.173243:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffbb6e800/ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5 for MGS 00000020:00000080:0.0:1789518460.173265:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fffbb6c000 for MGS 00000100:00100000:0.0:1789518460.173412:0:27607:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ffd8127000:27607] 2 exiting: rc = 0 00000100:00100000:0.0:1789518460.173491:0:27605:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff99fec1b6f200:27605] 0 exiting: rc = 1 00000100:00100000:3.0:1789518460.173800:0:27606:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff99ffe017c200:27606] 1 exiting: rc = 0 00000100:00100000:2.0:1789518460.173917:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173929:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173937:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173943:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173954:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173961:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173966:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173972:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173977:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173983:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173988:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173994:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.173999:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174035:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174044:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174051:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174059:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174066:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174073:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174080:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174087:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174094:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174100:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174107:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174113:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174119:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174126:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174133:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174139:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174146:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174154:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174161:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174168:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174176:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174193:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174202:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174212:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174218:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174222:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174231:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174238:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174244:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174249:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174254:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174259:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174264:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174269:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174274:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174279:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174284:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174289:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174294:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174299:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174304:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174309:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174314:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174319:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174324:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174329:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174334:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174339:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174345:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174350:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518460.174355:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789518460.174969:0:30224:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789518460.174973:0:30224:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1789518460.175482:0:30224:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc853d420 - data ffff99fff7e8f438/ffff99fec494ec00 00000020:01000000:2.0:1789518460.175754:0:30224:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffdfdbd840 - data ffff99fff7f87870/ffff99fff4b12000 00000020:00000080:2.0:1789518460.176332:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783df6 00000020:00000080:2.0:1789518460.176345:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffff2cf000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789518460.176364:0:30224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fffbb6a000 from MGS, refs=2 00000020:01000004:2.0:1789518460.176367:0:30224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fffbb6a000 2 00000020:01000004:2.0:1789518460.176371:0:30224:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99fffbb6a000 from MGS 00000020:00000080:2.0:1789518460.176392:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518460.176409:0:30224:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789518460.176412:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffff2ce000/MGS 00000020:00000080:2.0:1789518460.176415:0:30224:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff2ce000/MGS for MGS 00000020:01000000:2.0:1789518460.176421:0:30224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789518460.176472:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789518460.176476:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518460.176481:0:30224:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789518460.176487:0:30224:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ffeaa87000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518460.176493:0:30224:0:(genops.c:1552:class_disconnect_exports()) OBD device 10 (ffff99fff7838000) has exports, disconnecting them 00000020:00080000:2.0:1789518460.176498:0:30224:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ffeaa87000), last request at 1789518418 00000020:00000080:2.0:1789518460.176502:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783ee4 00000020:00080000:2.0:1789518460.176511:0:30224:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffeaa87000): rc 0 00000020:00000080:2.0:1789518460.176515:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffeaa87000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789518460.176649:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff2cf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518460.176660:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffeaa87000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789518460.177664:0:30224:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789518460.177671:0:30224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789518460.177675:0:30224:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789518460.177682:0:30224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518460.177775:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fff4013000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789518460.177974:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518460.177981:0:30224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789518460.177985:0:30224:0:(genops.c:885:class_export_put()) final put ffff99fff7a56000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789518460.177988:0:30224:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff7a56000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789518460.177993:0:30224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789518460.178042:0:30224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fffbb6a000 1 00000020:00000080:3.0:1789518460.178054:0:30224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783de8 00000020:00000080:3.0:1789518460.178060:0:30224:0:(genops.c:885:class_export_put()) final put ffff99ffff2c8000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789518460.178077:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789518460.178082:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518460.178086:0:30224:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789518460.178090:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff99fec18cb380) has no exports 00000020:00000080:0.0:1789518460.178676:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff2c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518460.192488:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518460.192507:0:30224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789518460.192513:0:30224:0:(genops.c:885:class_export_put()) final put ffff99fffbb68800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518460.192522:0:30224:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffbb68800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789518460.192531:0:30224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789518460.192809:0:30224:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99fffbb6b000 00000020:01000000:0.0:1789518460.192827:0:30224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789518460.192831:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518460.192834:0:30224:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518460.192838:0:30224:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff99fec2aa4d40) has no exports 00000100:00100000:3.0:1789518460.193547:0:27611:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff99ffe6ed3600:27611] 0 exiting: rc = 1 00000100:00100000:0.0:1789518460.193547:0:29483:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff99fec4815400:29483] 3 exiting: rc = 0 00000100:00100000:1.0:1789518460.193695:0:30193:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff99ffc86d0400:30193] 4 exiting: rc = 0 00000100:00100000:0.0:1789518460.193803:0:27613:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff99ffc6ad3000:27613] 1 exiting: rc = 0 00000100:00100000:0.0:1789518460.194839:0:27614:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff99ffd8126200:27614] 2 exiting: rc = 0 00000100:00100000:0.0:1789518460.195164:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195173:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195182:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195191:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195208:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195216:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195225:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195232:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195241:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195249:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195265:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195276:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195288:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195301:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195312:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195322:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195333:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195342:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195350:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195358:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195366:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195373:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195380:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195389:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195411:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195420:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195427:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195431:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195441:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195458:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195467:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195476:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195487:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195495:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195503:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195512:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195520:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195527:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195534:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195547:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195555:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195561:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195569:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195579:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195589:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195609:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195812:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195823:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195833:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195841:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195852:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195862:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195871:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195881:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195891:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.195899:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.196610:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.196687:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.196694:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.196700:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.196706:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.196711:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.196715:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.196720:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518460.200592:0:27615:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99fffffe9200:27615] 0 exiting: rc = 1 00000100:00100000:2.0:1789518460.200755:0:27616:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99ffc3c7be00:27616] 1 exiting: rc = 0 00000100:00100000:0.0:1789518460.200865:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200873:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200880:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200884:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200890:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200895:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200901:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200906:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200911:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200916:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200935:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200939:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200944:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200949:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200953:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200958:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200963:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200969:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200974:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200980:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200984:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200989:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.200994:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201000:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201005:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201011:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201017:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201021:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201024:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201027:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201030:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201034:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201037:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201040:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201043:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201047:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201050:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201053:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201056:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201059:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201063:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201066:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201070:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201073:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201076:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201089:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201092:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201095:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201099:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201103:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201106:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201109:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201112:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201115:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201118:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201121:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201124:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201127:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201130:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201133:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201136:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201139:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201143:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201146:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.201462:0:27618:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff99ffd844c800:27618] 1 exiting: rc = 0 00000100:00100000:2.0:1789518460.201512:0:27617:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff99ffd32c4600:27617] 0 exiting: rc = 1 00000100:00100000:0.0:1789518460.201589:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201596:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201602:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201608:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201827:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201835:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201841:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201847:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201852:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201858:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201864:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201870:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201891:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201898:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201902:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201905:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201914:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201917:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201921:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201925:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201929:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201933:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201936:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201940:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201953:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201957:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201961:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201964:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201968:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201973:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201978:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201984:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201989:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.201995:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202002:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202008:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202034:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202043:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202048:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202054:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202060:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202065:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202076:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202081:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202087:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202093:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202099:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202104:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202126:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202132:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202142:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202154:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202160:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202165:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202171:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202177:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202188:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202196:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202201:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202206:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202226:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202232:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202237:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.202242:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.207573:0:27620:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99ffd844c600:27620] 1 exiting: rc = 0 00000100:00100000:3.0:1789518460.207574:0:27619:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99ffd844c400:27619] 0 exiting: rc = 1 00000100:00100000:0.0:1789518460.207716:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207726:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207733:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207741:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207747:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207752:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207756:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207762:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207767:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207772:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207777:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207782:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207788:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207793:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207798:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207803:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207807:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207812:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207816:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207821:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207826:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207831:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207851:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207856:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207860:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207866:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207870:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207875:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207880:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207884:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207889:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207893:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207897:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207902:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207907:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207912:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207916:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207921:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207926:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207930:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207935:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207940:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207945:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207949:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207954:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207959:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207963:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207968:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207973:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207977:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207982:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207986:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207991:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.207996:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208000:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208004:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208009:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208020:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208025:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208030:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208035:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208039:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208044:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208049:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518460.208323:0:27622:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99ffff79d600:27622] 1 exiting: rc = 0 00000100:00100000:2.0:1789518460.208453:0:27621:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99ffff79d800:27621] 0 exiting: rc = 1 00000100:00100000:0.0:1789518460.208489:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208497:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208506:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208511:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208516:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208520:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208526:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208531:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208536:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208541:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208546:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208551:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208555:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208560:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208565:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208570:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208575:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208580:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208585:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208590:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208595:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208600:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208605:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208609:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208894:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208899:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208904:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208909:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208920:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208925:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208930:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208935:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208939:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208944:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208949:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208954:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208958:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208963:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208968:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208974:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208979:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208984:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208988:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208993:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.208998:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209003:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209008:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209012:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209017:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209022:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209027:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209031:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209036:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209041:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209046:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209050:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209055:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209060:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209066:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209070:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209075:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209080:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209084:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518460.209095:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211371:0:27624:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff99ffff79c200:27624] 1 exiting: rc = 0 00000100:00100000:1.0:1789518460.211461:0:27623:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff99ffff79c600:27623] 0 exiting: rc = 1 00000100:00100000:1.0:1789518460.211505:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211512:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211517:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211522:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211527:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211533:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211538:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211543:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211548:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211553:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211557:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211563:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211568:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211574:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211579:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211584:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211589:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211604:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211610:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211635:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211640:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211646:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211651:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211656:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211660:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211665:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211670:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211674:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211679:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211684:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211688:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211693:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211697:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211702:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211707:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211711:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211716:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211721:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211725:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211730:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211734:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211739:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211744:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211749:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211755:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211760:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211765:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211770:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211775:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211780:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211785:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211789:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211801:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211807:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211812:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211817:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211822:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211827:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211832:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211837:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211842:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211847:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211852:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.211857:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518460.212377:0:27625:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff99fff45c5e00:27625] 0 exiting: rc = 1 00000100:00100000:3.0:1789518460.212575:0:27626:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff99fff45c4600:27626] 1 exiting: rc = 0 00000100:00100000:3.0:1789518460.212772:0:27627:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff99fff45c4400:27627] 2 exiting: rc = 0 00000100:00100000:1.0:1789518460.212875:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212881:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212887:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212893:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212899:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212905:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212916:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212922:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212927:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212933:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212941:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212946:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212951:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212956:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212961:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212966:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212972:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212977:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212983:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212989:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.212995:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213001:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213006:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213020:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213026:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213031:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213037:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213055:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213062:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213067:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213073:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213078:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213084:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213089:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213095:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213100:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213105:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213110:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213116:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213121:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213127:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213131:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213137:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213143:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213148:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213154:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213159:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213164:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213170:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213175:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213190:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213197:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213203:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213209:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213214:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213220:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213225:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213231:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213241:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213246:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213251:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213257:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213263:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518460.213268:0:30224:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789518460.217331:0:30224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518460.217346:0:30224:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789518460.217351:0:30224:0:(genops.c:885:class_export_put()) final put ffff99fffc79d000/MDS_uuid 00000020:00000080:2.0:1789518460.217356:0:30224:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffc79d000/MDS_uuid for MDS 00000020:01000000:2.0:1789518460.217362:0:30224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789518460.217493:0:30224:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789518460.789936:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518461.810731:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789518461.861244:0:30377:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789518461.869269:0:30377:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789518461.869314:0:30377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518461.869330:0:30377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518461.869337:0:30377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518461.869344:0:30377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518461.869368:0:30377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789518461.869373:0:30377:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789518461.869402:0:30377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518461.869406:0:30377:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789518461.869412:0:30377:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789518461.869433:0:30377:0:(import.c:65:import_set_state_nolock()) ffff99ffc5566800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789518461.869490:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627590912:0@lo:39:umount.0 00000400:00000100:2.0:1789518461.869538:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627590912 offset 0 length 224: 4 00010000:00010000:3.0:1789518461.869634:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518461.869641:0:27600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518461.869649:0:27600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518461.869653:0:27600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518461.869661:0:27600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518461.869669:0:27600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518461.869675:0:27600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518461.869678:0:27600:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789518461.869693:0:27600:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789518461.869717:0:27600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518461.869723:0:27600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518461.869752:0:27600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518461.869760:0:27600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c783f69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c783f70 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518461.869771:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518461.869772:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627591040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518461.869774:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518461.869777:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518461.869820:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518461.871503:0:29722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627591040 00000100:00100000:3.0:1789518461.871516:0:29722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627591040 00000100:00100000:3.0:1789518461.871566:0:29722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518461.871573:0:29722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1876445627591040:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789518461.871580:0:29722:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518461 with bad export cookie 7142665481872752146 00000100:00100000:3.0:1789518461.879797:0:29722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1876445627591040:12345-0@lo:103:ldlm_bl.0 Request processed in 8039us (9793us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789518461.879892:0:29722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789518461.880424:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789518461.880429:0:3283:0:(import.c:65:import_set_state_nolock()) ffff99fffc79e000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789518461.880433:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789518461.889544:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789518461.889551:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789518461.889561:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffff665880 x1876445627591040/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789518477 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789518461.889576:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789518461.889579:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789518461.889580:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789518461.889584:0:3283:0:(import.c:65:import_set_state_nolock()) ffff99fffc79e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518461.889588:0:3283:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1789518461.889603:0:3283:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99fffc79e000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518461.889676:0:3283:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff78a8e00 x1876445627591168/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518461.889708:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3283:1876445627591040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518461.890457:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3279:1876445627591168:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1789518461.890522:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627591168 offset 0 length 520: 4 00010000:00010000:3.0:1789518462.838278:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518463.859432:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518464.626734:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518464.626745:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518464.627327:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518464.627350:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627591296:0@lo:400:kworker.0 00000400:00000100:1.0:1789518464.627419:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627591296 offset 0 length 224: 4 00000001:00100000:1.0:1789518464.656437:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789518464.656446:0:7607:0:(genops.c:885:class_export_put()) final put ffff99fec1f36800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789518464.656527:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec1f36800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789518464.656571:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec1f37000 for lustre-OST0001 00010000:00010000:3.0:1789518464.884435:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518465.907703:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789518466.674755:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789518466.674763:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789518466.674885:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627591424:0@lo:400:kworker.0 00000400:00000100:1.0:1789518466.674933:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627591424 offset 0 length 224: 4 00010000:00010000:3.0:1789518466.931553:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518467.957138:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518468.978882:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518470.003214:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518471.026848:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518471.282943:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518461/real 1789518461] req@ffff99fff78a8e00 x1876445627591168/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518471 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518471.282986:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fff78a8e00 x1876445627591168/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518471 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518471.282998:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518461/real 1789518461] req@ffff99ffffe5b100 x1876445627590912/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518471 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518471.283011:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffffe5b100 x1876445627590912/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518471 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518471.283029:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fffc79e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518471.283052:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789518471.283055:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3279:1876445627591168:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1789518471.283062:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc5566800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789518471.283085:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627590912:0@lo:39:umount.0 00000100:00080000:2.0:1789518471.283126:0:30377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518471.283131:0:30377:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789518471.283209:0:30377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789518471.283984:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518471.284376:0:19561:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789518471.284379:0:19561:0:(import.c:65:import_set_state_nolock()) ffff99fffc79e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518471.284385:0:19561:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1789518471.284391:0:19561:0:(import.c:630:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00010000:00010000:2.0:1789518471.284395:0:30377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789518471.284402:0:19561:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99fffc79e000 using connection 192.168.206.151@tcp/0@lo 00010000:00010000:2.0:1789518471.284412:0:30377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518471.284420:0:30377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518471.284428:0:30377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518471.284431:0:19561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffff664380 x1876445627591552/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518471.284506:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627591680:0@lo:400:kworker.0 00000400:00000100:3.0:1789518471.284550:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627591680 offset 0 length 224: 4 00010000:00010000:2.0:1789518471.284590:0:30377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518471.284601:0:30377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518471.284606:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518471.284609:0:30377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518471.284631:0:29484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518471.284648:0:29484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc1b17c20) 00010000:00010000:2.0:1789518471.284652:0:30377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518471.284654:0:29484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518471.284671:0:30377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518471.284675:0:29484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518471.284687:0:29484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518471.284691:0:30377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789518471.284706:0:30377:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:01000000:3.0:1789518471.284719:0:29484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518471.284722:0:29484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789518471.284725:0:29484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000004:2.0:1789518471.284732:0:30377:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789518471.284738:0:30377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:3.0:1789518471.284739:0:29484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fffc79e000 00010000:00010000:3.0:1789518471.284745:0:29484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789518471.284745:0:30377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518471.284752:0:30377:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:3.0:1789518471.284754:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b44200/0x631fd8698c783f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783f46 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789518471.284759:0:30377:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99fec2aa0000) has no exports 00010000:00010000:3.0:1789518471.284769:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518471.284774:0:29484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518471.284781:0:29484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45600 already unused, calling callback (ffffffffc1b17c20) 00000020:00080000:2.0:1789518471.284782:0:30377:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99fec2aa0000) has no exports 10000000:00010000:3.0:1789518471.284785:0:29484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518471.284793:0:29484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518471.284799:0:29484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518471.284804:0:29484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789518471.284806:0:29484:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789518471.284808:0:29484:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789518471.284812:0:29484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fffc79e000 00010000:00010000:3.0:1789518471.284815:0:29484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518471.284827:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45600/0x631fd8698c78438a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784391 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518471.284835:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518471.284836:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518471.284838:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518471.284844:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518471.287200:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3279:1876445627591552:0@lo:250:kworker.0 00000400:00000100:1.0:1789518471.287262:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627591552 offset 0 length 520: 4 00000020:01000000:2.0:1789518471.294596:0:30377:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99fff11a0360 - data ffff99ffd7ad7798/ffff99fec3a11c00 00000020:01000000:3.0:1789518471.296516:0:30377:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99fff78874e0 - data ffff99ffd9733438/ffff99fff4c6c000 00100000:10000000:3.0:1789518471.306367:0:30377:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789518471.336535:0:30377:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783f54 00000020:00000080:1.0:1789518471.336545:0:30377:0:(genops.c:885:class_export_put()) final put ffff99ffed5a1800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789518471.336567:0:30377:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fff7a53800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789518471.336571:0:30377:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fff7a53800 2 00000020:01000004:1.0:1789518471.336574:0:30377:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99fff7a53800 from lustre-OST0000 00000020:00000080:1.0:1789518471.336600:0:30377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518471.336629:0:30377:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789518471.336642:0:30377:0:(genops.c:885:class_export_put()) final put ffff99ffed5a5000/lustre-OST0000_UUID 00000020:00000080:1.0:1789518471.336645:0:30377:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed5a5000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789518471.336652:0:30377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789518471.336689:0:30377:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789518471.336693:0:30377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789518471.336696:0:30377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518471.336702:0:30377:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789518471.336707:0:30377:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99ffd8623000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518471.336713:0:30377:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff99ffc65119c0) has exports, disconnecting them 00000020:00080000:1.0:1789518471.336717:0:30377:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99ffd8623000), last request at 1789518426 00000020:00000080:1.0:1789518471.336721:0:30377:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783f7e 00000020:00080000:1.0:1789518471.336730:0:30377:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffd8623000): rc 0 00000020:00000080:1.0:1789518471.336736:0:30377:0:(genops.c:885:class_export_put()) final put ffff99ffd8623000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789518471.337449:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed5a1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789518471.337462:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd8623000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789518471.339211:0:30377:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789518471.339218:0:30377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518471.339222:0:30377:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789518471.339240:0:30377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518471.339425:0:30377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518471.339433:0:30377:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789518471.339438:0:30377:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fff7a53800 1 00000020:00000080:0.0:1789518471.339444:0:30377:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783f23 00000020:00000080:0.0:1789518471.339451:0:30377:0:(genops.c:885:class_export_put()) final put ffff99ffedb7c800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789518471.339457:0:30377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789518471.339461:0:30377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518471.339465:0:30377:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518471.339468:0:30377:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99fff78399c0) has no exports 00000020:00000080:2.0:1789518471.339667:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc5566800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789518471.339676:0:19561:0:(genops.c:885:class_export_put()) final put ffff99fff4158000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789518471.339679:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4158000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789518471.339686:0:19561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789518471.339756:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb7c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789518471.355528:0:30377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518471.355543:0:30377:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789518471.355548:0:30377:0:(genops.c:885:class_export_put()) final put ffff99fff7a55800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789518471.355553:0:30377:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff7a55800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789518471.355561:0:30377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789518471.355693:0:30377:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99fff7a54800 00000020:02000400:2.0:1789518471.355733:0:30377:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789518472.053825:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518473.078899:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518473.090886:0:30531:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789518473.101741:0:30531:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789518473.101813:0:30531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518473.101829:0:30531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518473.101836:0:30531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518473.101844:0:30531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518473.101861:0:30531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789518473.101866:0:30531:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789518473.101885:0:30531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518473.101896:0:30531:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffff667480 x1876445627591296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518480 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518473.101913:0:30531:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff78a8000 x1876445627591424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518482 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518473.101939:0:30531:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffff664700 x1876445627591680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518487 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789518473.102039:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518473.102046:0:27601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518473.102054:0:27601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518473.102057:0:27601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518473.102066:0:27601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518473.102073:0:27601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518473.102078:0:27601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518473.102081:0:27601:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789518473.102083:0:27601:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789518473.102094:0:27601:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fffc79e000 00010000:00010000:3.0:1789518473.102105:0:27601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518473.102112:0:27601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7840b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7840c0 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518473.102122:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518473.102124:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518473.102126:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518473.102162:0:30531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789518473.102168:0:30531:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518473.102187:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627591424:0@lo:400:kworker.0 00000100:00100000:1.0:1789518473.102196:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627591296:0@lo:400:kworker.0 00000100:00080000:0.0:1789518473.102202:0:30531:0:(import.c:65:import_set_state_nolock()) ffff99fec1f34800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789518473.102313:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627591808:0@lo:39:umount.0 00000400:00000100:3.0:1789518473.102369:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627591808 offset 0 length 224: 4 00000100:00100000:2.0:1789518473.102460:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627591680:0@lo:400:kworker.0 00010000:00010000:3.0:1789518474.098793:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518475.123083:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518476.147177:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518476.404690:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789518476.404702:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789518477.170830:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518478.194891:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518479.219564:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518480.244903:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518481.266907:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518481.522952:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789518481.522963:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789518482.291491:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518483.315143:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518473/real 1789518473] req@ffff99fff78ab480 x1876445627591808/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518483 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518483.315175:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fff78ab480 x1876445627591808/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518483 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789518483.315193:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec1f34800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789518483.315207:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627591808:0@lo:39:umount.0 00000100:00080000:2.0:1789518483.315766:0:30531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518483.315771:0:30531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789518483.315776:0:30531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789518483.315957:0:27600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518483.317992:0:30531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518483.318010:0:30531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518483.318018:0:30531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518483.318025:0:30531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518483.318054:0:30531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518483.318061:0:30531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518483.318068:0:30531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518483.318075:0:30531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518483.318082:0:30531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518483.318105:0:30531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789518483.318109:0:30531:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789518483.318130:0:30531:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789518483.318134:0:30531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789518483.318138:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518483.318143:0:30531:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789518483.318157:0:30531:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff99fffee2b380) has no exports 00000020:00080000:2.0:1789518483.318177:0:30531:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff99fffee2b380) has no exports 00010000:00010000:3.0:1789518483.319879:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518483.319903:0:29484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518483.319913:0:29484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518483.319917:0:29484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518483.319926:0:29484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518483.319933:0:29484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518483.319939:0:29484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789518483.319941:0:29484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789518483.319945:0:29484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789518483.319958:0:29484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fffc79e000 00010000:00010000:3.0:1789518483.319962:0:29484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518483.319970:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b44000/0x631fd8698c78408f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784096 expref: -99 pid: 29012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518483.319983:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518483.319987:0:29484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518483.319993:0:29484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518483.319996:0:29484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518483.320015:0:29484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518483.320022:0:29484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518483.320027:0:29484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789518483.320030:0:29484:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789518483.320031:0:29484:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789518483.320036:0:29484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fffc79e000 00010000:00010000:3.0:1789518483.320039:0:29484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518483.320045:0:29484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffd0696600/0x631fd8698c78437c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784383 expref: -99 pid: 27609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518483.320057:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518483.320059:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518483.320060:0:29484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518483.320125:0:27601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789518483.320932:0:30531:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99fff11a0d20 - data ffff99fff7f72d80/ffff99fec2367400 00000020:01000000:2.0:1789518483.321074:0:30531:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc77f3c60 - data ffff9a0000b0be58/ffff99fec4ac0800 00100000:10000000:2.0:1789518483.331708:0:30531:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789518483.353864:0:30531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7840a4 00000020:00000080:1.0:1789518483.353877:0:30531:0:(genops.c:885:class_export_put()) final put ffff99fec1e9a000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789518483.353898:0:30531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffed824800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789518483.353902:0:30531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffed824800 2 00000020:01000004:1.0:1789518483.353905:0:30531:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffed824800 from lustre-OST0001 00000020:00000080:2.0:1789518483.353919:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec1e9a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789518483.353943:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518483.353955:0:30531:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789518483.353959:0:30531:0:(genops.c:885:class_export_put()) final put ffff99ffc5de1800/lustre-OST0001_UUID 00000020:00000080:1.0:1789518483.353962:0:30531:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5de1800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789518483.353983:0:30531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789518483.354096:0:30531:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5->MGS 00010000:00010000:1.0:1789518483.354114:0:30531:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783f38 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518483.354148:0:30531:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783f38 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518483.354156:0:30531:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789518483.354159:0:30531:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789518483.354163:0:30531:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789518483.354179:0:30531:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fffc79e000 00010000:00010000:1.0:1789518483.354184:0:30531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45e00/0x631fd8698c783f31 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783f38 expref: -99 pid: 28294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518483.354200:0:30531:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518483.354207:0:30531:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518483.354216:0:30531:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518483.354219:0:30531:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789518483.354221:0:30531:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789518483.354233:0:30531:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99fffc79e000 00010000:00010000:1.0:1789518483.354236:0:30531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bdc00/0x631fd8698c783e19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c783e20 expref: -99 pid: 27594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789518483.354262:0:30531:0:(import.c:65:import_set_state_nolock()) ffff99fffc79e000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789518483.354266:0:30531:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789518483.354269:0:30531:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789518483.354271:0:30531:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789518483.354276:0:30531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789518483.354301:0:30531:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffff664380 x1876445627591552/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789518486 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789518483.354332:0:30531:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789518483.354335:0:30531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1789518483.354381:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5:3279:1876445627591552:0@lo:250:kworker.0 10000000:01000000:1.0:1789518483.354416:0:30531:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789518483.354426:0:30531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c783e04 00000020:00000080:1.0:1789518483.354431:0:30531:0:(genops.c:885:class_export_put()) final put ffff99fffc79b800/ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5 00000020:01000000:1.0:1789518483.354439:0:30531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.151@tcp (flags='') 00000020:00000080:1.0:1789518483.354450:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518483.354455:0:30531:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789518483.354459:0:30531:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff99fec2aa3380) has no exports 00000020:00000080:2.0:1789518483.354474:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffc79b800/ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5 for MGC192.168.206.151@tcp 10000000:01000000:0.0:1789518483.354645:0:27609:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789518483.354662:0:30531:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.151@tcp: client import never connected 00000100:00080000:1.0:1789518483.354666:0:30531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789518483.354673:0:30531:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789518483.354676:0:30531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789518483.354678:0:30531:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789518483.354712:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fffc79e000 for MGC192.168.206.151@tcp 00000020:00000080:1.0:1789518483.354727:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518483.354733:0:30531:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.151@tcp (uuid ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5) 00000020:00000080:1.0:1789518483.354736:0:30531:0:(genops.c:885:class_export_put()) final put ffff99fffc79a000/ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5 00000020:00000080:1.0:1789518483.354739:0:30531:0:(genops.c:844:class_export_destroy()) destroying export ffff99fffc79a000/ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5 for MGC192.168.206.151@tcp 00000020:01000000:1.0:1789518483.354746:0:30531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.151@tcp (ea9d50e2-48d5-4f68-9d4f-bdffe9c941f5) 00000020:01000000:1.0:1789518483.355065:0:30531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789518483.355081:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518483.355085:0:30531:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789518483.355090:0:30531:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99fec1f32000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789518483.355096:0:30531:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff99ffc6510000) has exports, disconnecting them 00000020:00080000:1.0:1789518483.355101:0:30531:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99fec1f32000), last request at 1789518433 00000020:00000080:1.0:1789518483.355106:0:30531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7840ce 00000020:00080000:1.0:1789518483.355118:0:30531:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fec1f32000): rc 0 00000020:00000080:1.0:1789518483.355122:0:30531:0:(genops.c:885:class_export_put()) final put ffff99fec1f32000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789518483.355185:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec1f32000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789518483.357674:0:30531:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789518483.357683:0:30531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518483.357688:0:30531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789518483.357697:0:30531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518483.357733:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec1f34800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789518483.357885:0:27600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789518483.358145:0:29484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789518483.358337:0:27601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789518483.358531:0:28321:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff99fec1cdd200:28321] 2 exiting: rc = 0 00000100:00100000:2.0:1789518483.358659:0:27595:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99fec1b6ee00:27595] 0 exiting: rc = 1 00000100:00100000:3.0:1789518483.360498:0:27596:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99fec1b6ec00:27596] 1 exiting: rc = 0 00000100:00100000:0.0:1789518483.360643:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.361009:0:27597:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99fec1b6e000:27597] 0 exiting: rc = 1 00000100:00100000:0.0:1789518483.361089:0:27599:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99fec1b6fc00:27599] 2 exiting: rc = 0 00000100:00100000:2.0:1789518483.361210:0:27598:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99fec1b6fa00:27598] 1 exiting: rc = 0 00000100:00100000:3.0:1789518483.361345:0:29722:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99fec242e800:29722] 3 exiting: rc = 0 00000100:00100000:0.0:1789518483.361945:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.361957:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.361967:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.361974:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.361986:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.361999:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362005:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362011:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362018:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362023:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362030:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362036:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362049:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362054:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362079:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362085:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362090:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362095:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362101:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362106:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362112:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362117:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362123:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362128:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362133:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362139:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362146:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362152:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362159:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362166:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362173:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362179:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362185:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362191:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362198:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362211:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362218:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362224:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362336:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362345:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362350:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362357:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362363:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362368:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362373:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362379:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362384:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362390:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362396:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362412:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362419:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362426:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362433:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362438:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362444:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362894:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362901:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362906:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362913:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362918:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362924:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362930:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362935:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.362940:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789518483.364075:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518483.364088:0:30531:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789518483.364096:0:30531:0:(genops.c:885:class_export_put()) final put ffff99fec1f30000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789518483.364101:0:30531:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec1f30000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789518483.364107:0:30531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789518483.364167:0:30531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffed824800 1 00000020:00000080:0.0:1789518483.364175:0:30531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784088 00000020:00000080:0.0:1789518483.364183:0:30531:0:(genops.c:885:class_export_put()) final put ffff99ffed826800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789518483.364210:0:30531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789518483.364216:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518483.364222:0:30531:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518483.364227:0:30531:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99ffc6513380) has no exports 00000020:00000080:2.0:1789518483.364765:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed826800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789518483.387712:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518483.387729:0:30531:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789518483.387735:0:30531:0:(genops.c:885:class_export_put()) final put ffff99ffed827000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789518483.387740:0:30531:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed827000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789518483.387751:0:30531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789518483.388063:0:30531:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffed820800 00000020:01000000:0.0:1789518483.388106:0:30531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789518483.388111:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518483.388115:0:30531:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518483.388119:0:30531:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff99fec2aa19c0) has no exports 00000020:00000080:0.0:1789518483.388146:0:30531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518483.388154:0:30531:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789518483.388157:0:30531:0:(genops.c:885:class_export_put()) final put ffff99ffedb7e800/OSS_uuid 00000020:00000080:0.0:1789518483.388159:0:30531:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffedb7e800/OSS_uuid for OSS 00000020:01000000:0.0:1789518483.388163:0:30531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789518483.388270:0:29734:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff99fec11a7800:29734] 4 exiting: rc = 0 00000100:00080000:2.0:1789518483.388315:0:27608:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789518483.388377:0:28298:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff99ffc4fcd800:28298] 2 exiting: rc = 0 00000100:00100000:2.0:1789518483.388423:0:28515:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff99ffd81ce200:28515] 3 exiting: rc = 0 00000100:00100000:3.0:1789518483.388675:0:28297:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff99ffc4fcd400:28297] 1 exiting: rc = 0 00000100:00100000:3.0:1789518483.388747:0:28295:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff99fff5aee200:28295] 0 exiting: rc = 1 00000100:00100000:0.0:1789518483.388810:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388818:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388826:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388833:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388839:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388842:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388845:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388849:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388852:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388855:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388859:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388863:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388869:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388873:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388877:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388882:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388887:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388891:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388903:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388909:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388915:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388926:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388931:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388942:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388960:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388965:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388970:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388974:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388979:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388983:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388988:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.388992:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389001:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389010:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389018:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389032:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389040:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389049:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389057:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389067:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389078:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389089:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389100:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389109:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389118:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389126:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389136:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389146:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389154:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389163:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389175:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389183:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389193:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389204:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389213:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389225:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389235:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389245:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389256:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389275:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389296:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389307:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389317:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.389327:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518483.390822:0:29940:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99fec3ab3800:29940] 2 exiting: rc = 0 00000100:00100000:3.0:1789518483.390928:0:28300:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99fffc2ecc00:28300] 1 exiting: rc = 0 00000100:00100000:3.0:1789518483.391081:0:28299:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99fff7aba400:28299] 0 exiting: rc = 1 00000100:00100000:0.0:1789518483.391184:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391195:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391204:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391212:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391233:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391243:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391253:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391262:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391270:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391277:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391295:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391300:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391306:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391310:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391316:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391321:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391326:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391333:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391342:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391351:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391359:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391368:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391377:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391385:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391394:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391403:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391414:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391422:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391431:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391440:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391458:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391466:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391474:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391485:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391494:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391503:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391509:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391518:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391528:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391539:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391546:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391555:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391564:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391571:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391579:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391584:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391589:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391594:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391599:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.391606:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392532:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392548:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392555:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392560:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392565:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392570:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392575:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392580:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392585:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392589:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392594:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392598:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392603:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.392607:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518483.393652:0:28301:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99ffc6aeee00:28301] 0 exiting: rc = 1 00000100:00100000:2.0:1789518483.394093:0:28303:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99fff4026a00:28303] 2 exiting: rc = 0 00000100:00100000:3.0:1789518483.394117:0:28302:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99ffc6aee400:28302] 1 exiting: rc = 0 00000100:00100000:0.0:1789518483.394308:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394323:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394336:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394343:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394350:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394355:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394362:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394368:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394374:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394380:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394386:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394392:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394398:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394404:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394410:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394827:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394899:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394908:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394914:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394920:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394926:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394991:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.394997:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395002:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395007:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395013:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395018:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395039:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395046:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395051:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395057:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395062:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395067:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395073:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395080:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395089:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395107:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395114:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395121:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395126:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395132:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395139:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395146:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395152:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395158:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395163:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395168:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395173:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395179:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395184:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395189:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395195:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395201:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395215:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395234:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395241:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395248:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395254:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395260:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395265:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395271:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395277:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395293:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.395307:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518483.400044:0:28304:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99fec26dc600:28304] 0 exiting: rc = 1 00000100:00100000:1.0:1789518483.400066:0:28305:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99fec26dd200:28305] 1 exiting: rc = 0 00000100:00100000:0.0:1789518483.400163:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400170:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400175:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400180:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400185:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400191:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400202:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400220:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400225:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400231:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400236:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400241:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400246:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400251:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400255:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400260:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400265:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400269:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400274:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400278:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400293:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400299:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400304:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400309:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400313:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400318:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400322:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400327:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400332:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400336:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400341:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400345:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400350:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400354:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400359:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400363:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400367:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400373:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400378:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400382:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400387:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400391:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400402:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400406:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400412:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400426:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400431:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400436:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400441:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400446:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400451:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400455:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400460:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400465:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400469:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400474:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400478:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400482:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400487:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400492:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400496:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400501:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400506:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.400510:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518483.401376:0:28306:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99fec26dda00:28306] 0 exiting: rc = 1 00000100:00100000:1.0:1789518483.401450:0:28307:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99fec26dd400:28307] 1 exiting: rc = 0 00000100:00100000:0.0:1789518483.401572:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401583:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401590:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401595:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401601:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401607:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401752:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401759:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401764:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401769:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401788:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401793:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401798:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401810:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401815:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401820:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401825:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401831:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401847:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401852:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401857:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401862:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401879:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401885:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401891:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401895:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401901:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401906:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401911:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401917:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401922:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401926:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401938:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401944:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401961:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401966:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401972:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401978:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401983:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401988:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401994:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.401999:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402004:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402011:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402016:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402023:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402046:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402054:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402066:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402072:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402079:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402084:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402103:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402112:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402117:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402122:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402127:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402132:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402344:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402352:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402357:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402362:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402368:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518483.402383:0:30531:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789518483.411428:0:30531:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789518493.354385:0:31144:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789518497.945119:0:31606:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789518497.945132:0:31606:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789518497.945261:0:31606:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffe6225800 00000020:01000004:3.0:1789518497.945277:0:31606:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789518497.945285:0:31606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789518497.945298:0:31606:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99ffc6514d40) 00000020:00000080:3.0:1789518497.945311:0:31606:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789518497.956699:0:31606:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789518497.958291:0:31606:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x39:0x0] (8/32) 00100000:10000000:3.0:1789518497.958737:0:31606:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789518497.958803:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:3.0:1789518497.958936:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1789518497.959024:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1789518497.959114:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:3.0:1789518497.959204:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:3.0:1789518497.959313:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1789518497.959536:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:3.0:1789518497.960689:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 390: rc = 0 00100000:10000000:3.0:1789518497.960789:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 390: rc = 0 00100000:10000000:3.0:1789518497.961235:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 398: rc = 0 00100000:10000000:3.0:1789518497.961480:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 398: rc = 0 00100000:10000000:3.0:1789518497.961750:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 398: rc = 0 00100000:10000000:3.0:1789518497.961996:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 398: rc = 0 00100000:10000000:3.0:1789518497.962263:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 398: rc = 0 00100000:10000000:3.0:1789518497.962509:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 398: rc = 0 00100000:10000000:3.0:1789518497.962908:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 398: rc = 0 00100000:10000000:3.0:1789518497.963154:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 398: rc = 0 00100000:10000000:3.0:1789518497.963416:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 398: rc = 0 00100000:10000000:3.0:1789518497.963818:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 398: rc = 0 00100000:10000000:3.0:1789518497.964089:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 398: rc = 0 00100000:10000000:3.0:1789518497.964349:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 398: rc = 0 00100000:10000000:3.0:1789518497.964779:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 166: rc = 0 00100000:10000000:3.0:1789518497.965041:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 166: rc = 0 00100000:10000000:3.0:1789518497.965283:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 166: rc = 0 00100000:10000000:3.0:1789518497.965522:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 166: rc = 0 00100000:10000000:3.0:1789518497.965791:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 166: rc = 0 00100000:10000000:3.0:1789518497.966038:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 166: rc = 0 00100000:10000000:3.0:1789518497.966297:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 166: rc = 0 00100000:10000000:3.0:1789518497.966548:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 166: rc = 0 00100000:10000000:3.0:1789518497.966811:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 166: rc = 0 00100000:10000000:3.0:1789518497.967061:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 166: rc = 0 00100000:10000000:3.0:1789518497.967290:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 166: rc = 0 00100000:10000000:3.0:1789518497.967523:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 166: rc = 0 00100000:10000000:3.0:1789518497.967940:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 166: rc = 0 00100000:10000000:3.0:1789518497.968225:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 166: rc = 0 00100000:10000000:3.0:1789518497.968471:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 166: rc = 0 00100000:10000000:3.0:1789518497.968741:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 166: rc = 0 00100000:10000000:3.0:1789518497.968977:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 166: rc = 0 00100000:10000000:3.0:1789518497.969258:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 166: rc = 0 00100000:10000000:3.0:1789518497.969501:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 166: rc = 0 00100000:10000000:3.0:1789518497.969773:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 166: rc = 0 00100000:10000000:3.0:1789518497.970021:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 166: rc = 0 00100000:10000000:3.0:1789518497.970290:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 166: rc = 0 00100000:10000000:3.0:1789518497.970545:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 166: rc = 0 00100000:10000000:3.0:1789518497.970830:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 166: rc = 0 00100000:10000000:3.0:1789518497.971071:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 166: rc = 0 00100000:10000000:3.0:1789518497.971337:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 166: rc = 0 00100000:10000000:3.0:1789518497.971576:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 166: rc = 0 00100000:10000000:3.0:1789518497.971989:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 166: rc = 0 00100000:10000000:3.0:1789518497.972248:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 166: rc = 0 00100000:10000000:3.0:1789518497.975496:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 166: rc = 0 00100000:10000000:3.0:1789518497.975791:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 166: rc = 0 00100000:10000000:3.0:1789518497.976026:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 166: rc = 0 00100000:10000000:3.0:1789518497.976442:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 155: rc = 0 00100000:10000000:3.0:1789518497.976933:0:31606:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789518497.977155:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 391: rc = 0 00100000:10000000:3.0:1789518497.977346:0:31606:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789518497.977416:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 391: rc = 0 00100000:10000000:3.0:1789518497.978484:0:31606:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789518497.978560:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 391: rc = 0 00100000:10000000:3.0:1789518497.978947:0:31606:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789518497.979018:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 395: rc = 0 00100000:10000000:3.0:1789518497.979196:0:31606:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789518497.979278:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 395: rc = 0 00100000:10000000:3.0:1789518497.979443:0:31606:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789518497.979511:0:31606:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 395: rc = 0 00000020:00000080:3.0:1789518497.979848:0:31606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789518497.979856:0:31606:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789518497.979865:0:31606:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c784527 00000020:01000004:3.0:1789518497.979872:0:31606:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789518497.979877:0:31606:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789518497.979882:0:31606:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffe6225800 from MGS 00000020:01000004:3.0:1789518497.979892:0:31606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789518497.979901:0:31606:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99ffc6513380) 00000020:00000080:3.0:1789518497.979911:0:31606:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789518497.979958:0:31606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffe6225800 from MGS, refs=2 00080000:01000000:3.0:1789518497.979963:0:31606:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789518497.979967:0:31606:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c784535 00000100:00100000:3.0:1789518497.980058:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789518497.980172:0:31606:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789518497.980177:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789518497.980542:0:31606:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789518497.980548:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789518497.981197:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518497.981356:0:31606:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789518497.981361:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789518497.981873:0:31606:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789518497.981878:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789518497.982091:0:31606:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789518497.982095:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789518497.983173:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518497.983176:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518497.983178:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518497.983469:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518497.983472:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518497.983473:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518497.984135:0:31606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789518497.985879:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789518497.993968:0:31606:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789518497.993985:0:31606:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789518497.993989:0:31606:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789518497.995576:0:31615:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789518497.995810:0:31606:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789518497.995914:0:31606:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789518497.996527:0:31606:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789518497.996943:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518497.997149:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789518497.997157:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789518498.001632:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789518498.001644:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789518498.002311:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789518498.002318:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789518498.003024:0:31606:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789518498.003042:0:31606:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.151@tcp' 00000020:01000004:3.0:1789518498.003044:0:31606:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789518498.003070:0:31606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.151@tcp (typ=mgc) 00000020:00000080:3.0:1789518498.003081:0:31606:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.151@tcp (ffff99ffc6510000) 00000020:00000080:3.0:1789518498.003096:0:31606:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789518498.003161:0:31606:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffff380000@MGC192.168.206.151@tcp: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518498.003319:0:31606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.151@tcp-0 is initialized 00000040:01000000:3.0:1789518498.003325:0:31606:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789518498.003527:0:31620:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789518498.003760:0:31621:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789518498.003814:0:31606:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.151@tcp (uuid 6f013254-1301-45d1-9493-6d558799b39e) 00000020:00000080:3.0:1789518498.003828:0:31606:0:(genops.c:1384:class_connect()) connect: client 6f013254-1301-45d1-9493-6d558799b39e, cookie 0x631fd8698c784543 00000100:00080000:3.0:1789518498.003837:0:31606:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518498.003844:0:31606:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99ffff380000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518498.003869:0:31606:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffff664e00 x1876445627591936/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518498.003900:0:31606:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6f013254-1301-45d1-9493-6d558799b39e->MGS 00000100:00100000:0.0:1789518498.003971:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f013254-1301-45d1-9493-6d558799b39e:3279:1876445627591936:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789518498.004029:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.004090:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627591936 00000100:00100000:0.0:1789518498.004096:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627591936 00000100:00100000:0.0:1789518498.004123:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518498.004130:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3279:x1876445627591936:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789518498.004149:0:31616:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6f013254-1301-45d1-9493-6d558799b39e@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:0.0:1789518498.004169:0:31616:0:(genops.c:1384:class_connect()) connect: client 6f013254-1301-45d1-9493-6d558799b39e, cookie 0x631fd8698c78454a 00000100:00080000:0.0:1789518498.004299:0:31616:0:(import.c:65:import_set_state_nolock()) ffff99fec2afa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518498.004350:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+5:3279:x1876445627591936:12345-0@lo:250:mount.lustre.0 Request processed in 218us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518498.004358:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518498.004403:0:3279:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789518498.004412:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1789518498.004419:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789518498.004429:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789518498.004433:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffff380000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789518498.004436:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789518498.004444:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789518498.004452:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f013254-1301-45d1-9493-6d558799b39e:3279:1876445627591936:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1789518498.004506:0:31606:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789518498.004511:0:31606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789518498.004522:0:31606:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99ffc65119c0) 00000020:00000080:3.0:1789518498.004533:0:31606:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789518498.014794:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518498.015568:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789518498.015574:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789518498.016746:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789518498.016754:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789518498.017185:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789518498.017192:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789518498.017973:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518498.018126:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789518498.018131:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789518498.018739:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789518498.018746:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789518498.048763:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518498.048955:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789518498.048961:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789518498.050294:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789518498.050304:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789518498.050893:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518498.051056:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518498.051062:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789518498.054493:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789518498.054508:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789518498.056259:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518498.056416:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518498.056422:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789518498.057307:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789518498.057314:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789518498.058677:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518498.058851:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789518498.058857:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789518498.059449:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789518498.059456:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789518498.075229:0:31606:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518498.075478:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789518498.075485:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789518498.076915:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789518498.076927:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789518498.077949:0:31606:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789518498.077958:0:31606:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789518498.078862:0:31606:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789518498.078884:0:31606:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789518498.078889:0:31606:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789518498.079005:0:31606:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789518498.079043:0:31606:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789518498.079047:0:31606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789518498.079052:0:31606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789518498.079053:0:31606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518498.079055:0:31606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518498.079056:0:31606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518498.079057:0:31606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518498.079058:0:31606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789518498.079059:0:31606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789518498.079061:0:31606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518498.079062:0:31606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518498.079064:0:31606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789518498.079066:0:31606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789518498.079067:0:31606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789518498.079068:0:31606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518498.079069:0:31606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518498.079070:0:31606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518498.079071:0:31606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518498.079072:0:31606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789518498.079073:0:31606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789518498.079074:0:31606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518498.079075:0:31606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518498.079096:0:31606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789518498.079113:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592064:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789518498.079172:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518498.079266:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe0084240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518498.079407:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627592064 00000100:00100000:1.0:1789518498.079415:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627592064 00000100:00100000:1.0:1789518498.079491:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518498.079501:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+5:31606:x1876445627592064:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518498.079543:0:31619:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789518498.079546:0:31619:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789518498.079549:0:31619:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789518498.079927:0:31640:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789518498.080237:0:31619:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 17 20000000:01000000:3.0:1789518498.081181:0:31641:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789518498.081186:0:31641:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789518498.081188:0:31641:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789518498.081240:0:31641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789518498.081902:0:31619:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789518498.081912:0:31619:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789518498.088963:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+5:31606:x1876445627592064:12345-0@lo:253:mount.lustre.0 Request processed in 9455us (9781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518498.088977:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518498.089066:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592064:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789518498.089080:0:31606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789518498.089083:0:31606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518498.089085:0:31606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789518498.089087:0:31606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518498.089088:0:31606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518498.089089:0:31606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518498.089102:0:31606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518498.089104:0:31606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789518498.089105:0:31606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789518498.089106:0:31606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518498.089108:0:31606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789518498.089123:0:31606:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffe6225800 from lustre-MDT0000 10000000:01000000:3.0:1789518498.089145:0:31606:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789518498.089148:0:31606:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789518498.089152:0:31606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99ffc6510000 10000000:01000000:3.0:1789518498.089157:0:31606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518498.089165:0:31606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ffc6510000 from 1 10000000:01000000:3.0:1789518498.089167:0:31606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789518498.089200:0:31606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.089226:0:31606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.089236:0:31606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518498.089255:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518498.089287:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518498.089324:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518498.089370:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627592192 00000100:00100000:1.0:1789518498.089376:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627592192 00000100:00100000:1.0:1789518498.089414:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518498.089422:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+5:31606:x1876445627592192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518498.089434:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518498.089445:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b45e00/0x631fd8698c78455f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784558 expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518498.089465:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b45e00/0x631fd8698c78455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784558 expref: 6 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518498.089475:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b45e00/0x631fd8698c78455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784558 expref: 6 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518498.089483:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b45e00, rc 0) 00000100:00100000:1.0:1789518498.089518:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+6:31606:x1876445627592192:12345-0@lo:101:mount.lustre.0 Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518498.089524:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518498.089579:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518498.089591:0:31606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.089600:0:31606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518498.089668:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518498.089697:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518498.089715:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518498.089776:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627592320 00000100:00100000:1.0:1789518498.089780:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627592320 00000100:00100000:1.0:1789518498.089814:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518498.089820:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+6:31606:x1876445627592320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518498.090012:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+6:31606:x1876445627592320:12345-0@lo:501:mount.lustre.0 Request processed in 191us (314us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518498.090020:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518498.090055:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592320:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789518498.090080:0:31606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789518498.090098:0:31606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.090106:0:31606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518498.090113:0:31606:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffe6225800 10000000:01000000:0.0:1789518498.090117:0:31606:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789518498.090121:0:31606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ffe6225800 10000000:01000000:0.0:1789518498.090124:0:31606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789518498.090127:0:31606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99ffe6225800 from 1 10000000:01000000:0.0:1789518498.090358:0:31606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789518498.090378:0:31606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.090385:0:31606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.090393:0:31606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518498.090405:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518498.090443:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.090469:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd07603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518498.090529:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627592448 00000100:00100000:1.0:1789518498.090534:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627592448 00000100:00100000:1.0:1789518498.090567:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518498.090574:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+6:31606:x1876445627592448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518498.090583:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518498.090593:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b44a00/0x631fd8698c78456d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784566 expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518498.090661:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b44a00/0x631fd8698c78456d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784566 expref: 7 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518498.090672:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b44a00/0x631fd8698c78456d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784566 expref: 7 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518498.090679:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44a00, rc 0) 00000100:00100000:1.0:1789518498.090707:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+7:31606:x1876445627592448:12345-0@lo:101:mount.lustre.0 Request processed in 134us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518498.090713:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518498.090792:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518498.090803:0:31606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.090811:0:31606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518498.090821:0:31606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789518498.090835:0:31606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.090843:0:31606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518498.090849:0:31606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789518498.090853:0:31606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789518498.090857:0:31606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ffe6225800 10000000:01000000:0.0:1789518498.090860:0:31606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789518498.090862:0:31606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789518498.090864:0:31606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789518498.090877:0:31606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.090883:0:31606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.090889:0:31606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518498.090908:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518498.090933:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.090963:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd07603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.091015:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627592576 00000100:00100000:2.0:1789518498.091020:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627592576 00000100:00100000:2.0:1789518498.091073:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518498.091080:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+7:31606:x1876445627592576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518498.091087:0:31616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518498.091095:0:31616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c78457b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784574 expref: -99 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.091109:0:31616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c78457b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784574 expref: 8 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.091116:0:31616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c78457b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784574 expref: 8 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.091123:0:31616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:2.0:1789518498.091157:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+8:31606:x1876445627592576:12345-0@lo:101:mount.lustre.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.091162:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518498.091240:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518498.091252:0:31606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.091260:0:31606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518498.091304:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518498.091331:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.091353:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd07603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518498.091533:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627592704 00000100:00100000:1.0:1789518498.091538:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627592704 00000100:00100000:1.0:1789518498.091564:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518498.091572:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+8:31606:x1876445627592704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518498.091891:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+9:31606:x1876445627592704:12345-0@lo:501:mount.lustre.0 Request processed in 320us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518498.091905:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518498.091978:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518498.092008:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518498.092046:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.092129:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd07603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.092166:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627592832 00000100:00100000:2.0:1789518498.092171:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627592832 00000100:00100000:2.0:1789518498.093673:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518498.093684:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+9:31606:x1876445627592832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518498.094056:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+9:31606:x1876445627592832:12345-0@lo:503:mount.lustre.0 Request processed in 374us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.094064:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518498.094168:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627592832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518498.094728:0:31642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31642:1876445627592960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518498.094768:0:31642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.094805:0:31642:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518498.094859:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627592960 00000100:00100000:1.0:1789518498.094865:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627592960 00000100:00100000:1.0:1789518498.094895:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518498.094902:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+9:31642:x1876445627592960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518498.095150:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+9:31642:x1876445627592960:12345-0@lo:502:llog_process_th.0 Request processed in 247us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518498.095156:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518498.095225:0:31642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31642:1876445627592960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518498.095245:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518498.095256:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.095258:0:31642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789518498.095263:0:31642:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789518498.095265:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518498.095278:0:31642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99fffee2cd40) 00000020:00000080:0.0:1789518498.095296:0:31642:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789518498.095302:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789518498.095360:0:31642:0:(osd_handler.c:1614:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789518498.095366:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c784589 00000020:00000080:0.0:1789518498.095685:0:31642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789518498.095689:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518498.095692:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.095693:0:31642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789518498.095694:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518498.095697:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.095698:0:31642:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789518498.095700:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518498.095705:0:31642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99fffee28000) 00000020:00000080:0.0:1789518498.095712:0:31642:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789518498.095714:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789518498.095715:0:31642:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789518498.095717:0:31642:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789518498.095721:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789518498.095747:0:31642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffe6225800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789518498.095754:0:31642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99fffee2b380) 00000020:00000080:0.0:1789518498.095758:0:31642:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789518498.095788:0:31642:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789518498.095791:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c78459e 00000020:00000080:0.0:1789518498.098827:0:31642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789518498.098846:0:31642:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789518498.098857:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x631fd8698c7845a5 00080000:01000000:0.0:1789518498.098866:0:31642:0:(osd_handler.c:1614:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789518498.098873:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c7845ac 00010000:00010000:1.0:1789518498.137576:0:31642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789518498.138288:0:31642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 21474836515 00000001:00080000:1.0:1789518498.138449:0:31642:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789518498.138954:0:31642:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99ffee064d40) 00000020:00000080:1.0:1789518498.138972:0:31642:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789518498.139030:0:31642:0:(osd_handler.c:1614:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789518498.139036:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c7845ba 00000020:00000080:1.0:1789518498.140668:0:31642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789518498.143681:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x631fd8698c7845c1 00000020:00000080:1.0:1789518498.143931:0:31642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789518498.143942:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518498.143948:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518498.143951:0:31642:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789518498.143954:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518498.143958:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518498.143960:0:31642:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789518498.143963:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789518498.143993:0:31642:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789518498.144004:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518498.144007:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518498.144013:0:31642:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789518498.144016:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789518498.144018:0:31642:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1789518498.144020:0:31642:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518498.144021:0:31642:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789518498.144023:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789518498.144026:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518498.144027:0:31642:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789518498.144029:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789518498.144032:0:31642:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789518498.144035:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518498.144036:0:31642:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789518498.144038:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789518498.144043:0:31642:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1789518498.144068:0:31642:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789518498.144071:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789518498.144084:0:31642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99ffee063380) 00000020:00000080:1.0:1789518498.144097:0:31642:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789518498.144101:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789518498.144156:0:31642:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789518498.144161:0:31642:0:(osd_handler.c:1614:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789518498.144165:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c7845cf 00010000:00080000:1.0:1789518498.144193:0:31642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffc2c1b800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1789518498.144395:0:31642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789518498.144737:0:31642:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789518498.144780:0:31642:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789518498.145690:0:31642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518498.145749:0:31642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].6, 64 off8576 00000040:00080000:1.0:1789518498.145817:0:31642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].1, 64 off8256 00000040:00080000:1.0:1789518498.146102:0:31646:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1789518498.146107:0:31646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x22:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789518498.146432:0:31642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518498.146453:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789518498.146494:0:31642:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789518498.146512:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c7845d6 00000100:00080000:0.0:1789518498.146520:0:31642:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518498.146531:0:31642:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffc2c1b800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518498.146562:0:31642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff78a8380 x1876445627593088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518498.146590:0:31642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789518498.146658:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518498.146662:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.146664:0:31642:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789518498.146666:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789518498.146669:0:31642:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1789518498.146670:0:31642:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518498.146672:0:31642:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518498.146673:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789518498.146675:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.146677:0:31642:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789518498.146679:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518498.146683:0:31642:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789518498.146686:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.146687:0:31642:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789518498.146690:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789518498.146694:0:31642:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:0.0:1789518498.146720:0:31642:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789518498.146723:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518498.146734:0:31642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99fffee299c0) 00000020:00000080:0.0:1789518498.146744:0:31642:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789518498.146749:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1789518498.146793:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627593088:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1789518498.146798:0:31642:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789518498.146802:0:31642:0:(osd_handler.c:1614:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789518498.146810:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c7845e4 00010000:00080000:0.0:1789518498.146834:0:31642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffc4f46800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00000400:00000100:1.0:1789518498.146850:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627593088 offset 0 length 520: 4 00010000:00010000:0.0:1789518498.147008:0:31642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789518498.147144:0:31642:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789518498.147161:0:31642:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789518498.147584:0:31642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518498.148190:0:31642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].6, 64 off8576 00000040:00080000:0.0:1789518498.148313:0:31642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].1, 64 off8256 00000040:00080000:0.0:1789518498.149033:0:31648:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1789518498.149038:0:31648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789518498.149855:0:31642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518498.149866:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789518498.149895:0:31642:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789518498.149916:0:31642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c7845eb 00000100:00080000:0.0:1789518498.149924:0:31642:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518498.149933:0:31642:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffc4f46800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518498.149957:0:31642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff78ab800 x1876445627593216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518498.150001:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627593216:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789518498.150042:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627593216 offset 0 length 520: 4 00000100:00080000:0.0:1789518498.150090:0:31642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789518498.150183:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518498.150187:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.150189:0:31642:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789518498.150191:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518498.150195:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.150197:0:31642:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789518498.150199:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789518498.150201:0:31642:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789518498.150203:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518498.150205:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.150207:0:31642:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789518498.150223:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518498.150232:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.150233:0:31642:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789518498.150237:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789518498.150264:0:31642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31642:1876445627593344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518498.150306:0:31642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.150401:0:31642:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc76c4900 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.151466:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627593344 00000100:00100000:2.0:1789518498.151474:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627593344 00000100:00100000:2.0:1789518498.151511:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518498.151519:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+9:31642:x1876445627593344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518498.152052:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+9:31642:x1876445627593344:12345-0@lo:502:llog_process_th.0 Request processed in 533us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.152059:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789518498.152125:0:31642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31642:1876445627593344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518498.152155:0:31642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518498.152160:0:31642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.152162:0:31642:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789518498.152165:0:31642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789518498.152324:0:31606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789518498.152351:0:31606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789518498.152394:0:31606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.152405:0:31606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518498.152413:0:31606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffe6225800 from 1 10000000:01000000:3.0:1789518498.152416:0:31606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518498.152444:0:31606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.152453:0:31606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.152462:0:31606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518498.152480:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518498.152513:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518498.152584:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627593472 00000100:00100000:3.0:1789518498.152588:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4047780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518498.152589:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627593472 00000100:00100000:3.0:1789518498.152750:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518498.152759:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+9:31606:x1876445627593472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518498.152768:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518498.152781:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7845f2 expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.152815:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7845f2 expref: 10 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.152825:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7845f2 expref: 10 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.152833:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:3.0:1789518498.152913:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+10:31606:x1876445627593472:12345-0@lo:101:mount.lustre.0 Request processed in 155us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518498.152920:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518498.152969:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518498.152978:0:31606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.152984:0:31606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518498.153510:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593600:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789518498.153546:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.153639:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd9167d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.153719:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627593600 00000100:00100000:2.0:1789518498.153724:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627593600 00000100:00100000:2.0:1789518498.153751:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518498.153757:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+10:31606:x1876445627593600:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789518498.153770:0:31616:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789518498.153775:0:31616:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789518498.153933:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+10:31606:x1876445627593600:12345-0@lo:256:mount.lustre.0 Request processed in 175us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.153941:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518498.153987:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593600:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789518498.154534:0:31606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789518498.154597:0:31606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.154607:0:31606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518498.154695:0:31606:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffe6225800 from 1 10000000:01000000:0.0:1789518498.154697:0:31606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518498.154718:0:31606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.154726:0:31606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.154734:0:31606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518498.154745:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518498.154768:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.154790:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd9167d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518498.154806:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627593728 00000100:00100000:3.0:1789518498.154811:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627593728 00000100:00100000:3.0:1789518498.154848:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518498.154856:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+10:31606:x1876445627593728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518498.154865:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518498.154875:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784600 expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.154892:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784600 expref: 11 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.154901:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784600 expref: 11 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518498.154909:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:3.0:1789518498.154949:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+11:31606:x1876445627593728:12345-0@lo:101:mount.lustre.0 Request processed in 94us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518498.154955:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518498.155007:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518498.155030:0:31606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.155038:0:31606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518498.155080:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518498.155117:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.155137:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd9167d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.155157:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627593856 00000100:00100000:2.0:1789518498.155161:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627593856 00000100:00100000:2.0:1789518498.155194:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518498.155201:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+11:31606:x1876445627593856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518498.155574:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+11:31606:x1876445627593856:12345-0@lo:501:mount.lustre.0 Request processed in 373us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.155581:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518498.155762:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518498.155790:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518498.155826:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.155858:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd9167d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518498.156043:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627593984 00000100:00100000:3.0:1789518498.156049:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627593984 00000100:00100000:3.0:1789518498.156240:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518498.156248:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+11:31606:x1876445627593984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518498.156537:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+11:31606:x1876445627593984:12345-0@lo:503:mount.lustre.0 Request processed in 289us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518498.156545:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518498.156657:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627593984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518498.157369:0:31650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31650:1876445627594112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518498.157481:0:31650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518498.157511:0:31650:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd199a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.157528:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627594112 00000100:00100000:2.0:1789518498.157534:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627594112 00000100:00100000:2.0:1789518498.157577:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518498.157585:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+11:31650:x1876445627594112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518498.157822:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+11:31650:x1876445627594112:12345-0@lo:502:llog_process_th.0 Request processed in 227us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.157832:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518498.158030:0:31650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31650:1876445627594112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518498.158054:0:31650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518498.158063:0:31650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518498.158065:0:31650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789518498.158129:0:31650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffe6225800 00000020:00000080:3.0:1789518498.158132:0:31650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518498.158139:0:31650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518498.158142:0:31650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518498.158143:0:31650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789518498.158145:0:31650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518498.158148:0:31650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518498.158149:0:31650:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789518498.158152:0:31650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffe6225800 00000020:00000080:3.0:1789518498.158154:0:31650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518498.158223:0:31650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518498.158228:0:31650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518498.158229:0:31650:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789518498.158231:0:31650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518498.158234:0:31650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518498.158235:0:31650:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518498.158246:0:31650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffe6225800 00000020:00000080:3.0:1789518498.158248:0:31650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789518498.158359:0:31650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31650:1876445627594240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518498.163983:0:31650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518498.164040:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627594240 00000100:00100000:3.0:1789518498.164048:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627594240 00000100:00100000:3.0:1789518498.164091:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518498.164099:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+11:31650:x1876445627594240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518498.164697:0:31650:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd199a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518498.164812:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+11:31650:x1876445627594240:12345-0@lo:502:llog_process_th.0 Request processed in 712us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518498.164821:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518498.164969:0:31650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31650:1876445627594240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518498.165001:0:31650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518498.165009:0:31650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518498.165012:0:31650:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789518498.165016:0:31650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789518498.165070:0:31606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789518498.165088:0:31606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518498.165102:0:31606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.165113:0:31606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518498.165150:0:31606:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789518498.165153:0:31606:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffe6225800 10000000:01000000:0.0:1789518498.165156:0:31606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffe6225800 10000000:01000000:0.0:1789518498.165160:0:31606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789518498.165166:0:31606:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffe6225800 from 1 10000000:01000000:0.0:1789518498.165168:0:31606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518498.165196:0:31606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.165205:0:31606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.165237:0:31606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518498.165255:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627594368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518498.165928:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518498.165958:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627594368 00000100:00100000:0.0:1789518498.165965:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.165966:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627594368 00000100:00100000:2.0:1789518498.166000:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518498.166007:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+11:31606:x1876445627594368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518498.166019:0:31616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518498.166030:0:31616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17400/0x631fd8698c784615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78460e expref: -99 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.166051:0:31616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17400/0x631fd8698c784615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78460e expref: 12 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.166061:0:31616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17400/0x631fd8698c784615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78460e expref: 12 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.166069:0:31616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:2.0:1789518498.166108:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+12:31606:x1876445627594368:12345-0@lo:101:mount.lustre.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.166114:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518498.167001:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627594368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518498.167018:0:31606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518498.167028:0:31606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518498.167079:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627594496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518498.167110:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518498.167136:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe0496840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518498.167179:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627594496 00000100:00100000:0.0:1789518498.167184:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627594496 00000100:00100000:0.0:1789518498.167227:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518498.167235:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31606:x1876445627594496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518498.167668:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31606:x1876445627594496:12345-0@lo:501:mount.lustre.0 Request processed in 432us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518498.167675:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789518498.167963:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627594496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518498.167992:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627594624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518498.168032:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518498.168062:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627594624 00000100:00100000:1.0:1789518498.168065:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe0496840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.168068:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627594624 00000100:00100000:2.0:1789518498.168351:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518498.168361:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+12:31606:x1876445627594624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518498.168554:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+12:31606:x1876445627594624:12345-0@lo:503:mount.lustre.0 Request processed in 195us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.168562:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518498.168767:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627594624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518498.175067:0:31654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31654:1876445627594752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518498.175139:0:31654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.175177:0:31654:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518498.175229:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627594752 00000100:00100000:0.0:1789518498.175236:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627594752 00000100:00100000:0.0:1789518498.175281:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789518498.175291:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31654:x1876445627594752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518498.176849:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31654:x1876445627594752:12345-0@lo:502:llog_process_th.0 Request processed in 1552us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518498.176861:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789518498.178593:0:31654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31654:1876445627594752:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789518498.178677:0:31654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789518498.178691:0:31654:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99ffd10fcd40) 00000020:00000080:0.0:1789518498.178710:0:31654:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789518498.178795:0:31654:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffe6225800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789518498.178801:0:31654:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffe6225800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789518498.178804:0:31654:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffe6225800 4 00010000:00080000:0.0:1789518498.178849:0:31654:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffed7ae000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1789518498.184007:0:31654:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789518498.184224:0:31654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789518498.184260:0:31654:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789518498.184272:0:31654:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x631fd8698c784623 00000100:00080000:0.0:1789518498.184282:0:31654:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789518498.184293:0:31654:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ffed7ae000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518498.184325:0:31654:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff78a8700 x1876445627594880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789518498.184349:0:31654:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789518498.184406:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627594880:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789518498.184468:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518498.184504:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627594880 00000100:00100000:2.0:1789518498.184512:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627594880 00000100:00100000:2.0:1789518498.184542:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518498.184550:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627594880:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789518498.184605:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627594880:12345-0@lo:38:llog_process_th.0 Request processed in 55us (137us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789518498.184611:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518498.185089:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518498.185098:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffed7ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518498.185103:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789518498.185108:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627594880:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789518498.185494:0:31654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31654:1876445627595008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518498.185539:0:31654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518498.185561:0:31654:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.186684:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627595008 00000100:00100000:2.0:1789518498.186693:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627595008 00000100:00100000:2.0:1789518498.186743:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789518498.186751:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+12:31654:x1876445627595008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518498.187943:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+12:31654:x1876445627595008:12345-0@lo:502:llog_process_th.0 Request processed in 1189us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.187952:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789518498.188394:0:31654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f013254-1301-45d1-9493-6d558799b39e:31654:1876445627595008:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789518498.188429:0:31654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789518498.188699:0:31606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789518498.188718:0:31606:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518498.188775:0:31606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518498.188787:0:31606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518498.188844:0:31606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518498.188846:0:31606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518498.188848:0:31606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518498.188850:0:31606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518498.188852:0:31606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518498.188853:0:31606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518498.188855:0:31606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518498.188857:0:31606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518498.188859:0:31606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518498.188861:0:31606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518498.188865:0:31606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789518498.188868:0:31606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518498.188869:0:31606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518498.188871:0:31606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518498.188872:0:31606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518498.188873:0:31606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518498.188874:0:31606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518498.188875:0:31606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518498.188877:0:31606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518498.188878:0:31606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518498.188879:0:31606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518498.188899:0:31606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789518498.188915:0:31606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627595136:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518498.188966:0:31606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518498.189006:0:31606:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.189040:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627595136 00000100:00100000:2.0:1789518498.189047:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627595136 00000100:00100000:2.0:1789518498.189199:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518498.189255:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31606:x1876445627595136:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789518498.189289:0:31619:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789518498.189303:0:31619:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789518498.231328:0:31619:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518498.231349:0:31619:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789518498.231419:0:31640:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789518498.231423:0:31640:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789518498.231444:0:31640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.231479:0:31640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7845f2 expref: 12 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.231487:0:31640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.231523:0:31640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c7845f2 expref: 12 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.231535:0:31640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c7845f2 expref: 12 pid: 31618 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518498.231548:0:31640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31640:1876445627595264:0@lo:104: 00000100:00100000:2.0:1789518498.231606:0:31640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518498.231668:0:31640:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffed593540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518498.231703:0:31607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627595264 00000100:00100000:2.0:1789518498.231710:0:31607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627595264 00000100:00100000:2.0:1789518498.231750:0:31607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518498.231758:0:31607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:31640:x1876445627595264:12345-0@lo:104: 00010000:00010000:2.0:1789518498.231783:0:31607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.231852:0:31607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518498.231859:0:31607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:31640:x1876445627595264:12345-0@lo:104: Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.231867:0:31607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789518498.231891:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518498.231897:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.231910:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518498.231914:0:31613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.231922:0:31613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518498.231926:0:31640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31640:1876445627595264:0@lo:104: 10000000:00010000:2.0:1789518498.231932:0:31613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518498.231938:0:31613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518498.231947:0:31640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.231966:0:31613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.231974:0:31613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518498.231995:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232002:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7845f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7845f9 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232020:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518498.232021:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518498.232023:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518498.232042:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518498.232051:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627595392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518498.232077:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518498.232125:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627595392 00000100:00100000:2.0:1789518498.232129:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627595392 00010000:00010000:2.0:1789518498.232147:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7845f2 expref: 13 pid: 31618 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518498.232167:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518498.232174:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f013254-1301-45d1-9493-6d558799b39e+13:3282:x1876445627595392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518498.232183:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518498.232187:0:31609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7845f2 expref: 13 pid: 31618 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232196:0:31609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7845f2 expref: 13 pid: 31618 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232207:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7845f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7845f2 expref: 13 pid: 31618 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232230:0:31609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232237:0:31609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789518498.232247:0:31609:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000824917s 00010000:00010000:2.0:1789518498.232251:0:31609:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232257:0:31609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232264:0:31609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232269:0:31609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232279:0:31609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518498.232283:0:31609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232290:0:31609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232304:0:31609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518498.232313:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518498.232320:0:31640:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.232330:0:31640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518498.232337:0:31640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78462a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518498.232345:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f013254-1301-45d1-9493-6d558799b39e+12:3282:x1876445627595392:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.232353:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518498.232377:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627595392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518498.243016:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+11:31606:x1876445627595136:12345-0@lo:253:mount.lustre.0 Request processed in 53797us (54038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518498.243031:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789518498.243258:0:31606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:31606:1876445627595136:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518498.243270:0:31606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789518498.243272:0:31606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518498.243273:0:31606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518498.243274:0:31606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518498.243275:0:31606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518498.243276:0:31606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518498.243277:0:31606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518498.243278:0:31606:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518498.243279:0:31606:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518498.243291:0:31606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518498.243292:0:31606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789518498.243303:0:31606:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789518498.252330:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789518498.252483:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789518498.252779:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789518498.252923:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789518498.253158:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789518498.253317:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518498.254551:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518498.254874:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518498.255159:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518498.255469:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518498.256406:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518498.256574:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789518498.278462:0:31606:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 17179869275 00000040:01000000:2.0:1789518498.278724:0:31606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789518498.278978:0:31663:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 17179869275 00000020:00080000:3.0:1789518498.278982:0:31663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869275 00000040:01000000:1.0:1789518498.279207:0:31664:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789518498.279280:0:31664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789518498.284947:0:31606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789518498.285077:0:31606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789518498.285604:0:31606:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:00080000:1.0:1789518498.285794:0:31664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789518498.285852:0:31664:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789518498.285857:0:31664:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789518498.285978:0:31606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789518498.286186:0:31606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789518498.287293:0:31606:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789518498.287891:0:31606:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789518498.287920:0:31606:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789518498.288309:0:31606:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 4, last_idx 5 00080000:10000000:2.0:1789518498.289222:0:31606:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3a:0x0] (8/8/4) registered 00000001:00000004:3.0:1789518498.293225:0:31606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803776 00000001:00080000:1.0:1789518498.317466:0:31606:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789518498.317499:0:31606:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa5084185b988 00100000:10000000:1.0:1789518498.317507:0:31606:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789518498.318428:0:31606:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789518498.318445:0:31606:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789518498.318456:0:31606:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789518498.318479:0:31606:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789518498.995907:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518499.187822:0:31656:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1789518499.187831:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518499.188195:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:2.0:1789518499.188201:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 10000000:01000000:3.0:1789518499.250834:0:31621:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518499.250839:0:31621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffe6225800 from 18 10000000:01000000:3.0:1789518499.250843:0:31621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518499.250879:0:31621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518499.250891:0:31621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518499.250903:0:31621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518499.250941:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627595520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518499.251003:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518499.251053:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518499.251161:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627595520 00000100:00100000:0.0:1789518499.251169:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627595520 00000100:00100000:0.0:1789518499.251223:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518499.251232:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+11:31621:x1876445627595520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518499.251244:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518499.251256:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784631 expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518499.251278:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784631 expref: 12 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518499.251302:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784631 expref: 12 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518499.251311:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696000, rc 0) 00000100:00100000:0.0:1789518499.251362:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+12:31621:x1876445627595520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518499.251369:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518499.251464:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627595520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518499.251477:0:31621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518499.251485:0:31621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518499.251531:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627595648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518499.251559:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518499.251629:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0760180 going to sleep for 11 seconds 00000100:00100000:0.0:1789518499.253192:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627595648 00000100:00100000:0.0:1789518499.253201:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627595648 00000100:00100000:0.0:1789518499.253269:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789518499.253278:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31621:x1876445627595648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789518499.253818:0:31619:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518499.253838:0:31619:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518499.253841:0:31619:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 18 00000100:00100000:0.0:1789518499.253976:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31621:x1876445627595648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 698us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518499.253985:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518499.254039:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627595648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789518499.254092:0:31621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789518499.254112:0:31621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518499.254127:0:31621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518500.022398:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518500.210832:0:31656:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1789518500.210843:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518500.210956:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:2.0:1789518500.210963:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000001:02000400:3.0:1789518500.676432:0:31907:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789518501.045154:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518502.068858:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789518502.509932:0:32057:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc076efed0 20000000:00000080:3.0:1789518502.509951:0:32057:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fffd4df000 uarg=0000000000000000 20000000:01000000:3.0:1789518502.509981:0:32057:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789518502.509988:0:32057:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789518502.509992:0:32057:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789518502.510553:0:32058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789518502.510719:0:32057:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789518502.518926:0:32057:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789518502.518951:0:32057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518502.518970:0:32057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784600 expref: 11 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518502.518995:0:32057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518502.519032:0:32057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c784600 expref: 11 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518502.519047:0:32057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c784600 expref: 11 pid: 31618 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518502.519061:0:32057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32057:1876445627595776:0@lo:104: 00000100:00100000:3.0:1789518502.519117:0:32057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518502.519170:0:32057:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffedb6c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518502.519383:0:31607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627595776 00000100:00100000:2.0:1789518502.519390:0:31607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627595776 00000100:00100000:2.0:1789518502.519441:0:31607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518502.519449:0:31607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:32057:x1876445627595776:12345-0@lo:104: 00010000:00010000:2.0:1789518502.519461:0:31607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518502.519517:0:31607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789518502.519523:0:31607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:32057:x1876445627595776:12345-0@lo:104: Request processed in 75us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518502.519530:0:31607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789518502.519557:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518502.519562:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518502.519570:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518502.519574:0:31612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518502.519583:0:31612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518502.519591:0:31612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518502.519597:0:31612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789518502.519648:0:31612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518502.519654:0:31612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518502.519671:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518502.519677:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffd0697600/0x631fd8698c784600 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c784607 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518502.519691:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518502.519693:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518502.519694:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518502.519722:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f013254-1301-45d1-9493-6d558799b39e:3280:1876445627595904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518502.519998:0:32057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:32057:1876445627595776:0@lo:104: 00010000:00010000:0.0:1789518502.520018:0:32057:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518502.520061:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518502.520197:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627595904 00000100:00100000:0.0:1789518502.520202:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627595904 00010000:00010000:0.0:1789518502.520221:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c784600 expref: 12 pid: 31618 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518502.520279:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518502.520292:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f013254-1301-45d1-9493-6d558799b39e+12:3280:x1876445627595904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518502.520303:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518502.520308:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c784600 expref: 12 pid: 31618 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520318:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c784600 expref: 12 pid: 31618 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520331:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bda00/0x631fd8698c784607 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c784600 expref: 12 pid: 31618 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520345:0:31611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520353:0:31611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520366:0:31611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520373:0:31611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520381:0:31611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520388:0:31611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520393:0:31611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518502.520398:0:31611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520410:0:31611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520425:0:31611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518502.520436:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518502.520469:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f013254-1301-45d1-9493-6d558799b39e+11:3280:x1876445627595904:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518502.520476:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789518502.520732:0:32057:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518502.520748:0:32057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518502.520765:0:32057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bca00/0x631fd8698c78463f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518502.521388:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f013254-1301-45d1-9493-6d558799b39e:3280:1876445627595904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518503.090896:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518503.540935:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518503.540941:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518503.540943:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518503.540947:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789518503.540949:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789518503.540952:0:19561:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789518503.540956:0:19561:0:(import.c:65:import_set_state_nolock()) ffff99ffed7ae000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518503.540971:0:19561:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ffed7ae000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518503.540992:0:19561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffff666680 x1876445627596160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518503.541083:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518503.541084:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627596160:0@lo:38:kworker.0 00000100:00100000:2.0:1789518503.541097:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f013254-1301-45d1-9493-6d558799b39e:3280:1876445627596032:0@lo:400:kworker.0 00000100:00100000:3.0:1789518503.541170:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518503.541171:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518503.541258:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627596160 00000100:00100000:2.0:1789518503.541266:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627596160 00000100:00100000:3.0:1789518503.541307:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627596032 00000100:00100000:3.0:1789518503.541312:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627596032 00000100:00100000:2.0:1789518503.541317:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518503.541325:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627596160:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789518503.541350:0:31626:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000100:00100000:3.0:1789518503.541363:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518503.541373:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+11:3280:x1876445627596032:12345-0@lo:400:kworker.0 00000020:00000080:2.0:1789518503.541395:0:31626:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x631fd8698c784646 00000004:00100000:2.0:1789518503.541410:0:31626:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789518503.541426:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+11:3280:x1876445627596032:12345-0@lo:400:kworker.0 Request processed in 54us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518503.541434:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518503.541494:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f013254-1301-45d1-9493-6d558799b39e:3280:1876445627596032:0@lo:400:kworker.0 00000100:00080000:2.0:1789518503.541577:0:31626:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bde000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518503.541640:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876445627596160:12345-0@lo:38:kworker.0 Request processed in 314us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518503.541647:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789518503.541813:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffff666680 x1876445627596160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789518503.541826:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 6 00000100:00080000:3.0:1789518503.541833:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789518503.541837:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789518503.541840:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffed7ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789518503.541845:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627596160:0@lo:38:kworker.0 10000000:01000000:3.0:1789518503.859854:0:31621:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518503.859862:0:31621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffe6225800 from 10 10000000:01000000:3.0:1789518503.859867:0:31621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518503.859906:0:31621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518503.859917:0:31621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518503.859927:0:31621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518503.859963:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627596288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518503.860026:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518503.860076:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518503.860128:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627596288 00000100:00100000:0.0:1789518503.860136:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627596288 00000100:00100000:0.0:1789518503.860198:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789518503.860208:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+11:31621:x1876445627596288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518503.860221:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518503.860233:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78464d expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518503.860255:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78464d expref: 12 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518503.860265:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78464d expref: 12 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518503.860274:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00000100:00100000:0.0:1789518503.860316:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31621:x1876445627596288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518503.860324:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518503.861024:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627596288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518503.861040:0:31621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518503.861051:0:31621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518503.861107:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627596416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518503.861139:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518503.861211:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc92470c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518503.861246:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627596416 00000100:00100000:3.0:1789518503.861251:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627596416 00000100:00100000:3.0:1789518503.861320:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789518503.861328:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+12:31621:x1876445627596416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518503.861544:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+12:31621:x1876445627596416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518503.861551:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518503.861609:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627596416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518503.861663:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627596544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518503.861704:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518503.861883:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc92470c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518503.861914:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627596544 00000100:00100000:0.0:1789518503.861919:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627596544 00000100:00100000:0.0:1789518503.861940:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789518503.861948:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31621:x1876445627596544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518503.862154:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:31621:x1876445627596544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518503.862162:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518503.862249:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627596544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518503.872967:0:32164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789518503.873167:0:31621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789518503.873214:0:31621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518503.873225:0:31621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518503.873236:0:31621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518504.116168:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518505.138856:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789518505.303973:0:32305:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789518505.303976:0:32305:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789518505.304096:0:32305:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffd1031000 00000020:01000004:1.0:1789518505.304110:0:32305:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789518505.304121:0:32305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789518505.304133:0:32305:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99ffee0619c0) 00000020:00000080:1.0:1789518505.304147:0:32305:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789518505.323845:0:32305:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789518505.324098:0:32305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789518505.325112:0:32305:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789518505.325355:0:32305:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789518505.325560:0:32305:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xe:0x0] (8/32) 00100000:10000000:3.0:1789518505.326050:0:32305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1789518505.326141:0:32305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1789518505.326242:0:32305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1789518505.326680:0:32305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:3.0:1789518505.328098:0:32305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:3.0:1789518505.328490:0:32305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:3.0:1789518505.328908:0:32305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1789518505.329158:0:32305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:3.0:1789518505.329413:0:32305:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00000020:00000080:3.0:1789518505.330056:0:32305:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789518505.330068:0:32305:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789518505.330079:0:32305:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c784662 00000020:01000004:3.0:1789518505.330086:0:32305:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789518505.330107:0:32305:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789518505.330111:0:32305:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789518505.330116:0:32305:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789518505.330121:0:32305:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789518505.330131:0:32305:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99fff4200000) 00000020:00000080:3.0:1789518505.330141:0:32305:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789518505.332671:0:32305:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518505.333053:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789518505.333059:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789518505.336000:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789518505.336015:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789518505.338482:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789518505.338493:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789518505.341867:0:32305:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518505.342034:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789518505.342039:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789518505.343421:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789518505.343429:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789518505.361563:0:32305:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518505.361991:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789518505.361998:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789518505.363228:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789518505.363238:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789518505.364197:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789518505.364205:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789518505.366206:0:32305:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518505.366388:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789518505.366394:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789518505.367029:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789518505.367035:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789518505.393572:0:32305:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518505.393747:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789518505.393751:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789518505.394592:0:32305:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789518505.394599:0:32305:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789518505.395029:0:32305:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789518505.395051:0:32305:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789518505.395057:0:32305:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789518505.402983:0:32305:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789518505.403021:0:32305:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789518505.403026:0:32305:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789518505.403028:0:32305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518505.403029:0:32305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518505.403031:0:32305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518505.403032:0:32305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518505.403033:0:32305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518505.403035:0:32305:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518505.403036:0:32305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518505.403038:0:32305:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789518505.403041:0:32305:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789518505.403044:0:32305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518505.403045:0:32305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518505.403046:0:32305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518505.403047:0:32305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518505.403048:0:32305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518505.403049:0:32305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518505.403050:0:32305:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518505.403051:0:32305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518505.403053:0:32305:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789518505.403078:0:32305:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789518505.403097:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627596672:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789518505.403168:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518505.403832:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627596672 00000100:00100000:0.0:1789518505.403840:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627596672 00000100:00100000:2.0:1789518505.403997:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518505.404022:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789518505.404031:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:32305:x1876445627596672:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789518505.404082:0:31619:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789518505.404086:0:31619:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789518505.404089:0:31619:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789518505.412531:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:32305:x1876445627596672:12345-0@lo:253:mount.lustre.0 Request processed in 8492us (9354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518505.412545:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518505.414230:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627596672:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789518505.414248:0:32305:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789518505.414252:0:32305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518505.414253:0:32305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518505.414255:0:32305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518505.414256:0:32305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518505.414257:0:32305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518505.414258:0:32305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518505.414259:0:32305:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518505.414261:0:32305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518505.414262:0:32305:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789518505.414295:0:32305:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffd1031000 from lustre-OST0000 10000000:01000000:2.0:1789518505.414321:0:32305:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789518505.414324:0:32305:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789518505.414331:0:32305:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ffc6510000 local copy 00010000:00010000:2.0:1789518505.414341:0:32305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518505.414631:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627596800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518505.414681:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518505.414723:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518505.414771:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627596800 00000100:00100000:3.0:1789518505.414778:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627596800 00000100:00100000:3.0:1789518505.414839:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518505.414849:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+12:32305:x1876445627596800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518505.415029:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+12:32305:x1876445627596800:12345-0@lo:501:mount.lustre.0 Request processed in 182us (346us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518505.415036:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789518505.415162:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627596800:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789518505.415188:0:32305:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789518505.415318:0:32305:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789518505.415324:0:32305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.415333:0:32305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518505.415353:0:32305:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffd1031000 10000000:01000000:2.0:1789518505.415356:0:32305:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789518505.415360:0:32305:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99ffc6510000 10000000:01000000:2.0:1789518505.415362:0:32305:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789518505.415365:0:32305:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99ffc6510000 from 1 10000000:01000000:2.0:1789518505.415368:0:32305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789518505.415489:0:32305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.415497:0:32305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.415521:0:32305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518505.415535:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627596928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518505.415559:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518505.415578:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518505.415631:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627596928 00000100:00100000:0.0:1789518505.415637:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627596928 00000100:00100000:0.0:1789518505.415786:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789518505.415808:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+12:32305:x1876445627596928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518505.415823:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518505.415836:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0697800/0x631fd8698c784677 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784670 expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518505.415856:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0697800/0x631fd8698c784677 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784670 expref: 13 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518505.415867:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0697800/0x631fd8698c784677 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784670 expref: 13 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518505.415877:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697800, rc 0) 00000100:00100000:0.0:1789518505.415916:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+13:32305:x1876445627596928:12345-0@lo:101:mount.lustre.0 Request processed in 110us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518505.415922:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518505.415956:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627596928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518505.415968:0:32305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784677 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.415977:0:32305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784677 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518505.415990:0:32305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789518505.416008:0:32305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784677 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.416016:0:32305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784677 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518505.416021:0:32305:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789518505.416024:0:32305:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518505.416029:0:32305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789518505.416031:0:32305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789518505.416043:0:32305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.416050:0:32305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.416063:0:32305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518505.416075:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518505.416099:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518505.416403:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518505.416404:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627597056 00000100:00100000:3.0:1789518505.416411:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627597056 00000100:00100000:1.0:1789518505.416453:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518505.416464:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc742d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+13:32305:x1876445627597056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518505.416473:0:31616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518505.416483:0:31616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fff5b44800/0x631fd8698c784685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78467e expref: -99 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.416499:0:31616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b44800/0x631fd8698c784685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78467e expref: 14 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.416507:0:31616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fff5b44800/0x631fd8698c784685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78467e expref: 14 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.416513:0:31616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff5b44800, rc 0) 00000100:00100000:1.0:1789518505.416595:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc742d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597056:12345-0@lo:101:mount.lustre.0 Request processed in 134us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518505.416601:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789518505.417102:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518505.417116:0:32305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.417125:0:32305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518505.417775:0:32305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000040:00080000:2.0:1789518505.418517:0:32305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518505.419495:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:0.0:1789518505.419552:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:0.0:1789518505.419586:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:0.0:1789518505.419729:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:0.0:1789518505.419769:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:0.0:1789518505.419804:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:0.0:1789518505.419855:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:0.0:1789518505.419892:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:0.0:1789518505.419927:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 80 off9712 00000040:00080000:0.0:1789518505.419973:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9936 00000040:00080000:0.0:1789518505.420006:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 224 off10160 00000040:00080000:0.0:1789518505.420051:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 120 off10280 00000040:00080000:0.0:1789518505.420201:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].13, 224 off10504 00000040:00080000:0.0:1789518505.420209:0:32305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 13 count 14 00000100:00100000:0.0:1789518505.420292:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518505.420346:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518505.420440:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc30323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518505.420492:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627597184 00000100:00100000:2.0:1789518505.420499:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627597184 00000100:00100000:2.0:1789518505.420548:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789518505.420557:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518505.421445:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597184:12345-0@lo:501:mount.lustre.0 Request processed in 886us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.421453:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518505.421528:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518505.421562:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518505.421602:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518505.421703:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc30323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518505.421733:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627597312 00000100:00100000:1.0:1789518505.421737:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627597312 00000100:00100000:1.0:1789518505.421794:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789518505.421801:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597312:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518505.422156:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597312:12345-0@lo:503:mount.lustre.0 Request processed in 355us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518505.422163:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518505.422214:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597312:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518505.422772:0:32305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518505.422837:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518505.422873:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518505.422903:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518505.422961:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627597440 00000100:00100000:3.0:1789518505.422965:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627597440 00000100:00100000:3.0:1789518505.422999:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518505.423006:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518505.423268:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597440:12345-0@lo:502:mount.lustre.0 Request processed in 261us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.423275:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518505.423337:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518505.423501:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:1.0:1789518505.423538:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:1.0:1789518505.423555:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:1.0:1789518505.423580:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:1.0:1789518505.423609:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:1.0:1789518505.423788:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:1.0:1789518505.423838:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:1.0:1789518505.423875:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:1.0:1789518505.423910:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 80 off9712 00000040:00080000:1.0:1789518505.423956:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9936 00000040:00080000:1.0:1789518505.424207:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 224 off10160 00000040:00080000:1.0:1789518505.424252:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 120 off10280 00000100:00100000:1.0:1789518505.424275:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518505.424307:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518505.424335:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518505.424355:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627597568 00000100:00100000:3.0:1789518505.424361:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627597568 00000100:00100000:3.0:1789518505.424502:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789518505.424511:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518505.424711:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597568:12345-0@lo:502:mount.lustre.0 Request processed in 201us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.424717:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789518505.424827:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518505.425095:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].13, 224 off10504 00000040:00080000:2.0:1789518505.425111:0:32305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789518505.427019:0:32320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518505.427029:0:32320:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789518505.427035:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518505.427038:0:32320:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789518505.427043:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518505.427062:0:32320:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99fff4204d40) 00000020:00000080:3.0:1789518505.427085:0:32320:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789518505.427092:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789518505.427165:0:32320:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffd1031000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789518505.427184:0:32320:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789518505.427192:0:32320:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c784693 00010000:00010000:3.0:1789518505.433207:0:32320:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789518505.434660:0:32320:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 21474836486 00080000:10000000:3.0:1789518505.436663:0:32320:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00000020:00000080:0.0:1789518505.440078:0:32320:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789518505.440090:0:32320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518505.440096:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518505.440098:0:32320:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789518505.440102:0:32320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789518505.440105:0:32320:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1789518505.440107:0:32320:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518505.440108:0:32320:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518505.440110:0:32320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789518505.440113:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518505.440114:0:32320:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789518505.440117:0:32320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518505.440120:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518505.440121:0:32320:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789518505.440124:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789518505.440126:0:32320:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789518505.440128:0:32320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518505.440130:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518505.440132:0:32320:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789518505.440135:0:32320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518505.440137:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518505.440138:0:32320:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789518505.440140:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789518505.440208:0:32320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518505.440212:0:32320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518505.440213:0:32320:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789518505.440222:0:32320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000020:01000000:2.0:1789518505.440449:0:32305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789518505.440476:0:32305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789518505.440524:0:32305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.440547:0:32305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518505.440555:0:32305:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffd1031000 from 1 10000000:01000000:2.0:1789518505.440558:0:32305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518505.440588:0:32305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.440596:0:32305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.440607:0:32305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518505.440651:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518505.440712:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518505.440748:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518505.440818:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627597696 00000100:00100000:3.0:1789518505.440825:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627597696 00000100:00100000:3.0:1789518505.440882:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789518505.440890:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+14:32305:x1876445627597696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518505.440911:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518505.440923:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78469a expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518505.440944:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78469a expref: 15 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518505.440954:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78469a expref: 15 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518505.440962:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:3.0:1789518505.440995:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627597696:12345-0@lo:101:mount.lustre.0 Request processed in 107us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.441002:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518505.441192:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518505.441208:0:32305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.441216:0:32305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518505.441769:0:32305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000040:00080000:2.0:1789518505.442164:0:32305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789518505.444281:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:2.0:1789518505.444357:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:2.0:1789518505.445357:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:2.0:1789518505.445548:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:2.0:1789518505.445749:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:2.0:1789518505.445832:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:2.0:1789518505.445870:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 224 off9536 00000040:00080000:2.0:1789518505.445905:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 128 off9664 00000040:00080000:2.0:1789518505.446004:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:2.0:1789518505.446013:0:32305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 9 count 10 00000100:00100000:2.0:1789518505.446349:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518505.446412:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518505.446494:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518505.446539:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627597824 00000100:00100000:1.0:1789518505.446546:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627597824 00000100:00100000:1.0:1789518505.446715:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789518505.446725:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627597824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518505.446947:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627597824:12345-0@lo:501:mount.lustre.0 Request processed in 223us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518505.446955:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789518505.447022:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518505.447057:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518505.447097:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518505.449004:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518505.449202:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627597952 00000100:00100000:0.0:1789518505.449210:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627597952 00000100:00100000:0.0:1789518505.449250:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518505.449258:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627597952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518505.449436:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627597952:12345-0@lo:503:mount.lustre.0 Request processed in 177us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518505.449443:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518505.449930:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627597952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518505.451371:0:32305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518505.451443:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518505.451503:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518505.451541:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518505.451608:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627598080 00000100:00100000:2.0:1789518505.451642:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627598080 00000100:00100000:2.0:1789518505.451681:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789518505.451690:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627598080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518505.452013:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627598080:12345-0@lo:502:mount.lustre.0 Request processed in 323us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518505.452021:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518505.452037:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518505.452456:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:3.0:1789518505.452488:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:3.0:1789518505.452512:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:3.0:1789518505.452531:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:3.0:1789518505.452546:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000040:00080000:3.0:1789518505.452581:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:3.0:1789518505.452944:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 224 off9536 00000040:00080000:3.0:1789518505.452986:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 128 off9664 00000100:00100000:3.0:1789518505.453014:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518505.453067:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518505.453099:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518505.453166:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627598208 00000100:00100000:1.0:1789518505.453182:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627598208 00000100:00100000:1.0:1789518505.453252:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518505.453260:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627598208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518505.453414:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627598208:12345-0@lo:502:mount.lustre.0 Request processed in 155us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518505.453431:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518505.453507:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518505.453605:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:3.0:1789518505.453637:0:32305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789518505.454420:0:32324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518505.454429:0:32324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518505.454431:0:32324:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789518505.454437:0:32324:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffd1031000 00000020:00000080:3.0:1789518505.454439:0:32324:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518505.454453:0:32324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518505.454456:0:32324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518505.454457:0:32324:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789518505.454460:0:32324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518505.454462:0:32324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518505.454463:0:32324:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789518505.454467:0:32324:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffd1031000 00000020:00000080:3.0:1789518505.454469:0:32324:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518505.454523:0:32324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518505.454528:0:32324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518505.454529:0:32324:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789518505.454531:0:32324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518505.454533:0:32324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518505.454534:0:32324:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789518505.454537:0:32324:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffd1031000 00000020:00000080:3.0:1789518505.454539:0:32324:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789518505.454572:0:32324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518505.454575:0:32324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518505.454576:0:32324:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789518505.454579:0:32324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000020:01000000:1.0:1789518505.455952:0:32305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789518505.455989:0:32305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789518505.456036:0:32305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.456049:0:32305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518505.456094:0:32305:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789518505.456097:0:32305:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffd1031000 10000000:01000000:1.0:1789518505.456100:0:32305:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffd1031000 10000000:01000000:1.0:1789518505.456104:0:32305:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518505.456109:0:32305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffd1031000 from 1 10000000:01000000:1.0:1789518505.456112:0:32305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789518505.456144:0:32305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.456152:0:32305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.456163:0:32305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518505.456202:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518505.456263:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518505.456303:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb000 going to sleep for 11 seconds 00000100:00100000:3.0:1789518505.456658:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627598336 00000100:00100000:3.0:1789518505.456665:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627598336 00000100:00100000:3.0:1789518505.456710:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789518505.456719:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627598336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518505.456732:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518505.456744:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bca00/0x631fd8698c7846af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7846a8 expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518505.456766:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bca00/0x631fd8698c7846af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7846a8 expref: 16 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518505.456777:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bca00/0x631fd8698c7846af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7846a8 expref: 16 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518505.456792:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bca00, rc 0) 00000100:00100000:3.0:1789518505.456840:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627598336:12345-0@lo:101:mount.lustre.0 Request processed in 121us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.456846:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518505.456917:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518505.456931:0:32305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.456957:0:32305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518505.463413:0:32305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000040:00080000:1.0:1789518505.463801:0:32305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518505.464041:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:1.0:1789518505.464101:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:1.0:1789518505.464165:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:1.0:1789518505.464224:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:1.0:1789518505.464261:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:1.0:1789518505.464305:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:1.0:1789518505.464340:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:1.0:1789518505.464369:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:1.0:1789518505.464412:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:1.0:1789518505.464447:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:1.0:1789518505.464482:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:1.0:1789518505.464527:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:1.0:1789518505.464561:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:1.0:1789518505.464589:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:1.0:1789518505.464652:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:1.0:1789518505.464686:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:1.0:1789518505.464715:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:1.0:1789518505.464758:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:1.0:1789518505.464809:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:1.0:1789518505.464846:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:1.0:1789518505.464896:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:1.0:1789518505.464931:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:1.0:1789518505.464965:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:1.0:1789518505.465029:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:1.0:1789518505.465064:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 128 off12440 00000040:00080000:1.0:1789518505.465105:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12664 00000040:00080000:1.0:1789518505.465146:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12888 00000040:00080000:1.0:1789518505.465194:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off12968 00000040:00080000:1.0:1789518505.465225:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13192 00000040:00080000:1.0:1789518505.465266:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13416 00000040:00080000:1.0:1789518505.465296:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13504 00000040:00080000:1.0:1789518505.465323:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13632 00000040:00080000:1.0:1789518505.465355:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13776 00000040:00080000:1.0:1789518505.465400:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13904 00000040:00080000:1.0:1789518505.468468:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14128 00000040:00080000:1.0:1789518505.468585:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14352 00000040:00080000:1.0:1789518505.468970:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14432 00000040:00080000:1.0:1789518505.469013:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14656 00000040:00080000:1.0:1789518505.469065:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14880 00000040:00080000:1.0:1789518505.469099:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 120 off15000 00000040:00080000:1.0:1789518505.469739:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 224 off15224 00000040:00080000:1.0:1789518505.469750:0:32305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 41 count 42 00000100:00100000:1.0:1789518505.469836:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518505.469897:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518505.469990:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518505.472538:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627598464 00000100:00100000:0.0:1789518505.472548:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627598464 00000100:00100000:0.0:1789518505.472592:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518505.472601:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627598464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518505.473246:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627598464:12345-0@lo:501:mount.lustre.0 Request processed in 644us (3347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518505.473255:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518505.473559:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518505.473604:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518505.473674:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518505.473703:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6154780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518505.473773:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627598592 00000100:00100000:3.0:1789518505.473779:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627598592 00000100:00100000:3.0:1789518505.473889:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518505.473897:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627598592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518505.474039:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627598592:12345-0@lo:503:mount.lustre.0 Request processed in 143us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.474046:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518505.474123:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598592:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789518505.474997:0:32305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789518505.475056:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518505.475093:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518505.475118:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627598720 00000100:00100000:0.0:1789518505.475122:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627598720 00000100:00100000:0.0:1789518505.475147:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518505.475159:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627598720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518505.475342:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627598720:12345-0@lo:502:mount.lustre.0 Request processed in 183us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518505.475349:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518505.475387:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6154780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518505.475401:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518505.475600:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:0.0:1789518505.475662:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:0.0:1789518505.475696:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:0.0:1789518505.475743:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:0.0:1789518505.475781:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:0.0:1789518505.476668:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:0.0:1789518505.476707:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:0.0:1789518505.476741:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:0.0:1789518505.476799:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:0.0:1789518505.476840:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:0.0:1789518505.476878:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:0.0:1789518505.476927:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:0.0:1789518505.476964:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:0.0:1789518505.476999:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:0.0:1789518505.477048:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:0.0:1789518505.477085:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:0.0:1789518505.477137:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:0.0:1789518505.477212:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:0.0:1789518505.477247:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:0.0:1789518505.477278:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:0.0:1789518505.477329:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:0.0:1789518505.477365:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:0.0:1789518505.477399:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:0.0:1789518505.477448:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:0.0:1789518505.477495:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 128 off12440 00000040:00080000:0.0:1789518505.477529:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12664 00000040:00080000:0.0:1789518505.477574:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12888 00000040:00080000:0.0:1789518505.477610:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off12968 00000040:00080000:0.0:1789518505.477667:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13192 00000040:00080000:0.0:1789518505.477714:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13416 00000040:00080000:0.0:1789518505.477747:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13504 00000040:00080000:0.0:1789518505.477795:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13632 00000040:00080000:0.0:1789518505.477846:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13776 00000040:00080000:0.0:1789518505.478744:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13904 00000040:00080000:0.0:1789518505.478799:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14128 00000040:00080000:0.0:1789518505.478852:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14352 00000040:00080000:0.0:1789518505.478889:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14432 00000040:00080000:0.0:1789518505.478922:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14656 00000040:00080000:0.0:1789518505.478970:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14880 00000040:00080000:0.0:1789518505.479006:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 120 off15000 00000100:00100000:0.0:1789518505.479054:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518505.479124:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518505.479256:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627598848 00000100:00100000:1.0:1789518505.479263:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627598848 00000100:00100000:1.0:1789518505.479306:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789518505.479314:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627598848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518505.479540:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6154780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518505.480085:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627598848:12345-0@lo:502:mount.lustre.0 Request processed in 770us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518505.480094:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518505.480300:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627598848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518505.480449:0:32305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 224 off15224 00000040:00080000:0.0:1789518505.480460:0:32305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789518505.483260:0:32329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789518505.483277:0:32329:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99fff78399c0) 00000020:00000080:2.0:1789518505.483296:0:32329:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789518505.483371:0:32329:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffd1031000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789518505.483375:0:32329:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffd1031000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789518505.483446:0:32329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffd1031000 3 00010000:00080000:2.0:1789518505.483476:0:32329:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffc76d6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1789518505.485862:0:32329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789518505.486040:0:32329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789518505.486072:0:32329:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789518505.486083:0:32329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x631fd8698c7846bd 00000100:00080000:2.0:1789518505.486093:0:32329:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518505.486110:0:32329:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99ffc76d6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518505.486144:0:32329:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd846f800 x1876445627598976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518505.486167:0:32329:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789518505.486362:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627598976:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789518505.486498:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789518505.486800:0:32329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000100:00080000:1.0:1789518505.486925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518505.486929:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789518505.486939:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518505.486942:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789518505.486991:0:32305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:3.0:1789518505.486999:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627599104:0@lo:400:kworker.0 10000000:01000000:1.0:1789518505.487020:0:32305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:3.0:1789518505.487025:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518505.487033:0:32305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.487044:0:32305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518505.487058:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627598976 00000100:00100000:3.0:1789518505.487064:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627598976 00000100:00100000:3.0:1789518505.487085:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627599104 00000020:01000004:1.0:1789518505.487085:0:32305:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00100000:3.0:1789518505.487087:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627599104 00000020:01000004:1.0:1789518505.487087:0:32305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789518505.487088:0:32305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518505.487090:0:32305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518505.487091:0:32305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518505.487092:0:32305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518505.487093:0:32305:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518505.487095:0:32305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518505.487097:0:32305:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518505.487100:0:32305:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789518505.487102:0:32305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518505.487104:0:32305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789518505.487105:0:32305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518505.487106:0:32305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518505.487107:0:32305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518505.487108:0:32305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518505.487109:0:32305:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518505.487110:0:32305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518505.487111:0:32305:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1789518505.487119:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 10000000:01000000:1.0:1789518505.487124:0:32305:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789518505.487127:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627599104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518505.487133:0:32305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627599232:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789518505.487505:0:31625:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518505.487514:0:31625:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789518505.487579:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627599104:12345-0@lo:400:kworker.0 Request processed in 451us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.487587:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518505.487607:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518505.487634:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627598976:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789518505.487652:0:31626:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:3.0:1789518505.487679:0:31626:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x631fd8698c7846c4 00000004:00100000:3.0:1789518505.487694:0:31626:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789518505.487719:0:31626:0:(import.c:65:import_set_state_nolock()) ffff99fff4011000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518505.487757:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876445627598976:12345-0@lo:38:llog_process_th.0 Request processed in 145us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.487763:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789518505.487905:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffd846f800 x1876445627598976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518505.487916:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518505.487923:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 6 00000100:00080000:3.0:1789518505.487930:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789518505.487934:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789518505.487936:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc76d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789518505.487941:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627598976:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789518505.488130:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffffe5b100 x1876445627599104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518505.488140:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627599104:0@lo:400:kworker.0 00000100:00100000:1.0:1789518505.488223:0:32305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518505.488262:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627599232 00000100:00100000:3.0:1789518505.488268:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627599232 00000100:00100000:1.0:1789518505.488273:0:32305:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518505.488338:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789518505.488346:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:32305:x1876445627599232:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518505.488374:0:31618:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789518505.488446:0:31618:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789518505.516985:0:31618:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518505.517051:0:31618:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789518505.517144:0:31640:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789518505.517149:0:31640:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789518505.517170:0:31640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.517202:0:31640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784631 expref: 16 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.517211:0:31640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.517254:0:31640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c784631 expref: 16 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.517267:0:31640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c784631 expref: 16 pid: 31618 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518505.517281:0:31640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31640:1876445627599360:0@lo:104: 00000100:00100000:1.0:1789518505.517334:0:31640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518505.517418:0:31640:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518505.517570:0:31607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627599360 00000100:00100000:3.0:1789518505.517587:0:31607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627599360 00000100:00100000:3.0:1789518505.517690:0:31607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518505.517700:0:31607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:31640:x1876445627599360:12345-0@lo:104: 00010000:00010000:3.0:1789518505.517712:0:31607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518505.517764:0:31607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518505.517770:0:31607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:31640:x1876445627599360:12345-0@lo:104: Request processed in 73us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.517777:0:31607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789518505.517777:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518505.517786:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.517796:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518505.517799:0:31612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.517808:0:31612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518505.517816:0:31612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518505.517823:0:31612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518505.517858:0:31612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518505.517864:0:31640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31640:1876445627599360:0@lo:104: 00010000:00010000:2.0:1789518505.517867:0:31612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518505.517886:0:31640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.517890:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.517904:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd400/0x631fd8698c784631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c784638 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518505.517924:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518505.517926:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518505.517928:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627599488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518505.517930:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518505.517961:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518505.518028:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627599488 00000100:00100000:1.0:1789518505.518033:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627599488 00010000:00010000:1.0:1789518505.518049:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c784631 expref: 17 pid: 31618 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518505.518077:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518505.518084:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f013254-1301-45d1-9493-6d558799b39e+17:3283:x1876445627599488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518505.518093:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518505.518097:0:31609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c784631 expref: 17 pid: 31618 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518119:0:31609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c784631 expref: 17 pid: 31618 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518132:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0696000/0x631fd8698c784638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c784631 expref: 17 pid: 31618 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518144:0:31609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518152:0:31609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789518505.518163:0:31609:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001014561s 00010000:00010000:1.0:1789518505.518167:0:31609:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518185:0:31609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518192:0:31609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518199:0:31609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518204:0:31609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518505.518208:0:31609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518216:0:31609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518230:0:31609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518505.518239:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518505.518270:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f013254-1301-45d1-9493-6d558799b39e+16:3283:x1876445627599488:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518505.518277:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518505.518305:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627599488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518505.518450:0:31640:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518505.518458:0:31640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518505.518464:0:31640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b44200/0x631fd8698c7846cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518505.524199:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+15:32305:x1876445627599232:12345-0@lo:253:mount.lustre.0 Request processed in 35844us (35966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518505.524214:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518505.524221:0:32305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:32305:1876445627599232:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518505.524239:0:32305:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789518505.524242:0:32305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518505.524244:0:32305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789518505.524246:0:32305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518505.524248:0:32305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518505.524250:0:32305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518505.524251:0:32305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518505.524252:0:32305:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518505.524254:0:32305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518505.524256:0:32305:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789518505.524270:0:32305:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789518505.524664:0:32305:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518505.524823:0:32305:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518505.525053:0:32305:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518505.525207:0:32305:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518505.525338:0:32305:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518505.525550:0:32305:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789518505.526254:0:32305:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803776 00002000:00080000:2.0:1789518505.567345:0:32305:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789518505.567355:0:32305:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789518505.567392:0:32305:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789518505.567449:0:32305:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789518505.567464:0:32305:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789518505.567491:0:32305:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789518506.162893:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789518506.998948:0:31621:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518506.998954:0:31621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffe6225800 from 19 10000000:01000000:3.0:1789518506.998959:0:31621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518506.999008:0:31621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518506.999026:0:31621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518506.999038:0:31621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518506.999063:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627599616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518506.999208:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518506.999252:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518506.999272:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627599616 00000100:00100000:3.0:1789518506.999278:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627599616 00000100:00100000:3.0:1789518506.999961:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789518506.999971:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdac56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+15:31621:x1876445627599616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518506.999982:0:31616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518507.000162:0:31616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7846d2 expref: -99 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518507.000197:0:31616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7846d2 expref: 16 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518507.000207:0:31616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7846d2 expref: 16 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518507.000217:0:31616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:3.0:1789518507.000257:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdac56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+16:31621:x1876445627599616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518507.000264:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789518507.000315:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627599616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518507.000330:0:31621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518507.000339:0:31621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518507.000385:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627599744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518507.000414:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518507.000434:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518507.000446:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627599744 00000100:00100000:3.0:1789518507.000450:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627599744 00000100:00100000:3.0:1789518507.000472:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518507.000478:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:31621:x1876445627599744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789518507.000491:0:31618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789518507.000506:0:31618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789518507.000509:0:31618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 19 00000100:00100000:3.0:1789518507.000571:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:31621:x1876445627599744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518507.000578:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518507.000604:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627599744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518507.000666:0:31621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518507.000673:0:31621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518507.000681:0:31621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518507.186836:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518508.210914:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518508.595339:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518498/real 1789518498] req@ffff99fff78ab800 x1876445627593216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518508 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518508.595367:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fff78ab800 x1876445627593216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518508 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518508.595386:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518498/real 1789518498] req@ffff99fff78a8380 x1876445627593088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518508 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518508.595399:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fff78a8380 x1876445627593088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518508 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789518508.595415:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f46800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518508.595438:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789518508.595442:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627593216:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789518508.595447:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc2c1b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789518508.595452:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789518508.595455:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627593088:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789518508.595878:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789518508.595884:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789518508.595886:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ffc2c1b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789518508.595891:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 552 00000100:00080000:2.0:1789518508.595896:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789518508.595905:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffc2c1b800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518508.596189:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518508.596201:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627599872:0@lo:400:kworker.0 00000100:00100000:0.0:1789518508.596422:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518508.596484:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627599872 00000100:00100000:0.0:1789518508.596492:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627599872 00000100:00100000:0.0:1789518508.596531:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789518508.596540:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:3281:x1876445627599872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518508.596585:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:3281:x1876445627599872:12345-0@lo:400:kworker.0 Request processed in 46us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518508.596591:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789518508.597890:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627599872:0@lo:400:kworker.0 00000100:00100000:2.0:1789518508.597984:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd846ca80 x1876445627600000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518508.598007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789518508.598011:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789518508.598013:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f46800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789518508.598017:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 552 00000100:00080000:2.0:1789518508.598020:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789518508.598034:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffc4f46800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518508.598050:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd846e300 x1876445627600128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518508.598095:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518508.598104:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627600256:0@lo:400:kworker.0 00000100:00100000:2.0:1789518508.598139:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518508.598180:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627600384:0@lo:400:kworker.0 00000100:00100000:2.0:1789518508.598205:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518508.598234:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627600256 00000100:00100000:2.0:1789518508.598238:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627600256 00000100:00100000:2.0:1789518508.598267:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627600384 00000100:00100000:2.0:1789518508.598270:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627600384 00000100:00100000:1.0:1789518508.598393:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627600000:0@lo:8:kworker.0 00000100:00100000:1.0:1789518508.598422:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518508.598495:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627600000 00000100:00100000:0.0:1789518508.598499:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627600000 00000100:00100000:0.0:1789518508.598518:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518508.598523:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518508.598523:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627600000:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789518508.598530:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627600256:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789518508.598544:0:32306:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000100:00100000:3.0:1789518508.598568:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627600256:12345-0@lo:400:kworker.0 Request processed in 39us (429us total) trans 0 rc 0/0 00000020:00000080:0.0:1789518508.598569:0:32306:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c7846e0 00000100:00100000:3.0:1789518508.598574:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00100000:0.0:1789518508.598579:0:32306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99ffff385800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789518508.598583:0:32306:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789518508.598585:0:32306:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789518508.598588:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518508.598593:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627600384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518508.598632:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627600384:12345-0@lo:400:kworker.0 Request processed in 39us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518508.598637:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518508.598799:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627600128:0@lo:8:kworker.0 00000100:00100000:1.0:1789518508.598822:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518508.598864:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:0.0:1789518508.598891:0:32306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789518508.598910:0:32306:0:(import.c:65:import_set_state_nolock()) ffff99ffff386000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518508.598927:0:32309:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789518508.598933:0:32309:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789518508.598955:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627600000:12345-0@lo:8:kworker.0 Request processed in 431us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518508.598961:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518508.598971:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627600128 00000100:00100000:0.0:1789518508.598974:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627600128 00000100:00100000:0.0:1789518508.598983:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518508.598987:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627600128:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789518508.598996:0:32306:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789518508.599432:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846ca80 x1876445627600000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518508.599442:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518508.599448:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 6 00000100:00080000:1.0:1789518508.599454:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789518508.599458:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789518508.599467:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc2c1b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789518508.599479:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789518508.599484:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627600000:0@lo:8:kworker.0 00000004:00080000:1.0:1789518508.599506:0:31646:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789518508.599746:0:31646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 562596131067ns, next at 0ns, rc = 0 00010000:00080000:3.0:1789518508.601735:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846c700 x1876445627600256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518508.601752:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627600256:0@lo:400:kworker.0 00010000:00080000:3.0:1789518508.601864:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffd846df80 x1876445627600384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518508.601874:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627600384:0@lo:400:kworker.0 00000004:00080000:3.0:1789518508.602008:0:31647:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x82:0x0] 00000100:00100000:3.0:1789518508.602028:0:31647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31647:1876445627600640:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789518508.602080:0:31647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518508.602101:0:31647:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518508.602111:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518508.602123:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627600512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518508.602147:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518508.602184:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627600640 00000100:00100000:3.0:1789518508.602190:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627600640 00000100:00100000:3.0:1789518508.602227:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518508.602235:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:31647:x1876445627600640:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789518508.606519:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627600512 00000100:00100000:2.0:1789518508.606532:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627600512 00000100:00100000:2.0:1789518508.606573:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518508.606583:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627600512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518508.606632:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518508.606705:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627600512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (4557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518508.606712:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789518508.607538:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffff667480 x1876445627600512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518508.607558:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627600512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518508.607608:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789518508.610605:0:32308:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789518508.610645:0:32308:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -31 00002000:02000040:3.0:1789518508.610652:0:32308:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:131 to 0x240000400:161) 00000100:00100000:0.0:1789518508.613267:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627600128:12345-0@lo:8:kworker.0 Request processed in 14270us (14435us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789518508.613280:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789518508.613332:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f46800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518508.613337:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789518508.613341:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627600128:0@lo:8:kworker.0 00002000:00010000:3.0:1789518508.627347:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.627359:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.627375:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa1:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.627380:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.627386:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.627403:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.627414:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.627422:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.627523:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518508.628112:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.628118:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.628128:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa0:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.628131:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.628136:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.628145:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.628153:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.628174:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628237:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518508.628245:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628254:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bdc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.628259:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628269:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628288:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628296:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4875cf5/0x631fd8698c7846e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628321:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518508.628325:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628343:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.628347:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628355:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628366:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.628375:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.628377:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.628379:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.628444:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789518508.628449:0:32308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b635cb49/0x631fd8698c7846ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.628527:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.629248:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.629255:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629271:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.629275:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.629280:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629291:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629299:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629307:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629322:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.629332:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.629336:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629343:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.629347:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629356:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629380:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629388:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000baeabe1/0x631fd8698c7846f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629403:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.629405:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.629407:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.629957:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.629964:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629974:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.629977:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.629981:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629990:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.629999:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630007:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630036:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.630046:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.630051:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630059:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.630063:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630071:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630084:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630091:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd9791f9/0x631fd8698c7846fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630106:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.630108:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.630109:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.630525:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.630531:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630539:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.630548:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.630553:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630563:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630571:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630579:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630592:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.630599:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.630603:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630610:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.630630:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630638:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630648:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630666:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7dfc8ba/0x631fd8698c784703 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.630679:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.630681:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.630682:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.631042:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.631048:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631056:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.631059:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.631063:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631071:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631080:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631088:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631101:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.631108:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.631116:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631123:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.631127:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631134:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631145:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631152:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f430e8e/0x631fd8698c78470a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631180:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.631182:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.631184:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.631542:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.631548:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631557:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.631560:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.631804:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631824:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631833:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631840:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631854:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.631864:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.631868:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631876:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.631880:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631889:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631900:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631908:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16297d1/0x631fd8698c784711 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.631927:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.631929:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.631931:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.632388:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.632394:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632403:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.632406:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.632411:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632421:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632429:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632436:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632449:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.632457:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.632461:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632480:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.632484:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632493:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632505:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632513:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784718 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.632533:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.632536:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.632539:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.632986:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.632992:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633001:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x99:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.633005:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.633009:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633019:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633033:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633041:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633055:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.633064:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.633068:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633076:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.633079:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633087:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633099:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633107:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78471f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633120:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.633127:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.633129:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.633551:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.633557:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633566:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x98:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.633569:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.633573:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633583:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633591:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.633599:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634082:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.634095:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.634099:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634107:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.634110:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634134:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634148:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634155:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba704a2e/0x631fd8698c784726 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634187:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.634189:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.634190:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.634665:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.634672:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634681:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x97:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.634685:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.634689:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634699:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634708:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634722:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634737:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.634745:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.634750:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634757:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.634760:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634768:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634782:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634790:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b2dd9b/0x631fd8698c78472d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.634811:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.634813:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.634815:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.635236:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.635249:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635257:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x96:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.635261:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.635265:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635275:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635283:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635291:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635306:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.635313:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.635317:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635324:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.635328:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635335:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635351:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635358:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000347f3ccb/0x631fd8698c784734 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635373:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.635375:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.635376:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.635805:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.635811:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635819:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x95:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.635822:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.635826:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635834:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635842:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635849:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.635878:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518508.635933:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518508.635941:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.635955:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518508.635960:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.635969:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.635985:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.635994:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc2099ed/0x631fd8698c78473b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.636012:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518508.636014:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518508.636016:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.636344:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.636350:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636358:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x94:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.636361:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.636365:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636373:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636381:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636389:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636405:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.636414:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.636419:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636426:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.636434:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636443:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636455:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636462:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006252da75/0x631fd8698c784742 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636477:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.636479:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.636480:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.636927:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.636933:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636942:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x93:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.636945:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.636950:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636960:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636968:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636982:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.636997:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518508.637485:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.637491:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637499:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x92:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.637502:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.637506:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637515:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637523:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637531:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637546:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789518508.637554:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518508.637558:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637570:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.637574:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637582:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637593:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637601:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb335f4/0x631fd8698c784749 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637885:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.637890:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637897:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.637901:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637908:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637920:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637935:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba41c924/0x631fd8698c784750 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.637948:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.637950:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.637951:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.638819:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.638827:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.638837:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x91:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.638840:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.638845:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.638855:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.638863:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.638871:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.638888:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.638897:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.638906:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.638914:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.638918:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.638926:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.638938:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.638939:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.638949:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d4af35/0x631fd8698c784757 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.638967:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.638970:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.638972:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.639434:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.639441:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.639449:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x90:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.639452:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.639457:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.639478:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.639487:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.639494:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.639507:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518508.639835:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518508.639843:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.639852:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518508.639857:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.639878:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.639892:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.639899:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000399a7ea8/0x631fd8698c78475e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.639918:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518508.639920:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518508.639922:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.643305:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.643319:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643336:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.643341:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.643347:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643361:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643371:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643391:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643409:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518508.643422:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518508.643427:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643434:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c9e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.643439:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643448:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643463:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643471:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017ddd459/0x631fd8698c784765 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.643495:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.643497:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.643499:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.644527:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.644650:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.644663:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.644667:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.644672:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.644683:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.644692:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.644700:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.644727:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518508.644734:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518508.644742:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.644753:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29c8800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518508.644757:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.644766:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.644782:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.644802:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df0eeec/0x631fd8698c78476c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.644826:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518508.644829:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518508.644831:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.645232:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.645239:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645248:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.645251:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.645255:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645266:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645281:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645288:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645305:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518508.645323:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518508.645331:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.645341:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.645345:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.645354:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.645411:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.645426:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc5cef90/0x631fd8698c784773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.645553:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.645556:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.645558:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.645912:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.645917:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645926:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.645929:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.645933:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645944:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645954:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645962:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.645986:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789518508.646077:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789518508.646471:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.646478:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.646486:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.646489:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.646493:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.646503:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.646510:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.646517:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.646540:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789518508.646741:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518508.646748:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.646757:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.646761:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.646764:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518508.646773:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.646786:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.646794:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070243cf6/0x631fd8698c78477a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.646809:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.646811:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.646819:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.647289:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.647296:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647306:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.647313:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.647317:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647327:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647335:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647343:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647511:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518508.647936:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.647942:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647951:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x89:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.647954:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.647958:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647967:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647976:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647989:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.647998:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789518508.648119:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518508.648125:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648134:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.648138:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648146:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648170:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648178:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b72fba83/0x631fd8698c784788 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648194:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518508.648198:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648204:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.648208:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648216:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648232:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648239:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000396ffe19/0x631fd8698c78478f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.648253:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.648255:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.648257:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.649194:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.649202:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.649214:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x88:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.649218:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.649222:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.649232:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.649240:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.649248:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.649267:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518508.649572:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518508.649578:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.649587:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.649591:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.649599:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.649640:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.649649:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045c8e589/0x631fd8698c784796 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.649676:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.649678:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.649679:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.650518:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.650521:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.650523:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.650559:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.650579:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518508.650583:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.650592:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.650605:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.650637:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015508e14/0x631fd8698c784781 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.650655:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.650656:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518508.650658:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518508.651059:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518508.651066:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651077:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x87:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1789518508.651081:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518508.651086:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651096:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651103:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651109:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651130:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518508.651197:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518508.651203:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.651211:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.651215:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.651224:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.651237:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.651244:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084b6d432/0x631fd8698c78479d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.651261:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.651263:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.651265:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518508.651534:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518508.651540:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651549:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x86:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1789518508.651552:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518508.651555:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651563:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651570:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651577:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.651602:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518508.652814:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518508.652822:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.652833:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.652836:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.652844:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.652859:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.652866:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c7847a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.652885:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.652887:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.652889:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.653114:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.653124:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.653135:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x85:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.653140:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.653145:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.653166:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.653183:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.653191:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.653205:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518508.653423:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518508.653430:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.653438:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518508.653442:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.653461:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.653473:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.653479:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a99996/0x631fd8698c7847ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518508.653492:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518508.653494:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518508.653496:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.654654:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.654664:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.654678:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x84:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.654682:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.654688:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.654699:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.654709:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.654717:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.654741:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518508.654778:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518508.654786:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.654795:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.654798:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.654817:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.654832:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.654838:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f81c1a62/0x631fd8698c7847b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.654857:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.654859:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.654861:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789518508.655183:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518508.655190:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.655198:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x83:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1789518508.655202:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518508.655206:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.655216:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.655224:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.655232:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518508.655253:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518508.655293:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518508.655300:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.655308:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518508.655312:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.655319:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.655331:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.655351:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005658b2ad/0x631fd8698c7847b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518508.655372:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.655374:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518508.655376:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789518508.656121:0:32308:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:130 00000100:00100000:3.0:1789518508.656223:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:31647:x1876445627600640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 53986us (54139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518508.656233:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518508.656280:0:31647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31647:1876445627600640:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789518508.656297:0:31647:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0xa1:0x0] from OST, last_created [0x240000400:0xa1:0x0]last_used is [0x240000400:0x82:0x0] 00000100:00100000:3.0:1789518508.656413:0:31647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff665f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31647:1876445627600768:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789518508.656462:0:31647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518508.656512:0:31647:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d8eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518508.656530:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627600768 00000100:00100000:2.0:1789518508.656537:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627600768 00000100:00100000:3.0:1789518508.656660:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518508.656670:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:31647:x1876445627600768:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789518508.656703:0:32579:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 162 00000100:00100000:3.0:1789518508.663483:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:31647:x1876445627600768:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6807us (7012us total) trans 25769803777 rc 0/0 00000100:00100000:3.0:1789518508.663495:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518508.663695:0:31647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff665f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31647:1876445627600768:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789518508.663722:0:31647:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xa1:0x0]-[0x240000400:0xc1:0x0] 00010000:00010000:2.0:1789518509.236347:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518509.633789:0:32677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789518510.259707:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518510.451414:0:31656:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1789518510.451422:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518510.451720:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 2 00000040:00080000:2.0:1789518510.451726:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000001:00100000:3.0:1789518510.769525:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789518510.769542:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803777 is committed 00010000:00010000:0.0:1789518511.288469:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518512.307487:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518513.331973:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518513.711078:0:33025:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789518513.711083:0:33025:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789518513.711228:0:33025:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffc5112000 00000020:01000004:0.0:1789518513.711250:0:33025:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789518513.711265:0:33025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789518513.711283:0:33025:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99ffd10fb380) 00000020:00000080:0.0:1789518513.711303:0:33025:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789518513.727019:0:33025:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789518513.727250:0:33025:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789518513.728005:0:33025:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789518513.728197:0:33025:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789518513.728429:0:33025:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xe:0x0] (8/32) 00100000:10000000:0.0:1789518513.728996:0:33025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 495: rc = 0 00100000:10000000:0.0:1789518513.729078:0:33025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 495: rc = 0 00100000:10000000:0.0:1789518513.729150:0:33025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 495: rc = 0 00100000:10000000:0.0:1789518513.729688:0:33025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 770: rc = 0 00100000:10000000:0.0:1789518513.729946:0:33025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:0.0:1789518513.730216:0:33025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:0.0:1789518513.730666:0:33025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 770: rc = 0 00100000:10000000:0.0:1789518513.730915:0:33025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:0.0:1789518513.731179:0:33025:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 770: rc = 0 00000020:00000080:0.0:1789518513.731900:0:33025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789518513.731915:0:33025:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789518513.731925:0:33025:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c7847c7 00000020:01000004:0.0:1789518513.731935:0:33025:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789518513.731957:0:33025:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789518513.731961:0:33025:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789518513.731966:0:33025:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789518513.731989:0:33025:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789518513.731993:0:33025:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789518513.747877:0:33025:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789518513.748026:0:33025:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.151@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789518513.748031:0:33025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789518513.748033:0:33025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518513.748035:0:33025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518513.748037:0:33025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518513.748038:0:33025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518513.748040:0:33025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518513.748041:0:33025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518513.748044:0:33025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518513.748045:0:33025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518513.748050:0:33025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789518513.748052:0:33025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518513.748053:0:33025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518513.748054:0:33025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518513.748056:0:33025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518513.748057:0:33025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518513.748058:0:33025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518513.748059:0:33025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518513.748061:0:33025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518513.748062:0:33025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518513.748100:0:33025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789518513.748126:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627600896:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518513.748256:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.748341:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518513.748758:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627600896 00000100:00100000:2.0:1789518513.748774:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627600896 00000100:00100000:2.0:1789518513.748831:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789518513.748839:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+16:33025:x1876445627600896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789518513.748873:0:31619:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789518513.748877:0:31619:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789518513.748882:0:31619:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789518513.778770:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518513.778797:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627601024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518513.778874:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518513.778935:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627601024 00000100:00100000:2.0:1789518513.778944:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627601024 00000100:00100000:2.0:1789518513.779016:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518513.779026:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627601024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518513.779069:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518513.779116:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627601024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518513.779123:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789518513.779155:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518513.779184:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803777 gen 2 00000100:00100000:2.0:1789518513.779207:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627601024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518513.779427:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518513.779433:0:19561:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789518513.779438:0:19561:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f46800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518513.779443:0:19561:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 562 00000100:00080000:3.0:1789518513.779448:0:19561:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789518513.779458:0:19561:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffc4f46800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518513.779486:0:19561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffff666d80 x1876445627601152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518513.779551:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627601280:0@lo:400:kworker.0 00000100:00100000:2.0:1789518513.779669:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.780261:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518513.780284:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627601280 00000100:00100000:1.0:1789518513.780284:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627601408:0@lo:400:kworker.0 00000100:00100000:3.0:1789518513.780290:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627601280 00000100:00100000:1.0:1789518513.780324:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518513.780387:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627601152:0@lo:8:kworker.0 00000100:00100000:3.0:1789518513.780545:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627601408 00000100:00100000:3.0:1789518513.780549:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627601408 00000100:00100000:0.0:1789518513.780827:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518513.780866:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627601152 00000100:00100000:0.0:1789518513.780870:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627601152 00000100:00100000:0.0:1789518513.780896:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518513.780902:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627601152:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789518513.780924:0:32306:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789518513.781370:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518513.784430:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627601280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518513.784449:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518513.784469:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627601408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518513.784544:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627601280:12345-0@lo:400:kworker.0 Request processed in 3163us (4871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518513.784553:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518513.784661:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627601408:12345-0@lo:400:kworker.0 Request processed in 196us (4331us total) trans 0 rc 0/0 00010000:00080000:1.0:1789518513.784687:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffff667800 x1876445627601408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518513.784703:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627601408:0@lo:400:kworker.0 00000100:00080000:2.0:1789518513.784911:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789518513.784970:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffff667b80 x1876445627601280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518513.784986:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627601280:0@lo:400:kworker.0 00000100:00100000:3.0:1789518513.785163:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518513.789527:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+16:33025:x1876445627600896:12345-0@lo:253:mount.lustre.0 Request processed in 40674us (41258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518513.789545:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518513.789830:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627600896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518513.789850:0:33025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789518513.789853:0:33025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518513.789855:0:33025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518513.789857:0:33025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518513.789859:0:33025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518513.789860:0:33025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518513.789862:0:33025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518513.789863:0:33025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518513.789866:0:33025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518513.789867:0:33025:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789518513.789899:0:33025:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffc5112000 from lustre-OST0001 10000000:01000000:1.0:1789518513.789934:0:33025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789518513.789938:0:33025:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789518513.789947:0:33025:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ffc6510000 local copy 00010000:00010000:1.0:1789518513.789961:0:33025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518513.790273:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627601536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518513.792697:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.792827:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.792948:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627601536 00000100:00100000:3.0:1789518513.792960:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627601536 00000100:00100000:3.0:1789518513.793026:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789518513.793037:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:33025:x1876445627601536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518513.793452:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:33025:x1876445627601536:12345-0@lo:501:mount.lustre.0 Request processed in 416us (3133us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518513.793461:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789518513.793486:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627601536:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789518513.793511:0:33025:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789518513.794203:0:33025:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789518513.794216:0:33025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518513.794229:0:33025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518513.794265:0:33025:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffc5112000 10000000:01000000:2.0:1789518513.794271:0:33025:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789518513.794278:0:33025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789518513.794281:0:33025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518513.794286:0:33025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789518513.794289:0:33025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789518513.795012:0:33025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518513.795025:0:33025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518513.795037:0:33025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518513.795065:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627601664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518513.795152:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518513.795197:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.795401:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627601664 00000100:00100000:3.0:1789518513.795414:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627601664 00000100:00100000:3.0:1789518513.795475:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789518513.795485:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+16:33025:x1876445627601664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518513.795500:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518513.795517:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4981600/0x631fd8698c7847d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7847ce expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.795541:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4981600/0x631fd8698c7847d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7847ce expref: 17 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.795552:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4981600/0x631fd8698c7847d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7847ce expref: 17 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.795561:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981600, rc 0) 00000100:00100000:3.0:1789518513.795739:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627601664:12345-0@lo:101:mount.lustre.0 Request processed in 255us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.795746:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789518513.796140:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627601664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518513.796158:0:33025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518513.797471:0:33025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518513.798372:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627601152:12345-0@lo:8:kworker.0 Request processed in 17458us (17535us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789518513.798389:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789518513.798868:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f46800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518513.798882:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789518513.798887:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627601152:0@lo:8:kworker.0 00000040:00080000:1.0:1789518513.799357:0:33025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000040:00080000:1.0:1789518513.801305:0:33025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518513.801524:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:1.0:1789518513.801562:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:1.0:1789518513.801590:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:1.0:1789518513.801672:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:1.0:1789518513.801704:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:1.0:1789518513.802311:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:1.0:1789518513.802366:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:1.0:1789518513.802396:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:1.0:1789518513.802434:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 120 off9752 00000040:00080000:1.0:1789518513.803589:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9976 00000040:00080000:1.0:1789518513.803607:0:33025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 10 count 11 00000100:00100000:1.0:1789518513.803721:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627601792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518513.803928:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.804035:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.806063:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627601792 00000100:00100000:3.0:1789518513.806076:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627601792 00000100:00100000:3.0:1789518513.806125:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789518513.806144:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627601792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518513.806927:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627601792:12345-0@lo:501:mount.lustre.0 Request processed in 793us (2997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.806936:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789518513.807015:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627601792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518513.807060:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627601920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518513.807103:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.807183:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.807273:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627601920 00000100:00100000:3.0:1789518513.807277:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627601920 00000100:00100000:3.0:1789518513.807307:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789518513.807314:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627601920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518513.807662:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627601920:12345-0@lo:503:mount.lustre.0 Request processed in 347us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.807670:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789518513.807921:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627601920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518513.808449:0:33025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518513.808509:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518513.808547:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.808582:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.808689:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627602048 00000100:00100000:3.0:1789518513.808695:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627602048 00000100:00100000:3.0:1789518513.808734:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789518513.808743:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627602048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518513.808913:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627602048:12345-0@lo:502:mount.lustre.0 Request processed in 171us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.808921:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789518513.809077:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518513.809317:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:1.0:1789518513.809361:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:1.0:1789518513.809389:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:1.0:1789518513.809428:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:1.0:1789518513.809466:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:1.0:1789518513.809503:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:1.0:1789518513.809549:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:1.0:1789518513.809578:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:1.0:1789518513.809645:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 120 off9752 00000100:00100000:1.0:1789518513.809674:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518513.809714:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518513.810842:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627602176 00000100:00100000:3.0:1789518513.810853:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627602176 00000100:00100000:3.0:1789518513.810907:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789518513.810917:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627602176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518513.811147:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.814481:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627602176:12345-0@lo:502:mount.lustre.0 Request processed in 3555us (4755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.814495:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789518513.816319:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518513.816450:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9976 00000040:00080000:1.0:1789518513.816463:0:33025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789518513.819272:0:33028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789518513.819286:0:33028:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789518513.819294:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518513.819297:0:33028:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789518513.819309:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789518513.819344:0:33028:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99fff783cd40) 00000020:00000080:2.0:1789518513.822098:0:33028:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789518513.822219:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789518513.822350:0:33028:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc5112000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789518513.822361:0:33028:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789518513.822372:0:33028:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c7847e3 00010000:00010000:2.0:1789518513.827341:0:33028:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789518513.827842:0:33028:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 21474836481 00080000:10000000:2.0:1789518513.829455:0:33028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xf:0x0] (8/8/4) registered 00000020:00000080:2.0:1789518513.831083:0:33028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789518513.831098:0:33028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518513.831106:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518513.831109:0:33028:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789518513.831112:0:33028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518513.831117:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518513.831118:0:33028:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789518513.831121:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789518513.831123:0:33028:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789518513.831125:0:33028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518513.831127:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518513.831129:0:33028:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789518513.831143:0:33028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789518513.831147:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518513.831148:0:33028:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789518513.831151:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789518513.831230:0:33028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789518513.831234:0:33028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789518513.831236:0:33028:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789518513.831242:0:33028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 11 count 11 00000020:01000000:1.0:1789518513.831445:0:33025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789518513.831478:0:33025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789518513.831505:0:33025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518513.831519:0:33025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518513.831541:0:33025:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc5112000 from 1 10000000:01000000:1.0:1789518513.831544:0:33025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518513.831589:0:33025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518513.831597:0:33025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518513.831639:0:33025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518513.831680:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518513.831761:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.831807:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518513.831890:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627602304 00000100:00100000:2.0:1789518513.831899:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627602304 00000100:00100000:2.0:1789518513.831951:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789518513.831962:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+17:33025:x1876445627602304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518513.831978:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518513.831992:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7847ea expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518513.832021:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7847ea expref: 18 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518513.832033:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7847ea expref: 18 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518513.832043:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17c00, rc 0) 00000100:00100000:2.0:1789518513.832088:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602304:12345-0@lo:101:mount.lustre.0 Request processed in 127us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518513.832095:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518513.832197:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518513.832213:0:33025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518513.832222:0:33025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518513.834144:0:33025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000040:00080000:1.0:1789518513.834943:0:33025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518513.835206:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:1.0:1789518513.835252:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:1.0:1789518513.835302:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:1.0:1789518513.835341:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:1.0:1789518513.835375:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:1.0:1789518513.835436:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:1.0:1789518513.835474:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 224 off9536 00000040:00080000:1.0:1789518513.835508:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 128 off9664 00000040:00080000:1.0:1789518513.835573:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:1.0:1789518513.835582:0:33025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 9 count 10 00000100:00100000:1.0:1789518513.835890:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518513.835977:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.836024:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.836141:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627602432 00000100:00100000:3.0:1789518513.836151:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627602432 00000100:00100000:3.0:1789518513.836207:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518513.836218:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518513.836548:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602432:12345-0@lo:501:mount.lustre.0 Request processed in 331us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.836556:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789518513.837384:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518513.837440:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518513.837503:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.837600:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518513.837841:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627602560 00000100:00100000:2.0:1789518513.837848:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627602560 00000100:00100000:2.0:1789518513.837932:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789518513.837942:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc3b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518513.840715:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc3b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602560:12345-0@lo:503:mount.lustre.0 Request processed in 2767us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518513.840731:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789518513.841859:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789518513.842589:0:33025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789518513.842747:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518513.842831:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.842883:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.842964:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627602688 00000100:00100000:3.0:1789518513.842973:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627602688 00000100:00100000:3.0:1789518513.843030:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789518513.843040:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec483bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518513.843314:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec483bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602688:12345-0@lo:502:mount.lustre.0 Request processed in 275us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.843323:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518513.845925:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518513.846286:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:1.0:1789518513.846354:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:1.0:1789518513.846400:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:1.0:1789518513.846435:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:1.0:1789518513.846465:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000040:00080000:1.0:1789518513.846509:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:1.0:1789518513.846544:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 224 off9536 00000040:00080000:1.0:1789518513.846581:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 128 off9664 00000100:00100000:1.0:1789518513.846662:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518513.846752:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.846798:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.848994:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627602816 00000100:00100000:3.0:1789518513.849011:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627602816 00000100:00100000:3.0:1789518513.849176:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789518513.849193:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518513.849544:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602816:12345-0@lo:502:mount.lustre.0 Request processed in 357us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.849553:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518513.849854:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518513.850040:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:1.0:1789518513.850059:0:33025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789518513.852364:0:33032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518513.852381:0:33032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518513.852397:0:33032:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789518513.852407:0:33032:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc5112000 00000020:00000080:1.0:1789518513.852409:0:33032:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518513.852418:0:33032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518513.852420:0:33032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518513.852421:0:33032:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789518513.852424:0:33032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518513.852426:0:33032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518513.852427:0:33032:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789518513.852430:0:33032:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc5112000 00000020:00000080:1.0:1789518513.852432:0:33032:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518513.852500:0:33032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518513.852504:0:33032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518513.852506:0:33032:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789518513.852509:0:33032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789518513.852511:0:33032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518513.852512:0:33032:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789518513.852515:0:33032:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffc5112000 00000020:00000080:1.0:1789518513.852518:0:33032:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789518513.852555:0:33032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789518513.852950:0:33032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789518513.852952:0:33032:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789518513.852956:0:33032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000020:01000000:3.0:1789518513.853319:0:33025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789518513.853349:0:33025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518513.853450:0:33025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.853464:0:33025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518513.853519:0:33025:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789518513.853523:0:33025:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffc5112000 10000000:01000000:3.0:1789518513.853526:0:33025:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffc5112000 10000000:01000000:3.0:1789518513.853531:0:33025:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518513.853537:0:33025:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc5112000 from 1 10000000:01000000:3.0:1789518513.853540:0:33025:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518513.853895:0:33025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.853906:0:33025:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.853919:0:33025:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518513.853950:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518513.854043:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518513.854111:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd91349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518513.854112:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627602944 00000100:00100000:2.0:1789518513.854207:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627602944 00000100:00100000:3.0:1789518513.854377:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789518513.854392:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec483a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627602944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518513.854407:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518513.854426:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4981000/0x631fd8698c7847ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7847f8 expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.854594:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4981000/0x631fd8698c7847ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7847f8 expref: 19 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.854606:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4981000/0x631fd8698c7847ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7847f8 expref: 19 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.854649:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981000, rc 0) 00000100:00100000:3.0:1789518513.854912:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec483a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627602944:12345-0@lo:101:mount.lustre.0 Request processed in 524us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.854921:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789518513.855156:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627602944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518513.855191:0:33025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518513.855203:0:33025:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518513.856706:0:33025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000040:00080000:1.0:1789518513.857115:0:33025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518513.857454:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:1.0:1789518513.857504:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:1.0:1789518513.857545:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:1.0:1789518513.857651:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:1.0:1789518513.857695:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:1.0:1789518513.857765:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:1.0:1789518513.857805:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:1.0:1789518513.857838:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:1.0:1789518513.857885:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:1.0:1789518513.857923:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:1.0:1789518513.857960:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:1.0:1789518513.858008:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:1.0:1789518513.858045:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:1.0:1789518513.858102:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:1.0:1789518513.858173:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:1.0:1789518513.858213:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:1.0:1789518513.858249:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:1.0:1789518513.858312:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:1.0:1789518513.858381:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:1.0:1789518513.858457:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:1.0:1789518513.859542:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:1.0:1789518513.859604:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:1.0:1789518513.859737:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:1.0:1789518513.859883:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:1.0:1789518513.859924:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 128 off12440 00000040:00080000:1.0:1789518513.859962:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12664 00000040:00080000:1.0:1789518513.860177:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12888 00000040:00080000:1.0:1789518513.860233:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off12968 00000040:00080000:1.0:1789518513.861513:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13192 00000040:00080000:1.0:1789518513.861668:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13416 00000040:00080000:1.0:1789518513.861717:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13504 00000040:00080000:1.0:1789518513.861757:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13632 00000040:00080000:1.0:1789518513.862125:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13776 00000040:00080000:1.0:1789518513.862199:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13904 00000040:00080000:1.0:1789518513.862234:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14128 00000040:00080000:1.0:1789518513.862350:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14352 00000040:00080000:1.0:1789518513.862466:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14432 00000040:00080000:1.0:1789518513.862504:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14656 00000040:00080000:1.0:1789518513.862553:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14880 00000040:00080000:1.0:1789518513.862590:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 120 off15000 00000040:00080000:1.0:1789518513.862721:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 224 off15224 00000040:00080000:1.0:1789518513.862729:0:33025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 41 count 42 00000100:00100000:1.0:1789518513.862926:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518513.863159:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.863214:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.864106:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627603072 00000100:00100000:3.0:1789518513.864121:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627603072 00000100:00100000:3.0:1789518513.864192:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518513.864204:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627603072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518513.864542:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627603072:12345-0@lo:501:mount.lustre.0 Request processed in 341us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.864552:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789518513.870484:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518513.870543:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518513.870648:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518513.870691:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627603200 00000100:00100000:2.0:1789518513.870696:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627603200 00000100:00100000:2.0:1789518513.870748:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789518513.870760:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627603200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518513.871226:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627603200:12345-0@lo:503:mount.lustre.0 Request processed in 469us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518513.871238:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789518513.871300:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5dce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518513.871315:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603200:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789518513.872052:0:33025:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518513.872145:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518513.872202:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518513.872241:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627603328 00000100:00100000:3.0:1789518513.872250:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627603328 00000100:00100000:2.0:1789518513.872255:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.872297:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518513.872307:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627603328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518513.872541:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627603328:12345-0@lo:502:mount.lustre.0 Request processed in 236us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.872549:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789518513.872849:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518513.874109:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:3.0:1789518513.874196:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:3.0:1789518513.874252:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:3.0:1789518513.874317:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:3.0:1789518513.874363:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:3.0:1789518513.874423:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:3.0:1789518513.874461:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:3.0:1789518513.874485:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:3.0:1789518513.874518:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:3.0:1789518513.874539:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:3.0:1789518513.874575:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:3.0:1789518513.874650:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:3.0:1789518513.874694:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:3.0:1789518513.874726:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:3.0:1789518513.874770:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:3.0:1789518513.874802:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:3.0:1789518513.874897:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:3.0:1789518513.874963:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:3.0:1789518513.874995:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:3.0:1789518513.875037:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:3.0:1789518513.875076:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:3.0:1789518513.875116:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:3.0:1789518513.875180:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:3.0:1789518513.875253:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:3.0:1789518513.875307:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 128 off12440 00000040:00080000:3.0:1789518513.875356:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12664 00000040:00080000:3.0:1789518513.875431:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12888 00000040:00080000:3.0:1789518513.875481:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off12968 00000040:00080000:3.0:1789518513.875524:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13192 00000040:00080000:3.0:1789518513.875572:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13416 00000040:00080000:3.0:1789518513.875610:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13504 00000040:00080000:3.0:1789518513.875667:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13632 00000040:00080000:3.0:1789518513.875703:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13776 00000040:00080000:3.0:1789518513.875750:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13904 00000040:00080000:3.0:1789518513.875785:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14128 00000040:00080000:3.0:1789518513.875855:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14352 00000040:00080000:3.0:1789518513.875918:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14432 00000040:00080000:3.0:1789518513.875973:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14656 00000040:00080000:3.0:1789518513.876040:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14880 00000040:00080000:3.0:1789518513.876087:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 120 off15000 00000100:00100000:3.0:1789518513.876142:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518513.876206:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518513.876236:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6926b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518513.876538:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627603456 00000100:00100000:2.0:1789518513.876546:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627603456 00000100:00100000:2.0:1789518513.876589:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789518513.876598:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627603456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518513.876878:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627603456:12345-0@lo:502:mount.lustre.0 Request processed in 280us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518513.876895:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789518513.879370:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518513.879495:0:33025:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 224 off15224 00000040:00080000:1.0:1789518513.879510:0:33025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789518513.884441:0:33037:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789518513.884458:0:33037:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99fff4203380) 00000020:00000080:3.0:1789518513.884480:0:33037:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789518513.884565:0:33037:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc5112000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789518513.884569:0:33037:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc5112000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789518513.884571:0:33037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc5112000 3 00010000:00080000:3.0:1789518513.885194:0:33037:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fec3ad8800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518513.890111:0:33037:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789518513.890310:0:33037:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789518513.890347:0:33037:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518513.890359:0:33037:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x631fd8698c78480d 00000100:00080000:3.0:1789518513.890368:0:33037:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518513.890378:0:33037:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fec3ad8800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518513.890410:0:33037:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffff666300 x1876445627603584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518513.890443:0:33037:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518513.890487:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627603584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518513.890551:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518513.890577:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627603584 00000100:00100000:3.0:1789518513.890583:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627603584 00000100:00100000:3.0:1789518513.890636:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518513.890644:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627603584:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789518513.890665:0:31624:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:3.0:1789518513.890698:0:31624:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x631fd8698c784814 00000040:00080000:2.0:1789518513.890779:0:33037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000020:01000000:1.0:1789518513.890941:0:33025:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789518513.890965:0:33025:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518513.890987:0:33025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518513.891004:0:33025:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518513.891044:0:33025:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518513.891046:0:33025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518513.891047:0:33025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518513.891048:0:33025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518513.891050:0:33025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518513.891051:0:33025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518513.891052:0:33025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518513.891054:0:33025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518513.891055:0:33025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518513.891059:0:33025:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789518513.891061:0:33025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518513.891062:0:33025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518513.891063:0:33025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518513.891064:0:33025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518513.891065:0:33025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518513.891066:0:33025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518513.891067:0:33025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518513.891068:0:33025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518513.891069:0:33025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518513.891082:0:33025:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789518513.891092:0:33025:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518513.891126:0:33025:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518513.891166:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627603712 00000100:00100000:1.0:1789518513.891170:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627603712 00000100:00100000:1.0:1789518513.891198:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789518513.891204:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfdc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+19:33025:x1876445627603712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518513.891225:0:31616:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789518513.891235:0:31616:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000004:00100000:3.0:1789518513.892647:0:31624:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789518513.892687:0:31624:0:(import.c:65:import_set_state_nolock()) ffff99fec3adf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518513.892744:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876445627603584:12345-0@lo:38:llog_process_th.0 Request processed in 2098us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.892753:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789518513.892805:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffff666300 x1876445627603584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518513.892817:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518513.892825:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 6 00000100:00080000:3.0:1789518513.892832:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789518513.892836:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789518513.892838:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec3ad8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789518513.892843:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627603584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518513.894364:0:33025:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe840 going to sleep for 11 seconds 20000000:01000000:3.0:1789518513.929672:0:31616:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789518513.929686:0:31616:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789518513.929698:0:31640:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789518513.929704:0:31640:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789518513.929726:0:31640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.929761:0:31640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7846d2 expref: 19 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.929770:0:31640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.929804:0:31640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c7846d2 expref: 19 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.929818:0:31640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c7846d2 expref: 19 pid: 31616 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518513.929833:0:31640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31640:1876445627603840:0@lo:104: 00000100:00100000:0.0:1789518513.929888:0:31640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518513.929931:0:31640:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518513.930079:0:31607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627603840 00000100:00100000:3.0:1789518513.930085:0:31607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627603840 00000100:00100000:3.0:1789518513.930141:0:31607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518513.930151:0:31607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:31640:x1876445627603840:12345-0@lo:104: 00010000:00010000:3.0:1789518513.930167:0:31607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930230:0:31607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518513.930237:0:31607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:31640:x1876445627603840:12345-0@lo:104: Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.930245:0:31607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789518513.930357:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518513.930363:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.930371:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518513.930374:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.930382:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518513.930389:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518513.930405:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789518513.930436:0:32583:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.930442:0:32583:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518513.930526:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.930533:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd600/0x631fd8698c7846d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7846d9 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.930551:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518513.930553:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518513.930555:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518513.930561:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518513.930572:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627603968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518513.930600:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518513.930662:0:31610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627603968 00000100:00100000:3.0:1789518513.930667:0:31610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627603968 00010000:00010000:3.0:1789518513.930681:0:31610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7846d2 expref: 20 pid: 31616 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518513.930689:0:31640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31640:1876445627603840:0@lo:104: 00000100:00100000:3.0:1789518513.930702:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518513.930708:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f013254-1301-45d1-9493-6d558799b39e+20:3282:x1876445627603968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518513.930712:0:31640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930715:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518513.930722:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7846d2 expref: 20 pid: 31616 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930732:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7846d2 expref: 20 pid: 31616 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930741:0:31610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd000/0x631fd8698c7846d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7846d2 expref: 20 pid: 31616 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930750:0:31610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930756:0:31610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789518513.930763:0:31610:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001060491s 00010000:00010000:3.0:1789518513.930766:0:31610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930770:0:31610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930775:0:31610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930785:0:31610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930803:0:31610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518513.930807:0:31610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930814:0:31610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930832:0:31610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518513.930843:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518513.930876:0:31640:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.930887:0:31640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518513.930894:0:31640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0696200/0x631fd8698c78481b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518513.931264:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f013254-1301-45d1-9493-6d558799b39e+19:3282:x1876445627603968:12345-0@lo:103:ldlm_bl.0 Request processed in 555us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.931270:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518513.931494:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627603968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518513.942261:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfdc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+18:33025:x1876445627603712:12345-0@lo:253:mount.lustre.0 Request processed in 51046us (51124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518513.942275:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789518513.942360:0:33025:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f013254-1301-45d1-9493-6d558799b39e:33025:1876445627603712:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518513.942388:0:33025:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789518513.942391:0:33025:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518513.942393:0:33025:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518513.942394:0:33025:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518513.942396:0:33025:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518513.942397:0:33025:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518513.942398:0:33025:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518513.942400:0:33025:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518513.942401:0:33025:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518513.942403:0:33025:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789518513.942415:0:33025:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789518513.942922:0:33025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518513.943236:0:33025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518513.943395:0:33025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518513.943555:0:33025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789518513.943838:0:33025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789518513.944214:0:33025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789518513.944964:0:33025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803776 00002000:00080000:1.0:1789518514.012488:0:33025:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789518514.012497:0:33025:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789518514.012530:0:33025:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789518514.014444:0:33025:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789518514.014470:0:33025:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789518514.014509:0:33025:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789518514.355971:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789518515.123692:0:31621:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518515.123701:0:31621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ffe6225800 from 20 10000000:01000000:3.0:1789518515.123707:0:31621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518515.123752:0:31621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518515.123764:0:31621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518515.123796:0:31621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518515.123820:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627604096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518515.123879:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518515.123931:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518515.124173:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627604096 00000100:00100000:2.0:1789518515.124181:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627604096 00000100:00100000:2.0:1789518515.124298:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789518515.124315:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+18:31621:x1876445627604096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518515.124328:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518515.124341:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17000/0x631fd8698c784829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784822 expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518515.124363:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17000/0x631fd8698c784829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784822 expref: 19 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518515.124375:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b17000/0x631fd8698c784829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784822 expref: 19 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518515.124383:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17000, rc 0) 00000100:00100000:2.0:1789518515.124428:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+19:31621:x1876445627604096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518515.124435:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518515.124458:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627604096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518515.124471:0:31621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518515.124481:0:31621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518515.124527:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627604224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518515.124559:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518515.124586:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518515.124642:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627604224 00000100:00100000:1.0:1789518515.124646:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627604224 00000100:00100000:1.0:1789518515.124676:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789518515.124684:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+19:31621:x1876445627604224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789518515.124698:0:31616:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789518515.124714:0:31616:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789518515.124717:0:31616:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 20 00000100:00100000:1.0:1789518515.124812:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+19:31621:x1876445627604224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518515.124819:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789518515.125383:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627604224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789518515.125458:0:31621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789518515.125466:0:31621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518515.125475:0:31621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518515.386980:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518516.409858:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518517.427936:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518518.365451:0:33381:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789518518.450947:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518518.900076:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627604480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518518.900086:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f013254-1301-45d1-9493-6d558799b39e:3280:1876445627604352:0@lo:400:kworker.0 00000100:00100000:0.0:1789518518.900388:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518518.900505:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627604480 00000100:00100000:3.0:1789518518.900513:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627604480 00000100:00100000:1.0:1789518518.900521:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518518.900586:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789518518.900587:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518518.900600:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627604480:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518518.900605:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627604352 00000100:00100000:1.0:1789518518.900611:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627604352 00002000:00000024:3.0:1789518518.900653:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518518.900662:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789518518.900671:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+19:3280:x1876445627604352:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518518.900689:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789518518.900695:0:19561:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789518518.900699:0:19561:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f46800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789518518.900700:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627604480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00080000:2.0:1789518518.900704:0:19561:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 567 00000100:00100000:3.0:1789518518.900707:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789518518.900708:0:19561:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789518518.900719:0:19561:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffc4f46800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518518.900725:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+19:3280:x1876445627604352:12345-0@lo:400:kworker.0 Request processed in 54us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518518.900733:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789518518.900741:0:19561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffd846e300 x1876445627604608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518518.900781:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f013254-1301-45d1-9493-6d558799b39e:3280:1876445627604352:0@lo:400:kworker.0 00000100:00100000:3.0:1789518518.900790:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627604608:0@lo:8:kworker.0 00000100:00100000:3.0:1789518518.900830:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518518.900859:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627604864:0@lo:400:kworker.0 00000100:00100000:2.0:1789518518.900864:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627604736:0@lo:400:kworker.0 00000100:00100000:3.0:1789518518.900884:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518518.900899:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627604608 00000100:00100000:2.0:1789518518.900902:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627604608 00000100:00100000:3.0:1789518518.900914:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627604864 00000100:00100000:3.0:1789518518.900916:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627604864 00000100:00100000:2.0:1789518518.900923:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518518.900928:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3279:x1876445627604608:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789518518.900944:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789518518.900947:0:32579:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000100:00100000:3.0:1789518518.900950:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627604864:12345-0@lo:400:kworker.0 00000020:00000080:2.0:1789518518.900970:0:32579:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c784830 00000100:00100000:3.0:1789518518.900980:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627604864:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00002000:00100000:2.0:1789518518.900982:0:32579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99fec4893800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:3.0:1789518518.900985:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00002000:00080000:2.0:1789518518.900986:0:32579:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789518518.900988:0:32579:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789518518.901001:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518518.901036:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627604736 00000100:00100000:3.0:1789518518.901040:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627604736 00000100:00100000:3.0:1789518518.901058:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518518.901063:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627604736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518518.901093:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627604736:12345-0@lo:400:kworker.0 Request processed in 28us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518518.901098:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518518.901125:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627604992:0@lo:400:kworker.0 00000100:00100000:1.0:1789518518.901153:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518518.901169:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627604992 00000100:00100000:3.0:1789518518.901174:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627604992 00000100:00100000:3.0:1789518518.901195:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518518.901200:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627604992:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789518518.901206:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518518.901233:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627604992:12345-0@lo:400:kworker.0 Request processed in 32us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518518.901241:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789518518.901255:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd846ca80 x1876445627604992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518518.901267:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627604992:0@lo:400:kworker.0 00010000:00080000:3.0:1789518518.901271:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd846df80 x1876445627604736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518518.901293:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627604736:0@lo:400:kworker.0 00010000:00080000:3.0:1789518518.901327:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd846c700 x1876445627604864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518518.901336:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627604864:0@lo:400:kworker.0 00000100:00100000:0.0:1789518518.902045:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627604480:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1789518518.905947:0:32579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789518518.905979:0:32579:0:(import.c:65:import_set_state_nolock()) ffff99fec4894000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518518.906059:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627604608:12345-0@lo:8:kworker.0 Request processed in 5128us (5226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518518.906082:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789518518.906318:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffd846e300 x1876445627604608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518518.906330:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789518518.906338:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 6 00000100:00080000:3.0:1789518518.906346:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789518518.906352:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789518518.906355:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f46800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789518518.906383:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789518518.906388:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627604608:0@lo:8:kworker.0 00000004:00080000:2.0:1789518518.906427:0:31648:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789518518.906577:0:31649:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x63:0x0] 00000100:00100000:0.0:1789518518.906597:0:31649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:31649:1876445627605248:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789518518.906651:0:31649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518518.906671:0:31649:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518518.906688:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627605248 00000100:00100000:0.0:1789518518.906693:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627605248 00000100:00100000:0.0:1789518518.906734:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518518.906742:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:31649:x1876445627605248:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789518518.906832:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518518.906844:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627605120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518518.906880:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789518518.906917:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789518518.906954:0:31648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 572903338916ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789518518.907131:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627605120 00000100:00100000:3.0:1789518518.907136:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627605120 00000100:00100000:3.0:1789518518.907171:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518518.907180:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627605120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518518.907203:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789518518.907252:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627605120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518518.907259:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789518518.907460:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff78aad80 x1876445627605120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518518.907479:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627605120:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1789518518.911192:0:32306:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789518518.911206:0:32306:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -62 00002000:02000040:1.0:1789518518.911212:0:32306:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:100 to 0x280000400:161) 00002000:00010000:1.0:1789518518.922910:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.922922:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.922939:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa1:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.922944:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.922951:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.922969:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.923451:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.923462:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.923482:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.923495:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.923500:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.923507:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.923512:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.923527:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.923543:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.923550:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c23681fb/0x631fd8698c784837 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.923567:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.923569:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.923571:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.924512:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.924519:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.924530:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa0:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.924534:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.924539:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.924550:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.925121:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.925137:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.925212:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.925226:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.925231:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.925240:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.925244:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.925254:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.925268:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.925276:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e776192/0x631fd8698c78483e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.925292:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.925293:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.925295:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.927745:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.927763:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927779:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9f:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.927784:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.927790:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927803:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927813:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927821:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927845:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.927857:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.927862:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927869:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.927874:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927883:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927911:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927919:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ae35cf/0x631fd8698c784845 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.927935:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.927937:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.927939:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.929061:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.929070:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929083:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9e:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.929087:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.929091:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929102:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929121:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929128:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929158:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.929170:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.929175:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929183:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.929187:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929196:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929210:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929218:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c7ac99/0x631fd8698c78484c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929234:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.929236:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.929238:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.929811:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.929818:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929827:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9d:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.929835:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.929839:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929847:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929855:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.929861:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.930011:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518518.930291:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518518.930298:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.930307:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518518.930310:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.930319:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.930333:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.930340:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efd70a09/0x631fd8698c784853 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.930421:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518518.930423:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518518.930425:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.931321:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.931328:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931339:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9c:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.931342:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.931347:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931357:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931366:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931379:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931396:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.931406:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.931411:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931418:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.931423:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931432:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931446:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931453:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac4cc14/0x631fd8698c78485a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931475:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.931477:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.931481:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.931910:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.931923:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931932:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9b:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.931935:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.931940:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931950:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931959:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931966:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.931981:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.932361:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.932367:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.932375:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b44400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.932379:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.932389:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.932415:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.932423:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bfb84fa/0x631fd8698c784861 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.932448:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.932452:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.932455:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.933368:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.933375:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933385:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9a:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.933388:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.933392:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933402:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933411:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933418:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933451:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.933462:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.933467:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933474:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.933478:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933486:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933498:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933505:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054b8987d/0x631fd8698c784868 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.933520:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.933521:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.933523:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.934208:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.934216:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934227:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x99:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.934237:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.934243:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934254:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934262:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934269:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934287:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.934310:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.934315:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934324:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.934328:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934336:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934350:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934369:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000062625cd/0x631fd8698c78486f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934392:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.934395:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.934399:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.934824:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.934830:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934838:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x98:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.934842:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.934846:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934856:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934863:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934871:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.934888:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518518.935070:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518518.935077:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935086:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518518.935090:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935098:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935123:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935131:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b50340b/0x631fd8698c784876 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935149:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.935151:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.935153:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.935425:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.935436:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.935445:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x97:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.935448:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.935452:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.935461:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.935471:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.935479:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.935503:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518518.935560:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518518.935566:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935586:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518518.935589:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935597:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935607:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935629:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c78487d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.935642:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.935644:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.935645:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.937825:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.937836:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.937851:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x96:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.937855:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.937860:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.937872:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.937889:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.937967:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.938219:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518518.938948:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518518.938956:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.938967:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518518.938972:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.938992:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.939009:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.939016:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784884 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518518.939035:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518518.939037:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518518.939038:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.939129:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.939136:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.939214:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x95:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.939219:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.939224:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.939237:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.939246:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.939255:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.939282:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518518.939412:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518518.939419:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.939428:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518518.939432:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.939440:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.939457:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.939464:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b85e1c3/0x631fd8698c78488b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.939480:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.939482:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.939484:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.940114:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.940122:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.940132:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x94:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.940136:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.940139:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.940217:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.940227:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.940234:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.940255:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789518518.941154:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.941161:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941170:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x93:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.941180:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.941185:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941195:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941204:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941211:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941228:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789518518.941238:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518518.941243:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941251:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.941255:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941263:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941277:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941480:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5b9c7b0/0x631fd8698c784892 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941500:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.941504:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941510:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.941514:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941522:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941532:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941538:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000912b7800/0x631fd8698c784899 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.941549:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.941551:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.941553:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.942088:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.942095:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942121:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x92:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.942124:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.942128:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942140:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942149:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942156:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942174:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.942185:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.942191:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942199:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.942202:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942210:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942233:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942241:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c7848a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942259:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.942261:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.942264:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.942904:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.942912:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942922:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x91:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.942926:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.942931:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942941:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942951:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.942958:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943201:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.943210:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.943215:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943222:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.943226:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943234:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943246:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943253:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043c63214/0x631fd8698c7848a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943268:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.943270:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.943272:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.943772:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.943778:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943787:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x90:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.943798:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.943803:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943814:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943822:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943830:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943846:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.943855:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.943859:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943866:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.943869:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943877:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943889:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.943894:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.943909:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba14c2c/0x631fd8698c7848ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.943925:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.943928:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.943929:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.944814:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.944821:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.944831:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8f:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.944835:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.944840:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.944850:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.944857:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.944864:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.944930:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789518518.945501:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.945513:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.945522:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8e:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.945526:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.945530:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.945540:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.945548:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.945556:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946692:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518518.946702:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946712:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518518.946717:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946727:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946745:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946753:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001672fcc/0x631fd8698c7848b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946785:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518518.946789:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946796:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518518.946799:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946807:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946818:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.946826:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.946828:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.946831:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518518.947003:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.947004:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789518518.947011:0:32306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000600444e7/0x631fd8698c7848bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518518.947708:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.947714:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947725:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8d:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.947729:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.947740:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947753:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947761:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947767:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947783:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.947794:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.947797:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947803:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.947806:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947814:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947824:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947840:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a242002b/0x631fd8698c7848c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.947853:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.947855:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.947856:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.948597:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.948604:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948650:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8c:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.948654:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.948658:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948667:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948675:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948682:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948698:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.948708:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.948719:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948726:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.948730:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948738:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948750:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948758:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c7848ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.948772:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.948773:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.948775:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.952328:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.952343:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952358:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8b:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.952362:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.952368:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952393:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952403:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952410:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952438:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789518518.952905:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.952911:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952920:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8a:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.952923:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.952927:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952936:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952944:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952963:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.952979:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789518518.952998:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518518.953003:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953010:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.953015:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953023:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953039:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953047:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c7848d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953063:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.953066:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953082:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.953085:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953092:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953102:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953119:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.953133:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.953135:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.953137:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.954115:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.954123:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954135:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x89:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.954139:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.954144:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954155:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954169:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954175:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954195:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.954208:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.954213:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954220:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.954224:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954231:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954243:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954250:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c7848df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.954266:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.954274:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.954276:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518518.955159:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.955252:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.955259:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955272:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x88:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.955276:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.955281:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955292:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955301:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955310:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955326:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518518.955336:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518518.955411:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955419:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518518.955423:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955444:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955457:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955465:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955479:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.955481:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.955483:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.955889:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.955895:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955904:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x87:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.955907:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.955912:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955922:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955930:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955943:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.955964:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518518.956072:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518518.956078:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.956087:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518518.956090:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.956121:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.956137:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.956144:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089c68ca2/0x631fd8698c7848ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.956165:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518518.956167:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518518.956169:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.961449:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.961461:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.961482:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x86:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.961487:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.961493:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.961506:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.961516:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.961524:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.961597:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518518.961655:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518518.961672:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.961682:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518518.961687:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.961698:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.961716:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.961735:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1eb917/0x631fd8698c7848f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518518.961751:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518518.961753:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518518.961755:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789518518.963854:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789518518.966902:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.966919:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.966942:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x85:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.966948:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.966954:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.966969:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.966978:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.966985:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.967011:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518518.967297:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518518.967382:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.967390:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518518.967394:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.967414:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.967431:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.967437:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c7848fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.967454:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.967456:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.967458:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789518518.968971:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.968981:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.968996:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.969000:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.969005:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.969018:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.969038:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.969045:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.969102:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789518518.969586:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.969592:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.969600:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x83:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.969603:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.969607:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.969644:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.969652:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.969659:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970117:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518518.970125:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970133:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518518.970137:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970146:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970162:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970183:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784902 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970208:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518518.970212:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970219:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518518.970222:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970229:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970239:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.970246:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.970248:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.970250:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.970318:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789518518.970323:0:32306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6dd398e/0x631fd8698c784909 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518518.971095:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518518.971101:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.971124:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82:0x0].0x0 since=572s v=(0 0) 00010000:00010000:1.0:1789518518.971128:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518518.971133:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.971145:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.971153:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518518.971159:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.973742:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518518.973756:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.973778:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518518.973791:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.973802:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.973823:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.973832:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.973834:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518518.973836:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518518.974866:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789518518.974878:0:32306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000102d10c0/0x631fd8698c784910 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518518.975395:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789518518.975996:0:32306:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:99 00000100:00100000:1.0:1789518518.976090:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:31649:x1876445627605248:12345-0@lo:5:osp-pre-1-0.0 Request processed in 69345us (69435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518518.976103:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518518.977146:0:31649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:31649:1876445627605248:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789518518.977167:0:31649:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0xa1:0x0] from OST, last_created [0x280000400:0xa1:0x0]last_used is [0x280000400:0x63:0x0] 00000100:00100000:2.0:1789518518.977217:0:31649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:31649:1876445627605376:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789518518.977260:0:31649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518518.977321:0:31649:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc61540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518518.978857:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627605376 00000100:00100000:1.0:1789518518.978872:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627605376 00000100:00100000:1.0:1789518518.978965:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518518.978976:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:31649:x1876445627605376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789518518.979020:0:32308:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 162 00000100:00100000:1.0:1789518518.983359:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:31649:x1876445627605376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4380us (6094us total) trans 25769803777 rc 0/0 00000100:00100000:1.0:1789518518.983371:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518518.983484:0:31649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:31649:1876445627605376:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789518518.983499:0:31649:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xa1:0x0]-[0x280000400:0xc1:0x0] 00000001:00080000:1.0:1789518519.461808:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803777 is committed 00000001:00100000:1.0:1789518519.461851:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789518519.475896:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518519.925875:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518519.925918:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617202944 00000100:00100000:3.0:1789518519.925932:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617202944 00000100:00100000:3.0:1789518519.925988:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:3.0:1789518519.925997:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2341:x1876445617202944:12345-192.168.206.51@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789518519.926033:0:31619:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6@192.168.206.51@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1789518519.926066:0:31619:0:(genops.c:1384:class_connect()) connect: client 4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6, cookie 0x631fd8698c784917 00000100:00080000:3.0:1789518519.926250:0:31619:0:(import.c:65:import_set_state_nolock()) ffff99fec3adc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518519.926417:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+5:2341:x1876445617202944:12345-192.168.206.51@tcp:250:mount.lustre.0 Request processed in 419us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518519.926426:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1789518519.933831:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518519.933975:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617203072 00000100:00100000:1.0:1789518519.933983:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617203072 00000100:00100000:1.0:1789518519.934040:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518519.934050:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+5:27188:x1876445617203072:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518519.934066:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518519.934081:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0c00/0x631fd8698c78491e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd4aa expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518519.934167:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0c00/0x631fd8698c78491e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4aa expref: 6 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518519.934179:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0c00/0x631fd8698c78491e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4aa expref: 6 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518519.934200:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0c00, rc 0) 00000100:00100000:1.0:1789518519.934292:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+6:27188:x1876445617203072:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 243us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518519.934299:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518519.938085:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518519.938225:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617203200 00000100:00100000:3.0:1789518519.938240:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617203200 00000100:00100000:3.0:1789518519.939309:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1789518519.939329:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+6:27188:x1876445617203200:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789518519.940036:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+6:27188:x1876445617203200:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 713us (1959us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518519.940047:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:0.0:1789518519.943182:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518519.943316:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617203328 00000100:00100000:1.0:1789518519.943329:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617203328 00000100:00100000:1.0:1789518519.943400:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1789518519.943411:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+6:27188:x1876445617203328:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518519.943431:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518519.943453:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c784925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd4b1 expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518519.943491:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c784925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4b1 expref: 7 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518519.943505:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c784925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4b1 expref: 7 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518519.943514:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0e00, rc 0) 00000100:00100000:1.0:1789518519.943599:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+7:27188:x1876445617203328:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 189us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518519.943607:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1789518519.946153:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518519.946417:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617203456 00000100:00100000:3.0:1789518519.946429:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617203456 00000100:00100000:3.0:1789518519.946503:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518519.946516:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+7:27188:x1876445617203456:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789518519.947099:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:27188:x1876445617203456:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 582us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518519.947118:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:2.0:1789518519.950045:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518519.950184:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617203584 00000100:00100000:3.0:1789518519.950197:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617203584 00000100:00100000:3.0:1789518519.950324:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1789518519.950336:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:27188:x1876445617203584:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789518519.950602:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:27188:x1876445617203584:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 268us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518519.950665:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1789518519.958754:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518519.958937:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617203712 00000100:00100000:2.0:1789518519.958950:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617203712 00000100:00100000:2.0:1789518519.959014:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1789518519.959025:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:27207:x1876445617203712:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518519.959688:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:27207:x1876445617203712:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 662us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518519.959698:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1789518519.974223:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518519.975099:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617203840 00000100:00100000:3.0:1789518519.975121:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617203840 00000100:00100000:3.0:1789518519.975196:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:3.0:1789518519.975207:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffa30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:27207:x1876445617203840:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789518519.975551:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffa30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:27207:x1876445617203840:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 345us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518519.975560:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1789518519.981069:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518519.981163:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617203968 00000100:00100000:2.0:1789518519.981177:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617203968 00000100:00100000:2.0:1789518519.981238:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:2.0:1789518519.981250:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:27188:x1876445617203968:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789518519.981273:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518519.981367:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78492c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd4db expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518519.981406:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78492c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4db expref: 9 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518519.981424:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78492c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4db expref: 9 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518519.981434:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16a00, rc 0) 00000100:00100000:2.0:1789518519.981509:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+9:27188:x1876445617203968:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 261us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518519.981517:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:0.0:1789518519.987725:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518519.987829:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617204096 00000100:00100000:1.0:1789518519.987842:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617204096 00000100:00100000:1.0:1789518519.987923:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518519.987934:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+9:27188:x1876445617204096:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789518519.987968:0:31618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789518519.988148:0:31618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789518519.988154:0:31618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789518519.988157:0:31618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789518519.988160:0:31618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 20 00000100:00100000:2.0:1789518519.990381:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+9:27188:x1876445617204096:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 2437us (2656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518519.990397:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:2.0:1789518519.993745:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518519.993884:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617204224 00000100:00100000:3.0:1789518519.993902:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617204224 00000100:00100000:3.0:1789518519.993983:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1789518519.993994:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+9:27188:x1876445617204224:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518519.994015:0:31616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518519.994037:0:31616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd4e2 expref: -99 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518519.994072:0:31616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4e2 expref: 10 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518519.994086:0:31616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4e2 expref: 10 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518519.994096:0:31616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981400, rc 0) 00000100:00100000:3.0:1789518519.994415:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27188:x1876445617204224:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 422us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518519.994423:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1789518519.997542:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518519.997647:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617204352 00000100:00100000:2.0:1789518519.997659:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617204352 00000100:00100000:1.0:1789518519.997852:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1789518519.997866:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27188:x1876445617204352:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789518519.998574:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27188:x1876445617204352:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 708us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518519.998585:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1789518520.000882:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518520.000974:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617204480 00000100:00100000:3.0:1789518520.000985:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617204480 00000100:00100000:3.0:1789518520.001113:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:3.0:1789518520.001129:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27188:x1876445617204480:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789518520.001502:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27188:x1876445617204480:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 377us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518520.001511:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:2.0:1789518520.004980:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518520.005090:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617204608 00000100:00100000:1.0:1789518520.005111:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617204608 00000100:00100000:1.0:1789518520.005204:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1789518520.005214:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27211:x1876445617204608:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518520.005541:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27211:x1876445617204608:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 327us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518520.005550:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:0.0:1789518520.013595:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518520.013731:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617204736 00000100:00100000:3.0:1789518520.013743:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617204736 00000100:00100000:3.0:1789518520.013808:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:3.0:1789518520.013835:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27211:x1876445617204736:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518520.014276:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27211:x1876445617204736:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 441us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518520.014286:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:3.0:1789518520.019291:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518520.019526:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617204864 00000100:00100000:1.0:1789518520.019539:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617204864 00000100:00100000:1.0:1789518520.019690:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518520.019700:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2341:x1876445617204864:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789518520.019734:0:31624:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1789518520.019817:0:31624:0:(genops.c:1384:class_connect()) connect: client 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c, cookie 0x631fd8698c78493a 00000004:00100000:1.0:1789518520.019863:0:31624:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789518520.019870:0:31624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803776 00000100:00080000:0.0:1789518520.053610:0:31624:0:(import.c:65:import_set_state_nolock()) ffff99ffc84de000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518520.053735:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2341:x1876445617204864:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 34034us (34454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518520.053754:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518520.058134:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518520.058309:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617205120 00000100:00100000:3.0:1789518520.058322:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617205120 00000100:00100000:3.0:1789518520.058459:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518520.058473:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27188:x1876445617205120:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789518520.058544:0:31625:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789518520.058707:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27188:x1876445617205120:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 238us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518520.058715:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518520.060133:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518520.060256:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518520.060571:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617204992 00000100:00100000:3.0:1789518520.060581:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617204992 00000100:00100000:3.0:1789518520.060779:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617205248 00000100:00100000:3.0:1789518520.060783:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617205248 00000100:00100000:0.0:1789518520.060856:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518520.060870:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:0:x1876445617204992:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789518520.060921:0:31624:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789518520.060991:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:0:x1876445617204992:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 125us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518520.060999:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518520.061018:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1789518520.061024:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27188:x1876445617205248:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789518520.061050:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27188:x1876445617205248:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 27us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518520.061056:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00080000:1.0:1789518520.061500:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518520.063995:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518520.064036:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518520.064074:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518520.064082:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617205376 00000100:00100000:3.0:1789518520.064095:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617205376 00000100:00100000:3.0:1789518520.064152:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617205504 00000100:00100000:3.0:1789518520.064156:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617205504 00000100:00100000:3.0:1789518520.064178:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518520.064188:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876445617205376:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789518520.064227:0:32309:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp t0 exp 0000000000000000 cur 574 last 0 00000100:00100000:1.0:1789518520.064241:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518520.064250:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445617205504:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789518520.064271:0:32306:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp t0 exp 0000000000000000 cur 574 last 0 00000100:00100000:0.0:1789518520.064310:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617205632 00000100:00100000:0.0:1789518520.064316:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617205632 00000100:00100000:0.0:1789518520.064397:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518520.064406:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27188:x1876445617205632:12345-192.168.206.51@tcp:33:mount.lustre.0 00000020:00000080:3.0:1789518520.064531:0:32309:0:(genops.c:1384:class_connect()) connect: client 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c, cookie 0x631fd8698c784941 00002000:00100000:3.0:1789518520.064547:0:32309:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c/ffff99fec3ade800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518520.064578:0:32309:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:1.0:1789518520.065071:0:32306:0:(genops.c:1384:class_connect()) connect: client 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c, cookie 0x631fd8698c784948 00002000:00100000:1.0:1789518520.065079:0:32306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c/ffff99fec216d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789518520.065097:0:32306:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00080000:0.0:1789518520.065347:0:31627:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 873us 00002000:00080000:3.0:1789518520.065421:0:32309:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789518520.065463:0:32309:0:(import.c:65:import_set_state_nolock()) ffff99fec3ad9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518520.065566:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2341:x1876445617205376:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 1377us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518520.065575:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00002000:00080000:1.0:1789518520.066267:0:32306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789518520.066377:0:32306:0:(import.c:65:import_set_state_nolock()) ffff99fec216f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518520.066421:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2341:x1876445617205504:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 2170us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518520.066430:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000004:00200000:1.0:1789518520.080816:0:31627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789518520.080972:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27188:x1876445617205632:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 16559us (16889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518520.080987:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518520.224684:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518520.224741:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617205760 00000100:00100000:0.0:1789518520.224754:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617205760 00000100:00100000:0.0:1789518520.224826:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518520.224837:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27232:x1876445617205760:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:0.0:1789518520.224863:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518520.224894:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78494f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd50c expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518520.224977:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784956 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518520.225014:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518520.225032:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518520.225079:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518520.225083:0:32331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518520.225136:0:32331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518520.225165:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78494f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd50c expref: 8 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518520.225187:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784956 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd50c expref: 7 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518520.225196:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5900) 00010000:00010000:0.0:1789518520.225199:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518520.225203:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:0.0:1789518520.225290:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:27232:x1876445617205760:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 454us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518520.225298:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:2.0:1789518520.499038:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518520.691057:0:31656:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1789518520.691068:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518520.691676:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 1 00000040:00080000:2.0:1789518520.691771:0:31656:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518520.691816:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 1 00000001:00100000:1.0:1789518520.998731:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 00010000:00010000:2.0:1789518521.522872:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518521.921961:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518521.925525:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617205888 00000100:00100000:3.0:1789518521.925542:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617205888 00000100:00100000:3.0:1789518521.925659:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518521.925672:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:27284:x1876445617205888:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1789518521.925713:0:31625:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789518521.925913:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:27284:x1876445617205888:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 243us (3960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518521.925922:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1789518521.935235:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518521.935355:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617206016 00000100:00100000:3.0:1789518521.935365:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617206016 00000100:00080000:1.0:1789518521.935511:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518521.935918:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518521.935930:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:27284:x1876445617206016:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:3.0:1789518521.935956:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518521.936043:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:27284:x1876445617206016:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 116us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518521.936051:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518521.939489:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518521.940488:0:32311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617206144 00000100:00100000:0.0:1789518521.940500:0:32311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617206144 00000100:00100000:0.0:1789518521.940572:0:32311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518521.940581:0:32311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27284:x1876445617206144:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1789518521.940604:0:32311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789518521.940716:0:32311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27284:x1876445617206144:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 136us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518521.940723:0:32311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00080000:2.0:1789518521.941564:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518522.027086:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518522.027288:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617206272 00000100:00100000:3.0:1789518522.027297:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617206272 00000100:00100000:3.0:1789518522.027395:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:3.0:1789518522.027406:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:27317:x1876445617206272:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789518522.027421:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518522.027437:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4981a00/0x631fd8698c78495d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd513 expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518522.027481:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4981a00/0x631fd8698c78495d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd513 expref: 11 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518522.027492:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4981a00/0x631fd8698c78495d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd513 expref: 11 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518522.027501:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981a00, rc 0) 00000100:00100000:3.0:1789518522.027559:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27317:x1876445617206272:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 154us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518522.027566:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:1.0:1789518522.029166:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518522.031878:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617206400 00000100:00100000:2.0:1789518522.031896:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617206400 00000100:00100000:2.0:1789518522.032142:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1789518522.032159:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27317:x1876445617206400:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789518522.032654:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27317:x1876445617206400:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 487us (3485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518522.033976:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1789518522.034180:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518522.034244:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617206528 00000100:00100000:1.0:1789518522.034255:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617206528 00000100:00100000:1.0:1789518522.034316:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:1.0:1789518522.034326:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27317:x1876445617206528:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789518522.034556:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27317:x1876445617206528:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 230us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518522.034564:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1789518522.038289:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518522.038797:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617206656 00000100:00100000:2.0:1789518522.038811:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617206656 00000100:00100000:2.0:1789518522.038905:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1789518522.038922:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff780a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27323:x1876445617206656:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518522.039264:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff780a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27323:x1876445617206656:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 348us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518522.039274:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1789518522.048750:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518522.048867:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617206784 00000100:00100000:0.0:1789518522.048880:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617206784 00000100:00100000:0.0:1789518522.048951:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:0.0:1789518522.048962:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27323:x1876445617206784:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518522.049996:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27323:x1876445617206784:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 1031us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518522.050006:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1789518522.052061:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518522.052152:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617206912 00000100:00100000:1.0:1789518522.052162:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617206912 00000100:00100000:1.0:1789518522.052217:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:1.0:1789518522.052225:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27317:x1876445617206912:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518522.052241:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518522.052261:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e1600/0x631fd8698c784964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd53d expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518522.052288:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e1600/0x631fd8698c784964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd53d expref: 12 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518522.052298:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e1600/0x631fd8698c784964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd53d expref: 12 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518522.052312:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1600, rc 0) 00000100:00100000:1.0:1789518522.052372:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27317:x1876445617206912:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 146us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518522.052380:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518522.054235:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518522.054300:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617207040 00000100:00100000:0.0:1789518522.054310:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617207040 00000100:00100000:0.0:1789518522.054420:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:0.0:1789518522.054429:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27317:x1876445617207040:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789518522.054451:0:31616:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789518522.054478:0:31616:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789518522.054482:0:31616:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789518522.054484:0:31616:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789518522.054486:0:31616:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 20 00000100:00100000:0.0:1789518522.056872:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27317:x1876445617207040:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 2435us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518522.056884:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:3.0:1789518522.059988:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518522.060155:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617207168 00000100:00100000:1.0:1789518522.060167:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617207168 00000100:00100000:1.0:1789518522.060240:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:1.0:1789518522.060255:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27317:x1876445617207168:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518522.060292:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518522.060314:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd544 expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518522.060349:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd544 expref: 13 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518522.060365:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd544 expref: 13 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518522.060374:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1400, rc 0) 00000100:00100000:1.0:1789518522.060440:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27317:x1876445617207168:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 188us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518522.060452:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:3.0:1789518522.061911:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518522.061972:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617207296 00000100:00100000:0.0:1789518522.061981:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617207296 00000100:00100000:0.0:1789518522.062037:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:0.0:1789518522.062048:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27317:x1876445617207296:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518522.062392:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27317:x1876445617207296:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 345us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518522.062400:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1789518522.063556:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518522.063766:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617207424 00000100:00100000:2.0:1789518522.063774:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617207424 00000100:00100000:2.0:1789518522.063824:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:2.0:1789518522.063833:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc742d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27317:x1876445617207424:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789518522.064045:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc742d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27317:x1876445617207424:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 212us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518522.064053:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:3.0:1789518522.066145:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518522.066231:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617207552 00000100:00100000:1.0:1789518522.066243:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617207552 00000100:00100000:1.0:1789518522.067287:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:1.0:1789518522.067302:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27326:x1876445617207552:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518522.067637:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27326:x1876445617207552:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 338us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518522.067646:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1789518522.069407:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518522.069517:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617207680 00000100:00100000:0.0:1789518522.069528:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617207680 00000100:00100000:0.0:1789518522.069582:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:0.0:1789518522.069593:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27326:x1876445617207680:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518522.071488:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27326:x1876445617207680:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 1888us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518522.071972:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:3.0:1789518522.079990:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518522.081121:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617207808 00000100:00100000:0.0:1789518522.081141:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617207808 00000100:00100000:0.0:1789518522.081216:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518522.081227:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2341:x1876445617207808:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518522.081278:0:32331:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1789518522.081334:0:32331:0:(genops.c:1384:class_connect()) connect: client e799ac01-e98f-4a49-8744-b8fd7980bcc5, cookie 0x631fd8698c784972 00000004:00100000:0.0:1789518522.083473:0:32331:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789518522.083683:0:32331:0:(import.c:65:import_set_state_nolock()) ffff99ffff6ca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518522.083786:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2341:x1876445617207808:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 2558us (3806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518522.083799:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1789518522.087842:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518522.088002:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617208064 00000100:00100000:2.0:1789518522.088015:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617208064 00000100:00100000:2.0:1789518522.088185:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1789518522.088198:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:27317:x1876445617208064:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789518522.088254:0:31625:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789518522.088350:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:27317:x1876445617208064:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 154us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518522.088358:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00080000:1.0:1789518522.088475:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518522.092751:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518522.092862:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518522.093803:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617207936 00000100:00100000:3.0:1789518522.093818:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617207936 00000100:00100000:3.0:1789518522.093894:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617208192 00000100:00100000:3.0:1789518522.093898:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617208192 00000100:00100000:3.0:1789518522.093934:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518522.093946:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:0:x1876445617207936:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789518522.094002:0:31626:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789518522.094085:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:0:x1876445617207936:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 141us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518522.094103:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518522.094126:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518522.094133:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:27317:x1876445617208192:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789518522.094170:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:27317:x1876445617208192:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 37us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518522.094177:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518522.102023:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518522.102064:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518522.102178:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617208320 00000100:00100000:2.0:1789518522.102192:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617208320 00000100:00100000:2.0:1789518522.102250:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1789518522.102260:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1876445617208320:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789518522.102327:0:32579:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:2.0:1789518522.102364:0:32579:0:(genops.c:1384:class_connect()) connect: client e799ac01-e98f-4a49-8744-b8fd7980bcc5, cookie 0x631fd8698c784979 00002000:00100000:2.0:1789518522.102388:0:32579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e799ac01-e98f-4a49-8744-b8fd7980bcc5/ffff99fec4897800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789518522.102424:0:32579:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789518522.102765:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518522.102791:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617208576 00000100:00100000:1.0:1789518522.102798:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617208576 00000100:00100000:3.0:1789518522.102847:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617208448 00000100:00100000:1.0:1789518522.102853:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518522.102854:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617208448 00000100:00100000:1.0:1789518522.102864:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:27317:x1876445617208576:12345-192.168.206.51@tcp:33:mount.lustre.0 00000100:00100000:3.0:1789518522.102889:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518522.102896:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445617208448:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789518522.102917:0:32306:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:3.0:1789518522.102949:0:32306:0:(genops.c:1384:class_connect()) connect: client e799ac01-e98f-4a49-8744-b8fd7980bcc5, cookie 0x631fd8698c784980 00000004:00200000:1.0:1789518522.102951:0:31628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00002000:00100000:3.0:1789518522.102958:0:32306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e799ac01-e98f-4a49-8744-b8fd7980bcc5/ffff99ffffbf6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518522.102982:0:32306:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789518522.103003:0:32579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789518522.103055:0:32579:0:(import.c:65:import_set_state_nolock()) ffff99fec4896000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518522.103057:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:27317:x1876445617208576:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 194us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518522.103069:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1789518522.103111:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2341:x1876445617208320:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 851us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518522.103121:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00002000:00080000:2.0:1789518522.103585:0:32306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789518522.103605:0:32306:0:(import.c:65:import_set_state_nolock()) ffff99fec4893000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518522.103811:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2341:x1876445617208448:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 913us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518522.103820:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518522.262932:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518522.263083:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617208704 00000100:00100000:3.0:1789518522.263110:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617208704 00000100:00100000:3.0:1789518522.263248:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518522.263261:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:27348:x1876445617208704:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:3.0:1789518522.263286:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518522.263325:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd56e expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518522.263409:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518522.263426:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518522.263443:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518522.263488:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518522.263493:0:31626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518522.263519:0:31626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518522.263551:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd56e expref: 8 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518522.263574:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd56e expref: 7 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518522.263584:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5900) 00010000:00010000:3.0:1789518522.263587:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518522.263593:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980e00, rc 0) 00000100:00100000:3.0:1789518522.263745:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:27348:x1876445617208704:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 487us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518522.263762:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00010000:00010000:0.0:1789518522.546819:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518523.571581:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518524.018917:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627605504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518524.018982:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518524.019078:0:32311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627605504 00000100:00100000:3.0:1789518524.019103:0:32311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627605504 00000100:00100000:3.0:1789518524.019162:0:32311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518524.019171:0:32311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627605504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518524.019210:0:32311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518524.019256:0:32311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627605504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518524.019263:0:32311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518524.019309:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627605504:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518524.019407:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518524.020470:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627605888:0@lo:400:kworker.0 00000100:00100000:3.0:1789518524.020516:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518524.020551:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627606272:0@lo:400:kworker.0 00000100:00100000:3.0:1789518524.020575:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518524.020596:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518524.020602:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627605760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518524.020639:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518524.020895:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627606272 00000100:00100000:3.0:1789518524.020901:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627606272 00000100:00100000:1.0:1789518524.021638:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627605888 00000100:00100000:1.0:1789518524.021647:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627605888 00000100:00100000:3.0:1789518524.021851:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518524.021860:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627606272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518524.021916:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627606272:12345-0@lo:400:kworker.0 Request processed in 58us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518524.021923:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518524.021953:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627605632:0@lo:400:kworker.0 00000100:00100000:3.0:1789518524.021984:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518524.022021:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627606144:0@lo:400:kworker.0 00000100:00100000:3.0:1789518524.022062:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518524.022095:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518524.022102:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627606016:0@lo:400:kworker.0 00000100:00100000:3.0:1789518524.022123:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518524.022147:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627605632 00000100:00100000:3.0:1789518524.022152:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627605632 00000100:00100000:3.0:1789518524.022178:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789518524.022185:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:3283:x1876445627605632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518524.022218:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:3283:x1876445627605632:12345-0@lo:400:kworker.0 Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518524.022230:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789518524.022260:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627606144 00000100:00100000:3.0:1789518524.022264:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627606144 00000100:00100000:2.0:1789518524.022749:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627606272:0@lo:400:kworker.0 00000100:00100000:2.0:1789518524.022775:0:32311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627605760 00000100:00100000:2.0:1789518524.022779:0:32311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627605760 00000100:00100000:2.0:1789518524.022804:0:32311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518524.022810:0:32311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627605760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518524.022835:0:32311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789518524.022875:0:32311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627605760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518524.022881:0:32311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518524.022903:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803777 gen 2 00000100:00100000:2.0:1789518524.022924:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627605760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518524.022957:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627606016 00000100:00100000:2.0:1789518524.022960:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627606016 00000100:00100000:2.0:1789518524.022983:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518524.022989:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627606016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518524.023019:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627606016:12345-0@lo:400:kworker.0 Request processed in 31us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518524.023025:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518524.023059:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627606016:0@lo:400:kworker.0 00000100:00100000:2.0:1789518524.023068:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627605632:0@lo:400:kworker.0 00000100:00100000:1.0:1789518524.023285:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518524.023297:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627605888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518524.023337:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627605888:12345-0@lo:400:kworker.0 Request processed in 41us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518524.023344:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518524.023370:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627605888:0@lo:400:kworker.0 00000100:00100000:3.0:1789518524.024159:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518524.024168:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627606144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518524.024219:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627606144:12345-0@lo:400:kworker.0 Request processed in 52us (2156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518524.024225:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518524.024257:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627606144:0@lo:400:kworker.0 00000100:00080000:0.0:1789518524.025573:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518524.025581:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789518524.074751:0:33585:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789518524.565827:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 00000001:00100000:2.0:1789518524.566270:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e799ac01-e98f-4a49-8744-b8fd7980bcc5 00010000:00010000:2.0:1789518524.595925:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789518525.092883:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e799ac01-e98f-4a49-8744-b8fd7980bcc5 00000001:00100000:3.0:1789518525.092895:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 00010000:00010000:0.0:1789518525.619858:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789518526.101755:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e799ac01-e98f-4a49-8744-b8fd7980bcc5 00000020:00000080:2.0:1789518526.108325:0:33736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd71117e30 20000000:00000080:2.0:1789518526.108342:0:33736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fec494dc00 uarg=0000000000000000 20000000:01000000:2.0:1789518526.108372:0:33736:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518526.108377:0:33736:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789518526.108381:0:33736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789518526.109032:0:33737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789518526.109862:0:33736:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789518526.109870:0:33736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789518526.109889:0:33736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.109906:0:33736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78464d expref: 18 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.109915:0:33736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78469a expref: 18 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.109936:0:33736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7847ea expref: 18 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.109955:0:33736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4e2 expref: 12 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.109970:0:33736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd544 expref: 12 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.109977:0:33736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.110018:0:33736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd544 expref: 12 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.110032:0:33736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd544 expref: 12 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.110045:0:33736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606400:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518526.110151:0:33736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4e2 expref: 12 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.110162:0:33736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4e2 expref: 12 pid: 31616 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.110171:0:33736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7880e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606528:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518526.110201:0:33736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c7847ea expref: 18 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.110219:0:33736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c7847ea expref: 18 pid: 31618 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.110229:0:33736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606656:0@lo:104: 00000100:00100000:2.0:1789518526.110267:0:33736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518526.110325:0:33736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c78469a expref: 18 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.110333:0:33736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c78469a expref: 18 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.110341:0:33736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606784:0@lo:104: 00000100:00100000:2.0:1789518526.110379:0:33736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518526.110422:0:33736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c78464d expref: 18 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.110432:0:33736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c78464d expref: 18 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.110440:0:33736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7880700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606912:0@lo:104: 00000100:00100000:2.0:1789518526.110466:0:33736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518526.110476:0:33736:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518526.110545:0:31608:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789518526.110557:0:31608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627606656 00000100:00100000:0.0:1789518526.110558:0:31607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627606784 00000100:00100000:1.0:1789518526.110564:0:31608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627606656 00000100:00100000:0.0:1789518526.110566:0:31607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627606784 00000100:00100000:1.0:1789518526.110604:0:31608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627606912 00000100:00100000:1.0:1789518526.110608:0:31608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627606912 00000100:00100000:0.0:1789518526.110610:0:31607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518526.110643:0:31607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+5:33736:x1876445627606656:12345-0@lo:104: 00010000:00010000:0.0:1789518526.110721:0:31607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.110783:0:31607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518526.110789:0:31607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+5:33736:x1876445627606656:12345-0@lo:104: Request processed in 151us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518526.110798:0:31607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789518526.110800:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518526.110808:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.110818:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45200 already unused, calling callback (ffffffffc1b17c20) 00000100:00100000:0.0:1789518526.110818:0:31607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518526.110828:0:31607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+4:33736:x1876445627606784:12345-0@lo:104: 10000000:00010000:3.0:1789518526.110832:0:31612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.110838:0:31607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.110843:0:31612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518526.110853:0:31612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518526.110859:0:31612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518526.110887:0:31607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789518526.110889:0:31612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518526.110897:0:31607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+4:33736:x1876445627606784:12345-0@lo:104: Request processed in 70us (519us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518526.110899:0:31612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789518526.110909:0:31607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789518526.110923:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518526.110929:0:31607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789518526.110933:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45200/0x631fd8698c7847ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7847f1 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518526.110947:0:31607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe008c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:33736:x1876445627606912:12345-0@lo:104: 00010000:00010000:3.0:1789518526.110951:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518526.110955:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.110957:0:31607:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.110967:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518526.110973:0:31612:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.110980:0:31612:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518526.110997:0:31612:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518526.111003:0:31612:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518526.111010:0:31607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518526.111016:0:31607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe008c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f013254-1301-45d1-9493-6d558799b39e+3:33736:x1876445627606912:12345-0@lo:104: Request processed in 72us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518526.111022:0:31607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518526.111033:0:33736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606656:0@lo:104: 00010000:00010000:1.0:1789518526.111038:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518526.111044:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.111055:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bcc00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518526.111059:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.111060:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518526.111079:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518526.111092:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518526.111098:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518526.111125:0:31612:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.111130:0:31612:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789518526.111270:0:32583:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.111277:0:32583:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789518526.111340:0:33736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606784:0@lo:104: 00000100:00100000:2.0:1789518526.111350:0:33736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7880700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606912:0@lo:104: 00010000:00010000:3.0:1789518526.111522:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.111528:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627607168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518526.111532:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c78469a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7846a1 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.111544:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518526.111546:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518526.111549:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518526.111564:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627607040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518526.111565:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518526.111600:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518526.111701:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.111710:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bcc00/0x631fd8698c78464d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c784654 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518526.111719:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627607168 00010000:00010000:1.0:1789518526.111724:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518526.111726:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627607168 00010000:00010000:1.0:1789518526.111727:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518526.111731:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518526.111749:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c78469a expref: 19 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.111766:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518526.111775:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627607040 00000100:00100000:2.0:1789518526.111778:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627607296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518526.111780:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627607040 00000100:00100000:3.0:1789518526.111790:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789518526.111798:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7847ea expref: 20 pid: 31618 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518526.111804:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f013254-1301-45d1-9493-6d558799b39e+20:3282:x1876445627607168:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518526.111818:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518526.111819:0:31609:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1789518526.111820:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789518526.111830:0:31609:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789518526.111831:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c78469a expref: 20 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.111845:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c78469a expref: 20 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.111845:0:31611:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789518526.111855:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627607296 00000100:00100000:2.0:1789518526.111859:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627607296 00010000:00010000:3.0:1789518526.111876:0:31610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bda00/0x631fd8698c7846a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c78469a expref: 21 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.111879:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c78464d expref: 21 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.111897:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518526.111901:0:31611:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789518526.111911:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518526.111919:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f013254-1301-45d1-9493-6d558799b39e+20:3281:x1876445627607040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518526.111927:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518526.111932:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7847ea expref: 20 pid: 31618 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518526.111944:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f013254-1301-45d1-9493-6d558799b39e+20:3282:x1876445627607168:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (380us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518526.111945:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7847ea expref: 20 pid: 31618 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518526.111953:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518526.111968:0:31610:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789518526.111975:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518526.111982:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f013254-1301-45d1-9493-6d558799b39e+19:3282:x1876445627607296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518526.111990:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518526.111994:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c78464d expref: 19 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.112032:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c78464d expref: 19 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.112097:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17c00/0x631fd8698c7847f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7847ea expref: 19 pid: 31618 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.112108:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518526.112146:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f013254-1301-45d1-9493-6d558799b39e+18:3281:x1876445627607040:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518526.112152:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518526.112179:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627607040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518526.112278:0:31610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0696600/0x631fd8698c784654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c78464d expref: 17 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518526.112279:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627607168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518526.112294:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518526.112332:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f013254-1301-45d1-9493-6d558799b39e+16:3282:x1876445627607296:12345-0@lo:103:ldlm_bl.0 Request processed in 350us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518526.112338:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518526.112394:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627607296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518526.115242:0:33736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606400:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518526.115257:0:33736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7880e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33736:1876445627606528:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518526.115300:0:33736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518526.115526:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518526.115586:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617208832 00000100:00100000:2.0:1789518526.115594:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617208832 00010000:00010000:2.0:1789518526.115645:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd544 expref: 13 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518526.115891:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518526.116261:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617208960 00000100:00100000:2.0:1789518526.116267:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617208960 00010000:00010000:2.0:1789518526.116288:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4e2 expref: 14 pid: 31616 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518526.116290:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518526.116307:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+14:2343:x1876445617208832:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518526.116321:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789518526.116326:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:1.0:1789518526.116331:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd544 expref: 14 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.116339:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+14:2344:x1876445617208960:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518526.116349:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd544 expref: 14 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116350:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518526.116360:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4e2 expref: 14 pid: 31616 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.116369:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e1400/0x631fd8698c78496b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd544 expref: 14 pid: 31619 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116374:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4e2 expref: 14 pid: 31616 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116389:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fec4981400/0x631fd8698c784933 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4e2 expref: 14 pid: 31616 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116414:0:31611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116422:0:31611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.116442:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518526.116449:0:31611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116458:0:31611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116464:0:31611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116470:0:31611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116476:0:31611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518526.116480:0:31611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116486:0:31611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518526.116499:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:2343:x1876445617208832:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 196us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518526.116507:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00010000:00010000:2.0:1789518526.116514:0:31611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.116527:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518526.116545:0:33736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.116553:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:2344:x1876445617208960:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 216us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518526.116564:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:3.0:1789518526.116574:0:33736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.116581:0:33736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17e00/0x631fd8698c784995 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.642855:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518526.819809:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518526.819997:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617209088 00000100:00100000:2.0:1789518526.820007:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617209088 00000100:00100000:2.0:1789518526.820095:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518526.820106:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27805:x1876445617209088:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518526.820136:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518526.820258:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78499c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd575 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820326:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820339:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820351:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820365:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820371:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820378:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789518526.820443:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789518526.820759:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7849b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820768:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7849b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820776:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7849b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518526.820800:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518526.820808:0:31626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518526.820843:0:31626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7849b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820855:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820862:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820869:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820874:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518526.820877:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820884:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820894:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5900) 00010000:00010000:2.0:1789518526.820897:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518526.820901:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820907:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7849a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820918:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820924:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.820939:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.821934:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518526.821952:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.821964:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.821977:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99ffd8a16d00) 00010000:00010000:2.0:1789518526.821980:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518526.821983:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.821990:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7849aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.822034:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c78499c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd575 expref: 8 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.822048:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7849b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd575 expref: 7 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.822054:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffd8a16700) 00010000:00010000:2.0:1789518526.822056:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518526.822058:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:2.0:1789518526.822144:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:27805:x1876445617209088:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2039us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518526.822179:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1789518526.825600:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518526.825703:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617209344 00000100:00100000:3.0:1789518526.825712:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617209344 00000100:00100000:3.0:1789518526.825758:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518526.825769:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:27805:x1876445617209344:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518526.825788:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518526.825806:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd57c expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.825875:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.825889:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.825900:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.825912:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.825919:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.825925:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828499:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980a00/0x631fd8698c7849cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828521:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980a00/0x631fd8698c7849cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828533:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980a00/0x631fd8698c7849cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518526.828544:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789518526.828795:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828803:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828810:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828816:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518526.828821:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828828:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828951:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffd8a16700) 00010000:00010000:3.0:1789518526.828955:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518526.828961:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828977:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828991:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.828996:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.829002:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.829007:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518526.829010:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.829016:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.829024:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffe6f98600) 00010000:00010000:3.0:1789518526.829027:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518526.829030:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.829035:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.829572:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd57c expref: 10 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.830456:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980a00/0x631fd8698c7849cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd57c expref: 9 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.830465:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffe6f98b00) 00010000:00010000:3.0:1789518526.830468:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518526.830471:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980a00, rc 0) 00000100:00100000:3.0:1789518526.830546:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27805:x1876445617209344:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 4777us (4954us total) trans 25769803777 rc 0/0 00000100:00100000:3.0:1789518526.830555:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518526.834867:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518526.835005:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617209472 00000100:00100000:0.0:1789518526.835033:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617209472 00000100:00100000:0.0:1789518526.835213:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518526.835226:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27805:x1876445617209472:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789518526.835371:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27805:x1876445617209472:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 147us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518526.835379:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518526.884900:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518526.885144:0:31633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617209600 00000100:00100000:3.0:1789518526.885157:0:31633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617209600 00000100:00100000:3.0:1789518526.885259:0:31633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518526.885270:0:31633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27814:x1876445617209600:12345-192.168.206.51@tcp:700:mkdir.0 00000100:00100000:3.0:1789518526.885373:0:31633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27814:x1876445617209600:12345-192.168.206.51@tcp:700:mkdir.0 Request processed in 104us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518526.885382:0:31633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518526.888398:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518526.889019:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617209856 00000100:00100000:1.0:1789518526.889034:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617209856 00000100:00100000:1.0:1789518526.889122:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518526.889134:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27814:x1876445617209856:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:1.0:1789518526.889186:0:32331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518526.889211:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784956 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd50c expref: 9 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.889230:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5900) 00010000:00010000:1.0:1789518526.889235:0:32331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518526.889425:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.889440:0:32331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd56e expref: 5 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.889449:0:32331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.889482:0:32331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd56e expref: 5 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.889496:0:32331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd56e expref: 5 pid: 31626 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518526.889518:0:32331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32331:1876445627607424:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518526.889672:0:32331:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6154180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518526.892284:0:32331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32331:1876445627607424:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518526.892309:0:32331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.892750:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518526.892824:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617209984 00000100:00100000:0.0:1789518526.892831:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617209984 00010000:00010000:0.0:1789518526.893163:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd56e expref: 6 pid: 31626 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518526.893194:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518526.893204:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2342:x1876445617209984:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518526.893217:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518526.893224:0:31609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd56e expref: 6 pid: 31626 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.893235:0:31609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd56e expref: 6 pid: 31626 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.893260:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c78498e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd56e expref: 6 pid: 31626 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.893275:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5900) 00010000:00010000:0.0:1789518526.893280:0:31609:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.893300:0:31609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.893307:0:31609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.893327:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518526.893381:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2342:x1876445617209984:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 178us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518526.893389:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00010000:00010000:3.0:1789518526.893515:0:32331:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.893524:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.893546:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.893555:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.893570:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789518526.894225:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1789518526.895519:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789518526.895533:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.895541:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.895548:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.895553:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518526.895557:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.895564:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.895576:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffdfff5900) 00010000:00010000:3.0:1789518526.895579:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518526.895583:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.895589:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7849db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518526.895608:0:32331:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b7eabae reply state 000000001e46be6a transno 25769803778 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518526.895652:0:32331:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518526.895735:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:27814:x1876445617209856:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 6601us (7346us total) trans 25769803778 rc 0/0 00000100:00100000:3.0:1789518526.895744:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00010000:00010000:1.0:1789518526.897774:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.897789:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.897797:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.897803:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518526.897807:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.897815:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.897827:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff99ffe6f98600) 00010000:00010000:1.0:1789518526.897830:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518526.897834:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.897841:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7849e2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.906913:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518526.907096:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617210112 00000100:00100000:3.0:1789518526.907105:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617210112 00000100:00100000:3.0:1789518526.907221:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518526.907232:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27815:x1876445617210112:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1789518526.907255:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518526.907295:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd583 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.907354:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.907368:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.907380:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518526.907412:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518526.907416:0:31626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518526.907451:0:31626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.907475:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c7849e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd583 expref: 11 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.907512:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd583 expref: 10 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.907535:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98700) 00010000:00010000:3.0:1789518526.907539:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518526.907542:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980600, rc 0) 00000100:00100000:3.0:1789518526.907602:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:27815:x1876445617210112:12345-192.168.206.51@tcp:101:rm.0 Request processed in 373us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518526.907610:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518526.910497:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518526.910594:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617210240 00000100:00100000:3.0:1789518526.910603:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617210240 00000100:00100000:2.0:1789518526.911414:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518526.911425:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:27815:x1876445617210240:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:2.0:1789518526.911443:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518526.911462:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7849f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd58a expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911519:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911533:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911543:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911557:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911565:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911572:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911702:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784a0c lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911711:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784a0c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911718:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784a0c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518526.911755:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518526.911759:0:31624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518526.911780:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784a0c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911792:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911798:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911805:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911810:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518526.911814:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911821:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911832:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98700) 00010000:00010000:2.0:1789518526.911841:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518526.911847:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911853:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7849fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911872:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911878:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911884:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911889:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518526.911892:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911897:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911904:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff99ffd8a16d00) 00010000:00010000:2.0:1789518526.911906:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518526.911909:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911914:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911948:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7849f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd58a expref: 12 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911975:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784a0c lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd58a expref: 11 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.911982:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:2.0:1789518526.911985:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789518526.911987:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16e00, rc 0) 00000100:00100000:2.0:1789518526.912111:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27815:x1876445617210240:12345-192.168.206.51@tcp:101:rm.0 Request processed in 688us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518526.912119:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518526.917314:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518526.917400:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617210368 00000100:00100000:0.0:1789518526.917414:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617210368 00000100:00100000:0.0:1789518526.917498:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1789518526.917508:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27815:x1876445617210368:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1789518526.917529:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518526.917551:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c784a13 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd591 expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917655:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917669:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917680:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917695:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917721:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917730:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917787:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917795:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917802:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917808:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518526.917812:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917819:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917830:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:0.0:1789518526.917833:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518526.917838:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917844:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784a1a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917874:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917888:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917895:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917900:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518526.917903:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917909:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917918:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff99ffdfff5800) 00010000:00010000:0.0:1789518526.917920:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518526.917922:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917928:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784a21 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917957:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c784a13 lrc: 1/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd591 expref: 12 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917964:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:0.0:1789518526.917965:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518526.917968:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c784a13 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd591 expref: 12 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.917980:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00000100:00100000:0.0:1789518526.918043:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27815:x1876445617210368:12345-192.168.206.51@tcp:101:rm.0 Request processed in 536us (740us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518526.918051:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1789518526.922034:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518526.922211:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617210496 00000100:00100000:3.0:1789518526.922222:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617210496 00000100:00100000:3.0:1789518526.922379:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1789518526.922389:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27815:x1876445617210496:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1789518526.922408:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518526.922427:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a28 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd598 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922491:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922507:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922519:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922554:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922561:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922567:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922715:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922724:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922731:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922740:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518526.922745:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922753:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922764:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:3.0:1789518526.922767:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518526.922771:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922778:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784a2f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922798:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922804:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922811:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922816:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518526.922819:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922825:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922833:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff99ffe6f98800) 00010000:00010000:3.0:1789518526.922835:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518526.922838:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922845:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784a36 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922877:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a28 lrc: 1/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd598 expref: 12 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922887:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:3.0:1789518526.922889:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518526.922899:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a28 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd598 expref: 12 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518526.922910:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980c00, rc 0) 00000100:00100000:2.0:1789518526.923088:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27815:x1876445617210496:12345-192.168.206.51@tcp:101:rm.0 Request processed in 680us (1044us total) trans 0 rc 301/301 00000100:00100000:2.0:1789518526.923101:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518526.952171:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518526.954190:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617210752 00000100:00100000:3.0:1789518526.954211:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617210752 00000100:00100000:2.0:1789518526.955003:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1789518526.955018:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27821:x1876445617210752:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518526.955046:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518526.955086:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a3d lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd59f expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.955244:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.955261:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.955295:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.955393:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.955402:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.955410:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518526.957039:0:31626:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x83:0x0], count =31 00000004:00080000:2.0:1789518526.957050:0:31626:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x83:0x0]+31 in llog 00000004:00080000:2.0:1789518526.957124:0:31626:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa2:0x0], index 0: 0 00010000:00010000:2.0:1789518526.957377:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957393:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957406:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957447:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957455:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957462:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957479:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518526.957484:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957492:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957506:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:2.0:1789518526.957510:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518526.957515:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957521:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784a44 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518526.957537:0:31626:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d405a1fe reply state 000000002a808b67 transno 25769803779 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.957546:0:31626:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518526.957591:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a3d lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd59f expref: 14 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957607:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd59f expref: 13 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.957666:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffd8a16600) 00010000:00010000:2.0:1789518526.957668:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518526.957670:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16000, rc 0) 00000100:00100000:2.0:1789518526.957770:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+14:27821:x1876445617210752:12345-192.168.206.51@tcp:101:bash.0 Request processed in 2753us (5609us total) trans 25769803779 rc 0/0 00000100:00100000:2.0:1789518526.957788:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00010000:00010000:2.0:1789518526.960873:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518526.960895:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:2.0:1789518526.960900:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.960912:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.960926:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518526.960931:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.960940:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.960960:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff99ffd8a16d00) 00010000:00010000:2.0:1789518526.960964:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518526.960968:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.960976:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a4b lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518526.961163:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617210880 00000100:00100000:0.0:1789518526.961177:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617210880 00000100:00100000:0.0:1789518526.961327:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518526.961340:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2343:x1876445617210880:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518526.961376:0:32579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518526.961398:0:32579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5a6 expref: -99 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518526.961430:0:32579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518526.961453:0:32579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1789518526.961458:0:32579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518526.961474:0:32579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5a6 expref: 6 pid: 32579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.961496:0:32579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5a6 expref: 6 pid: 32579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518526.961510:0:32579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696400, rc 0) 00000100:00100000:0.0:1789518526.961575:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617210880:12345-192.168.206.51@tcp:101:bash.0 Request processed in 238us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518526.961602:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00080000:1.0:1789518526.962026:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518526.965013:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518526.965135:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617211008 00000100:00100000:1.0:1789518526.965147:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617211008 00000100:00100000:1.0:1789518526.965221:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518526.965239:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27821:x1876445617211008:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518526.965275:0:32309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518526.965301:0:32309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5ad expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.965544:0:32309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5a6 expref: 7 pid: 32579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.965557:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518526.965562:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518526.965568:0:32309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 7 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.965692:0:32309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5a6 expref: 7 pid: 32579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.965711:0:32309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5a6 expref: 7 pid: 32579 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518526.965729:0:32309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:32309:1876445627607552:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518526.965896:0:32309:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6154180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518526.967874:0:32309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:32309:1876445627607552:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518526.967902:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518526.967911:0:32309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 7 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518526.967940:0:32309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0800, rc 0) 00000100:00100000:1.0:1789518526.968000:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:27821:x1876445617211008:12345-192.168.206.51@tcp:101:bash.0 Request processed in 2769us (2997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518526.968010:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518526.968205:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617211136 00000100:00100000:2.0:1789518526.968214:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617211136 00010000:00010000:2.0:1789518526.968250:0:33738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5a6 expref: 7 pid: 32579 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.968388:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1789518526.968399:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617211136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518526.968416:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518526.968445:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5a6 expref: 7 pid: 32579 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.968459:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5a6 expref: 7 pid: 32579 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.968485:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca169c6/0x631fd8698c784a60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5a6 expref: 7 pid: 32579 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.968502:0:33738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518526.968507:0:33738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518526.968521:0:33738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 6 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.968532:0:33738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 6 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518526.968569:0:33738:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 6 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518526.968584:0:33738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:33738:1876445627607680:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518526.968927:0:33738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518526.970545:0:33738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:33738:1876445627607680:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518526.970573:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518526.970720:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617211136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2321us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518526.970733:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518526.971789:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518526.971861:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617211392 00000100:00100000:1.0:1789518526.971871:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617211392 00000100:00100000:1.0:1789518526.971927:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518526.971938:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+13:27821:x1876445617211392:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:1.0:1789518526.972388:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+14:27821:x1876445617211392:12345-192.168.206.51@tcp:35:bash.0 Request processed in 450us (600us total) trans 25769803780 rc 0/0 00000100:00100000:1.0:1789518526.972396:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1789518527.018385:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518527.018520:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617211520 00000100:00100000:2.0:1789518527.018533:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617211520 00000100:00100000:2.0:1789518527.018657:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518527.018669:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+14:27827:x1876445617211520:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518527.018853:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518527.018889:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5b4 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.018977:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a75 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.019000:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a75 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.019024:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a75 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518527.019082:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518527.019086:0:31624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518527.019111:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a75 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.019140:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c784a6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5b4 expref: 16 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.019173:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a75 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5b4 expref: 15 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.019182:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:2.0:1789518527.019186:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518527.019190:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518527.019308:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+15:27827:x1876445617211520:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 641us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518527.019316:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1789518527.026320:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518527.026401:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617211776 00000100:00100000:3.0:1789518527.026410:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617211776 00000100:00100000:3.0:1789518527.026528:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1789518527.026541:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+15:27827:x1876445617211776:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518527.026560:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518527.026579:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784a7c lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5bb expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.026705:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.026720:0:31625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd59f expref: 16 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.026729:0:31625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 4/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.026760:0:31625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd59f expref: 16 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.026774:0:31625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd59f expref: 16 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518527.026804:0:31625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627607808:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518527.026893:0:31625:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518527.031269:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518527.031364:0:31610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617211904 00000100:00100000:1.0:1789518527.031372:0:31610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617211904 00010000:00010000:1.0:1789518527.031408:0:31610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd59f expref: 17 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518527.031446:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518527.031455:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:2342:x1876445617211904:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518527.031468:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518527.031474:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd59f expref: 17 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.031505:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd59f expref: 17 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.031527:0:31610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffd8a16600) 00010000:00010000:1.0:1789518527.031533:0:31610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.031542:0:31610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.031551:0:31610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.031570:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518527.031738:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:2342:x1876445617211904:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 283us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518527.031746:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00010000:00010000:3.0:1789518527.031842:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c784a52 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd59f expref: 16 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518527.031858:0:31625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627607808:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518527.031879:0:31625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.031889:0:31625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.031895:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518527.031912:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:3.0:1789518527.032045:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784a7c lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5bb expref: 17 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.032060:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5bb expref: 16 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.032076:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffd8a16600) 00010000:00010000:3.0:1789518527.032078:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518527.032081:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980c00, rc 0) 00000100:00100000:3.0:1789518527.032108:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:27827:x1876445617211776:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 5571us (5800us total) trans 25769803781 rc 0/0 00000100:00100000:3.0:1789518527.032122:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1789518527.036147:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518527.036241:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617212160 00000100:00100000:1.0:1789518527.036250:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617212160 00000100:00100000:1.0:1789518527.036308:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1789518527.036317:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:27827:x1876445617212160:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518527.036338:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518527.036341:0:32331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518527.036364:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784a83 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5bb expref: 16 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.036382:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffd8a16600) 00010000:00010000:1.0:1789518527.036404:0:32331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518527.036419:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784a91 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5c2 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.036503:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c784a98 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.036515:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c784a98 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.036525:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c784a98 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518527.036536:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:1.0:1789518527.037149:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784a91 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c2 expref: 18 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.037165:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c784a98 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c2 expref: 17 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.037173:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:1.0:1789518527.037176:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518527.037178:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0000, rc 0) 00000100:00100000:1.0:1789518527.037274:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:27827:x1876445617212160:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 957us (1138us total) trans 25769803782 rc 0/0 00000100:00100000:1.0:1789518527.037283:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1789518527.042243:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518527.042350:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617212288 00000100:00100000:0.0:1789518527.042358:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617212288 00000100:00100000:0.0:1789518527.042404:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1789518527.042412:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:27827:x1876445617212288:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518527.042433:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518527.042454:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5c9 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.042511:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c9 expref: 18 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.042526:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c9 expref: 18 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.042544:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:0.0:1789518527.042547:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518527.042551:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696200, rc 0) 00000100:00100000:0.0:1789518527.042601:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:27827:x1876445617212288:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 190us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518527.042699:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1789518527.045547:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518527.045634:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617212416 00000100:00100000:2.0:1789518527.045643:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617212416 00000100:00100000:2.0:1789518527.045688:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518527.045697:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2344:x1876445617212416:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:2.0:1789518527.045736:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.045755:0:32306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 6 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.045763:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xa2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789518527.045767:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518527.045771:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.045820:0:32306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 6 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.045834:0:32306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 6 pid: 32309 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518527.045849:0:32306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:32306:1876445627607936:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518527.045924:0:32306:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe480 going to sleep for 11 seconds 00000100:00100000:3.0:1789518527.049208:0:32306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:32306:1876445627607936:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518527.049238:0:32306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518527.049837:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518527.050097:0:32312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617212544 00000100:00100000:2.0:1789518527.050105:0:32312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617212544 00002000:00100000:2.0:1789518527.050144:0:32312:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa2:0x0] (0->8) req@ffff99ffff665180 x1876445617212544/t0(0) o4->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:173/0 lens 504/0 e 0 to 0 dl 1789518538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518527.050154:0:32312:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff665180 with x1876445617212544 ext(0->8) 00010000:00010000:2.0:1789518527.050161:0:32312:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 7 pid: 32309 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.050175:0:32312:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 7 pid: 32309 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518527.050182:0:32312:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffff665180 00000100:00100000:2.0:1789518527.050220:0:32312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518527.050229:0:32312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2343:x1876445617212544:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:2.0:1789518527.050733:0:32312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:2343:x1876445617212544:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 504us (896us total) trans 25769803778 rc 0/0 00000100:00100000:2.0:1789518527.050749:0:32312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:2.0:1789518527.050756:0:32312:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa2:0x0] (0->8) req@ffff99ffff665180 x1876445617212544/t25769803778(0) o4->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:173/0 lens 504/448 e 0 to 0 dl 1789518538 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518527.050765:0:32312:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffff665180 with x1876445617212544 ext(0->8) 00010000:00010000:2.0:1789518527.050771:0:32312:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 9 pid: 32309 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.050782:0:32312:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 9 pid: 32309 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518527.050786:0:32312:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffff665180 00000100:00100000:2.0:1789518527.052723:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518527.052892:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617212672 00000100:00100000:0.0:1789518527.052899:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617212672 00010000:00010000:0.0:1789518527.052925:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 9 pid: 32309 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518527.052991:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518527.052998:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:2342:x1876445617212672:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518527.053009:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789518527.053022:0:31611:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789518527.053024:0:31611:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime from disk: 0 -> 1789518527 00002000:00010000:0.0:1789518527.053026:0:31611:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb atime from disk: 0 -> 1789518527 00002000:00010000:0.0:1789518527.053027:0:31611:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime from disk: 0 -> 1789518527 00010000:00010000:0.0:1789518527.053031:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 9 pid: 32309 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.053042:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 9 pid: 32309 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.053079:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c784a67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ad expref: 9 pid: 32309 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.053095:0:31611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518527.053099:0:31611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518527.053117:0:31611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.053127:0:31611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.053159:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518527.053219:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2342:x1876445617212672:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 220us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518527.053225:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00010000:00010000:3.0:1789518527.053291:0:32306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.053300:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.053322:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.053330:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.053337:0:32306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.053345:0:32306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518527.053349:0:32306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.053359:0:32306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.053379:0:32306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.053387:0:32306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c784aad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518527.053429:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2344:x1876445617212416:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 7733us (7891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518527.053436:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518527.056513:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518527.056608:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617212928 00000100:00100000:1.0:1789518527.056687:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617212928 00000100:00100000:2.0:1789518527.056758:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518527.056769:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:27827:x1876445617212928:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:2.0:1789518527.056822:0:31628:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b11:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c784a98 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c2 expref: 18 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518527.057083:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803783 00000001:00080000:2.0:1789518527.057128:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803784 00000001:00080000:2.0:1789518527.057816:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803785 00010000:00010000:2.0:1789518527.057872:0:31628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.057887:0:31628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c9 expref: 22 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.057906:0:31628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.057937:0:31628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c9 expref: 22 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.057951:0:31628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c9 expref: 22 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518527.057964:0:31628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:31628:1876445627608064:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518527.058047:0:31628:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518527.060527:0:31628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:31628:1876445627608064:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518527.060527:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:2.0:1789518527.060551:0:31628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518527.061037:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617213056 00000100:00100000:0.0:1789518527.061045:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617213056 00010000:00010000:0.0:1789518527.061088:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c9 expref: 23 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518527.061113:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518527.061122:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+23:2342:x1876445617213056:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518527.061134:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518527.061140:0:31609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c9 expref: 23 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.061152:0:31609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c9 expref: 23 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.061171:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784aa6 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c9 expref: 23 pid: 31626 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.061214:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:0.0:1789518527.061219:0:31609:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.061227:0:31609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.061234:0:31609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.061262:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518527.061311:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+22:2342:x1876445617213056:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 190us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518527.061319:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00010000:00010000:2.0:1789518527.061451:0:31628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.061459:0:31628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518527.061562:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803786 00000001:00080000:2.0:1789518527.062019:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803787 00000100:00100000:2.0:1789518527.062127:0:31628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:31628:1876445627608192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518527.062168:0:31628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518527.062206:0:31628:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518527.062370:0:31629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627608192 00000100:00100000:0.0:1789518527.062376:0:31629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627608192 00000100:00100000:0.0:1789518527.062427:0:31629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518527.062435:0:31629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31628:x1876445627608192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789518527.062508:0:31629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31628:x1876445627608192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518527.062515:0:31629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789518527.062580:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518527.062740:0:31628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:31628:1876445627608192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789518527.063687:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803788 00000100:00100000:3.0:1789518527.063753:0:31628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:31628:1876445627608320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518527.063931:0:31628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518527.063967:0:31628:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518527.064369:0:31629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627608320 00000100:00100000:3.0:1789518527.064376:0:31629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627608320 00000100:00100000:3.0:1789518527.064431:0:31629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518527.064441:0:31629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31628:x1876445627608320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518527.065341:0:31629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:31628:x1876445627608320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 899us (1406us total) trans 25769803779 rc 0/0 00000100:00100000:3.0:1789518527.065351:0:31629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518527.066382:0:31628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:31628:1876445627608320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518527.066454:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803789 00010000:00010000:2.0:1789518527.066500:0:31628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.066511:0:31628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.066519:0:31628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.066524:0:31628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518527.066528:0:31628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.066535:0:31628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.066548:0:31628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:2.0:1789518527.066551:0:31628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789518527.066555:0:31628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.066561:0:31628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ab4 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518527.067479:0:31628:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789518527.068006:0:31628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].2, 64 off8320 00000004:00080000:2.0:1789518527.068019:0:31628:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 581064404927ns, next at 582064401837ns, rc = 0 00000001:00080000:2.0:1789518527.068028:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803790 00010000:00010000:2.0:1789518527.068098:0:31628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:2.0:1789518527.068103:0:31628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518527.068112:0:31628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c784a98 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5c2 expref: 26 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518527.068369:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+25:27827:x1876445617212928:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 11601us (11865us total) trans 25769803791 rc 0/0 00000100:00100000:2.0:1789518527.068379:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000020:00080000:2.0:1789518527.068384:0:31628:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518527.071740:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518527.071820:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617213184 00000100:00100000:3.0:1789518527.071830:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617213184 00000100:00100000:3.0:1789518527.071883:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1789518527.071893:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+25:27827:x1876445617213184:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518527.071920:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518527.071954:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5d0 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.072010:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d0 expref: 26 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.072025:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d0 expref: 26 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.072043:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:3.0:1789518527.072046:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518527.072050:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980000, rc 0) 00000100:00100000:3.0:1789518527.072119:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+26:27827:x1876445617213184:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 226us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518527.072126:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518527.075414:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518527.075529:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617213440 00000100:00100000:1.0:1789518527.075542:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617213440 00000100:00100000:1.0:1789518527.075594:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518527.075604:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+26:27827:x1876445617213440:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518527.076080:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:27827:x1876445617213440:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 466us (666us total) trans 25769803792 rc 0/0 00000100:00100000:1.0:1789518527.076093:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1789518527.135581:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518527.135739:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617213696 00000100:00100000:2.0:1789518527.135756:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617213696 00000100:00100000:2.0:1789518527.135820:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1789518527.135830:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:27837:x1876445617213696:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518527.135853:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518527.135874:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5d7 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518527.135965:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789518527.136095:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ac2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d7 expref: 29 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.136110:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98700) 00010000:00010000:2.0:1789518527.136113:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518527.136118:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d7 expref: 29 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.136130:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:2.0:1789518527.136188:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+28:27837:x1876445617213696:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 360us (621us total) trans 25769803793 rc 301/301 00000100:00100000:2.0:1789518527.136209:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1789518527.142720:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518527.142875:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617213824 00000100:00100000:3.0:1789518527.142883:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617213824 00000100:00100000:3.0:1789518527.142944:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1789518527.142954:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+28:27837:x1876445617213824:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1789518527.143036:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143055:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143077:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143093:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143110:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143117:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143197:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143206:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143212:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518527.143250:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143262:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143269:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143275:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143281:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518527.143285:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143292:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143309:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:3.0:1789518527.143312:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518527.143318:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143324:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c784ad0 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143337:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143343:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143349:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143354:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518527.143357:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143363:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143370:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff99ffe6f98600) 00010000:00010000:3.0:1789518527.143373:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518527.143376:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143381:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981800/0x631fd8698c784ad7 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143405:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143411:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143416:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143421:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518527.143424:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143430:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143437:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:3.0:1789518527.143439:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518527.143442:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.143447:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980200/0x631fd8698c784ade lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518527.143523:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+28:27837:x1876445617213824:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 570us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518527.143530:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1789518527.145265:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518527.145324:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617214080 00000100:00100000:2.0:1789518527.145331:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617214080 00000100:00100000:2.0:1789518527.145381:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518527.145391:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+28:27837:x1876445617214080:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518527.145607:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+29:27837:x1876445617214080:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 216us (347us total) trans 25769803794 rc 0/0 00000100:00100000:2.0:1789518527.145663:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518527.373903:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518527.373999:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518527.374030:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518527.374076:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518527.374126:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617214336 00000100:00100000:1.0:1789518527.374126:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617214464 00000100:00100000:2.0:1789518527.374136:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617214336 00000100:00100000:1.0:1789518527.374137:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617214464 00000100:00100000:1.0:1789518527.374198:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617214592 00000100:00100000:1.0:1789518527.374202:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617214592 00000100:00100000:3.0:1789518527.374213:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518527.374231:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2343:x1876445617214464:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518527.374307:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2343:x1876445617214464:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 80us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518527.374315:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518527.375755:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617214208 00000100:00100000:0.0:1789518527.375765:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617214208 00000100:00100000:0.0:1789518527.375879:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:0.0:1789518527.375887:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:2343:x1876445617214208:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518527.375934:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:2343:x1876445617214208:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 48us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518527.375940:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:2.0:1789518527.376969:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518527.376982:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2343:x1876445617214336:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518527.377009:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1789518527.377021:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2343:x1876445617214592:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518527.377033:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2343:x1876445617214336:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 53us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518527.377040:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518527.377061:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2343:x1876445617214592:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 41us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518527.377079:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00080000:3.0:1789518527.381477:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518527.381487:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518527.392978:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518527.393093:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617214848 00000100:00100000:1.0:1789518527.393103:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617214848 00000100:00100000:1.0:1789518527.393160:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1789518527.393169:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+29:27853:x1876445617214848:12345-192.168.206.51@tcp:101:multiop.0 00010000:00010000:1.0:1789518527.393191:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518527.393195:0:31625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518527.393218:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784a75 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5b4 expref: 29 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393236:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:1.0:1789518527.393253:0:31625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518527.393266:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0a00/0x631fd8698c784ae5 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5de expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393404:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393417:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393426:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393438:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393444:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393450:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393503:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393511:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393518:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518527.393526:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:1.0:1789518527.393608:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393670:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393678:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393683:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518527.393687:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393695:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393703:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:1.0:1789518527.393706:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518527.393710:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393715:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784aec lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393725:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393731:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393737:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393743:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518527.393752:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393759:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393767:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518527.393770:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518527.393773:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393778:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784af3 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393905:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0a00/0x631fd8698c784ae5 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5de expref: 31 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393920:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5de expref: 30 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.393927:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:1.0:1789518527.393929:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518527.393937:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1800, rc 0) 00000100:00100000:1.0:1789518527.394184:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+30:27853:x1876445617214848:12345-192.168.206.51@tcp:101:multiop.0 Request processed in 1015us (1219us total) trans 25769803795 rc 0/0 00000100:00100000:1.0:1789518527.394191:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 10000000:01000000:2.0:1789518527.539124:0:31621:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789518527.539132:0:31621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc5112000 from 10 10000000:01000000:2.0:1789518527.539139:0:31621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518527.539184:0:31621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.539196:0:31621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.539219:0:31621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518527.539246:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.539318:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518527.539383:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518527.539454:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627608448 00000100:00100000:0.0:1789518527.539462:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627608448 00000100:00100000:0.0:1789518527.539504:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518527.539513:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+16:31621:x1876445627608448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518527.539525:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518527.539538:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0696e00/0x631fd8698c784b0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784b08 expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.539560:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0696e00/0x631fd8698c784b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784b08 expref: 17 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.539573:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0696e00/0x631fd8698c784b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784b08 expref: 17 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.539582:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696e00, rc 0) 00000100:00100000:0.0:1789518527.539654:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+17:31621:x1876445627608448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518527.539660:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789518527.539878:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518527.539892:0:31621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.539902:0:31621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518527.539949:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.539974:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518527.540002:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518527.540052:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627608576 00000100:00100000:0.0:1789518527.540056:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627608576 00000100:00100000:0.0:1789518527.540099:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789518527.540107:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+17:31621:x1876445627608576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518527.540370:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+17:31621:x1876445627608576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518527.540382:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789518527.540539:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.540566:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.540602:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518527.540650:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518527.540883:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627608704 00000100:00100000:1.0:1789518527.540889:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627608704 00000100:00100000:1.0:1789518527.540926:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789518527.540933:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+17:31621:x1876445627608704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518527.541223:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+17:31621:x1876445627608704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518527.541230:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789518527.541350:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789518527.542240:0:33750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789518527.542917:0:31621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789518527.542936:0:31621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518527.542946:0:31621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.542957:0:31621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518527.542966:0:31621:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518527.542969:0:31621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffd1031000 from 10 10000000:01000000:3.0:1789518527.542972:0:31621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518527.543001:0:31621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.543008:0:31621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.543017:0:31621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518527.543035:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518527.543091:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518527.543178:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6f180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518527.544933:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627608832 00000100:00100000:1.0:1789518527.544945:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627608832 00000100:00100000:1.0:1789518527.545055:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789518527.545075:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+17:31621:x1876445627608832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518527.545090:0:31616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518527.545105:0:31616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0a00/0x631fd8698c784b1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784b16 expref: -99 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.545129:0:31616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0a00/0x631fd8698c784b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784b16 expref: 18 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.545139:0:31616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0a00/0x631fd8698c784b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784b16 expref: 18 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518527.545147:0:31616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0a00, rc 0) 00000100:00100000:1.0:1789518527.545208:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+18:31621:x1876445627608832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518527.545215:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789518527.545281:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518527.545297:0:31621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.545316:0:31621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518527.545382:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.545411:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518527.545581:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518527.545639:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627608960 00000100:00100000:3.0:1789518527.545644:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627608960 00000100:00100000:3.0:1789518527.545665:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789518527.545671:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+18:31621:x1876445627608960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518527.545890:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+18:31621:x1876445627608960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518527.545897:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789518527.546013:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627608960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.546038:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627609088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.546085:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518527.546112:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518527.546162:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627609088 00000100:00100000:0.0:1789518527.546167:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627609088 00000100:00100000:0.0:1789518527.546198:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789518527.546205:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+18:31621:x1876445627609088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518527.546342:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+18:31621:x1876445627609088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518527.546359:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789518527.546479:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627609088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789518527.547655:0:33751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789518527.547863:0:31621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789518527.547879:0:31621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518527.547889:0:31621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.547899:0:31621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518527.547909:0:31621:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789518527.547912:0:31621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffe6225800 from 10 10000000:01000000:2.0:1789518527.547914:0:31621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789518527.547939:0:31621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.547947:0:31621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.547965:0:31621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518527.547982:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627609216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.548019:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518527.548052:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518527.548104:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627609216 00000100:00100000:3.0:1789518527.548109:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627609216 00000100:00100000:3.0:1789518527.548174:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789518527.548182:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+18:31621:x1876445627609216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518527.548192:0:31618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518527.548203:0:31618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4981800/0x631fd8698c784b2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c784b24 expref: -99 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.548220:0:31618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4981800/0x631fd8698c784b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c784b24 expref: 19 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.548229:0:31618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4981800/0x631fd8698c784b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c784b24 expref: 19 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.548237:0:31618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981800, rc 0) 00000100:00100000:3.0:1789518527.548270:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+19:31621:x1876445627609216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518527.548276:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789518527.548600:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627609216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518527.548629:0:31621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518527.548637:0:31621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518527.548682:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627609344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518527.548707:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518527.548917:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffedb6cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518527.548959:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627609344 00000100:00100000:2.0:1789518527.548964:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627609344 00000100:00100000:2.0:1789518527.548986:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789518527.548991:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:31621:x1876445627609344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.549206:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:31621:x1876445627609344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518527.549213:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789518527.549277:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627609344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518527.549302:0:31621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627609472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518527.549335:0:31621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518527.549366:0:31621:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffedb6cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518527.549462:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627609472 00000100:00100000:2.0:1789518527.549467:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627609472 00000100:00100000:2.0:1789518527.549484:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789518527.549489:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:31621:x1876445627609472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518527.549639:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:31621:x1876445627609472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518527.549646:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789518527.549722:0:31621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f013254-1301-45d1-9493-6d558799b39e:31621:1876445627609472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518527.550712:0:33752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789518527.550962:0:31621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789518527.550981:0:31621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518527.550988:0:31621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518527.550998:0:31621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518527.667938:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518527.859886:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789518528.013952:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518528.014262:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617214976 00000100:00100000:3.0:1789518528.014275:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617214976 00000100:00100000:3.0:1789518528.014374:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:3.0:1789518528.014386:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:27202:x1876445617214976:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518528.014412:0:31619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518528.014436:0:31619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4980800/0x631fd8698c784b32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5e5 expref: -99 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518528.014472:0:31619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4980800/0x631fd8698c784b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5e5 expref: 12 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518528.014486:0:31619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4980800/0x631fd8698c784b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5e5 expref: 12 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518528.014496:0:31619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980800, rc 0) 00000100:00100000:3.0:1789518528.014579:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27202:x1876445617214976:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 194us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518528.014586:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:0.0:1789518528.018437:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518528.018558:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617215104 00000100:00100000:1.0:1789518528.018572:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617215104 00000100:00100000:1.0:1789518528.018903:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:1.0:1789518528.018917:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27202:x1876445617215104:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518528.019348:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27202:x1876445617215104:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 433us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518528.019369:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:1.0:1789518528.022412:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518528.022536:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617215232 00000100:00100000:0.0:1789518528.022550:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617215232 00000100:00100000:0.0:1789518528.022680:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:0.0:1789518528.022693:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdac56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27202:x1876445617215232:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518528.023159:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdac56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27202:x1876445617215232:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 468us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518528.023169:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:2.0:1789518528.027710:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518528.028448:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617215360 00000100:00100000:1.0:1789518528.028462:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617215360 00000100:00100000:1.0:1789518528.028537:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518528.028550:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:27202:x1876445617215360:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518528.028571:0:31616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518528.028595:0:31616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e1e00/0x631fd8698c784b39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5ec expref: -99 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518528.028665:0:31616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e1e00/0x631fd8698c784b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ec expref: 13 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518528.028678:0:31616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e1e00/0x631fd8698c784b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ec expref: 13 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518528.028688:0:31616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1e00, rc 0) 00000100:00100000:1.0:1789518528.028774:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27202:x1876445617215360:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 227us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518528.028782:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518528.031693:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518528.031790:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617215488 00000100:00100000:2.0:1789518528.031801:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617215488 00000100:00100000:2.0:1789518528.031971:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:2.0:1789518528.031995:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27202:x1876445617215488:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518528.032417:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27202:x1876445617215488:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 435us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518528.032426:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:2.0:1789518528.035029:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518528.035176:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617215616 00000100:00100000:0.0:1789518528.035187:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617215616 00000100:00100000:0.0:1789518528.035269:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:0.0:1789518528.035281:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27202:x1876445617215616:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518528.035557:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1080850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:27202:x1876445617215616:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 278us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518528.035566:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00010000:00010000:1.0:1789518528.691327:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518529.138951:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627609856:0@lo:400:kworker.0 00000100:00100000:0.0:1789518529.138972:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627610112:0@lo:400:kworker.0 00000100:00100000:3.0:1789518529.139144:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627609728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518529.139150:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627609984:0@lo:400:kworker.0 00000100:00100000:0.0:1789518529.141681:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518529.141690:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518529.141832:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627610368:0@lo:400:kworker.0 00000100:00100000:3.0:1789518529.141870:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518529.141870:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518529.141892:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518529.141960:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f013254-1301-45d1-9493-6d558799b39e:3280:1876445627609600:0@lo:400:kworker.0 00000100:00100000:2.0:1789518529.142009:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627609856 00000100:00100000:1.0:1789518529.142010:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627609984 00000100:00100000:3.0:1789518529.142020:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518529.142022:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627609856 00000100:00100000:0.0:1789518529.142022:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627610112 00000100:00100000:1.0:1789518529.142023:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627609984 00000100:00100000:0.0:1789518529.142033:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627610112 00000100:00100000:3.0:1789518529.142093:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627610240:0@lo:400:kworker.0 00000100:00100000:0.0:1789518529.142101:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627610368 00000100:00100000:0.0:1789518529.142109:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627610368 00000100:00100000:1.0:1789518529.142131:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518529.142139:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518529.142159:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518529.142167:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627609984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518529.142177:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627609856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518529.142189:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627610240 00000100:00100000:0.0:1789518529.142196:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627610240 00000100:00100000:0.0:1789518529.142236:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518529.142247:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627610112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518529.142270:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627609856:12345-0@lo:400:kworker.0 Request processed in 96us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518529.142273:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627609984:12345-0@lo:400:kworker.0 Request processed in 115us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518529.142287:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518529.142295:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518529.142295:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627610112:12345-0@lo:400:kworker.0 Request processed in 49us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518529.142315:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518529.142336:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789518529.142342:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627610496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518529.142344:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627610368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518529.142388:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518529.142393:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627610368:12345-0@lo:400:kworker.0 Request processed in 49us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518529.142399:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518529.142420:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518529.142430:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627610240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518529.142441:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627609984:0@lo:400:kworker.0 00000100:00100000:0.0:1789518529.142481:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627610240:12345-0@lo:400:kworker.0 Request processed in 53us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518529.142484:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627609728 00000100:00100000:1.0:1789518529.142489:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627609728 00000100:00100000:0.0:1789518529.142494:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518529.142518:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627610368:0@lo:400:kworker.0 00000100:00100000:1.0:1789518529.142518:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627610496 00000100:00100000:1.0:1789518529.142525:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627610496 00000100:00100000:2.0:1789518529.142546:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627609856:0@lo:400:kworker.0 00000100:00100000:1.0:1789518529.142552:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518529.142563:0:32311:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789518529.142568:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627609728:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518529.142576:0:32311:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1789518529.142599:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789518529.142800:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627609600 00000100:00100000:0.0:1789518529.142806:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627609600 00000100:00100000:1.0:1789518529.142847:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627609728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 281us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518529.142852:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789518529.142865:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789518529.142869:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518529.142870:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:3280:x1876445627609600:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518529.142876:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518529.142882:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518529.142901:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518529.142915:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627610112:0@lo:400:kworker.0 00000100:00100000:1.0:1789518529.142921:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627610496:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518529.142927:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:3280:x1876445627609600:12345-0@lo:400:kworker.0 Request processed in 61us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518529.142936:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00002000:00000024:1.0:1789518529.142952:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518529.142972:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627609728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518529.142986:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f013254-1301-45d1-9493-6d558799b39e:3280:1876445627609600:0@lo:400:kworker.0 00000100:00100000:2.0:1789518529.142999:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627610240:0@lo:400:kworker.0 00000100:00100000:1.0:1789518529.143015:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627610496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518529.143025:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:3.0:1789518529.143132:0:31647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 583139516231ns, next at 584139512785ns, rc = 0 00000100:00100000:1.0:1789518529.143232:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627610496:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789518529.714884:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789518530.194473:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803795 is committed 00000004:00080000:1.0:1789518530.194527:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1789518530.194566:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789518530.194578:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff7a43cc0 refcount 2 committed 0 result 0 batchid 21474836516 00000020:00080000:1.0:1789518530.194584:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffc469cc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7a43600 00000020:00080000:1.0:1789518530.194587:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff491ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec1b6f000 00000020:00080000:3.0:1789518530.194881:0:31663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836516 committed batchid 17179869275 00000020:00080000:3.0:1789518530.195131:0:31663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869275 00000100:00100000:1.0:1789518530.195179:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518530.195203:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627610624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789518530.195289:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518530.195485:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627610624 00000100:00100000:2.0:1789518530.195496:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627610624 00000100:00100000:2.0:1789518530.195555:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518530.195566:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627610624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789518530.195641:0:32306:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:162 count 1 00002000:00010000:2.0:1789518530.195687:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa2:0x0] initial LVB size: 9, mtime: 0x6aa9e2bf, atime: 0x6aa9e2bf, ctime: 0x6aa9e2bf, blocks: 0x1 00010000:00010000:2.0:1789518530.195696:0:32306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.195715:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1789518530.195720:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518530.195728:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.195747:0:32306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.195758:0:32306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.195779:0:32306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.195798:0:32306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789518530.196392:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627610624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 826us (1101us total) trans 25769803780 rc 0/0 00000100:00100000:2.0:1789518530.196402:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789518530.196549:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518530.196560:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.196569:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518530.196575:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.196586:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.196611:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.196655:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7645bd4/0x631fd8698c784b40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.196678:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518530.196687:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518530.196689:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789518530.196727:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff7881f80/2, rc 0, transno 25769803780 00000100:00100000:1.0:1789518530.196734:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627610624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789518530.256183:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.256389:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617215744 00000100:00100000:2.0:1789518530.256402:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617215744 00000100:00100000:2.0:1789518530.256483:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1789518530.256496:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:25567:x1876445617215744:12345-192.168.206.51@tcp:101:bash.0 00000100:00080000:3.0:1789518530.256516:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789518530.256522:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518530.256548:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784b47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5f3 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.256685:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.256702:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.256723:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518530.256767:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518530.256771:0:31626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518530.256795:0:31626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.256832:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5f3 expref: 7 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.256852:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5f3 expref: 6 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.256861:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98700) 00010000:00010000:2.0:1789518530.256864:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518530.256869:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518530.256948:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:25567:x1876445617215744:12345-192.168.206.51@tcp:101:bash.0 Request processed in 455us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518530.256956:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518530.259195:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.259256:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617215872 00000100:00100000:0.0:1789518530.259266:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617215872 00000100:00100000:0.0:1789518530.259327:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1789518530.259338:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:25567:x1876445617215872:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518530.259384:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518530.259409:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd5fa expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.259551:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.259566:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.259575:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.259585:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.259589:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.259594:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260061:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c784b6a lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260072:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c784b6a lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260079:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c784b6a lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518530.260113:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518530.260122:0:31625:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518530.260151:0:31625:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c784b6a lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260165:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260173:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260180:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260187:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518530.260191:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260198:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260208:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98700) 00010000:00010000:0.0:1789518530.260210:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518530.260214:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260219:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260229:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260232:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260246:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260249:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518530.260251:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260254:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260258:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff99ffdfff5300) 00010000:00010000:0.0:1789518530.260260:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518530.260261:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260265:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260363:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5fa expref: 8 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260376:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c784b6a lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5fa expref: 7 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.260381:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:0.0:1789518530.260382:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789518530.260385:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00000100:00100000:0.0:1789518530.260458:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:25567:x1876445617215872:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1122us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518530.260476:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518530.262482:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.262596:0:31634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617216000 00000100:00100000:0.0:1789518530.262608:0:31634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617216000 00000100:00100000:0.0:1789518530.262732:0:31634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518530.262743:0:31634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:25567:x1876445617216000:12345-192.168.206.51@tcp:700:bash.0 00000100:00100000:0.0:1789518530.262840:0:31634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:25567:x1876445617216000:12345-192.168.206.51@tcp:700:bash.0 Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518530.262849:0:31634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1789518530.265970:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.266077:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617216256 00000100:00100000:0.0:1789518530.266089:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617216256 00000100:00100000:0.0:1789518530.266161:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1789518530.266173:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:25567:x1876445617216256:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518530.266197:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518530.266224:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784b71 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd601 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.266716:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.266735:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.266748:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.266764:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.266784:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.266792:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.266982:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b86 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.266993:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b86 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267000:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b86 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518530.267011:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:0.0:1789518530.267167:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267176:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267184:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267190:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518530.267196:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267205:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267229:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:0.0:1789518530.267233:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518530.267240:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267247:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784b78 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267260:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267267:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267273:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267278:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518530.267281:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267287:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267295:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff99ffdfff5300) 00010000:00010000:0.0:1789518530.267297:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518530.267300:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267307:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784b7f lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267370:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784b71 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd601 expref: 10 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267386:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b86 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd601 expref: 9 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.267394:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:0.0:1789518530.267396:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518530.267400:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:0.0:1789518530.267486:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:25567:x1876445617216256:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1315us (1524us total) trans 25769803796 rc 0/0 00000100:00100000:0.0:1789518530.267496:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1789518530.273231:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518530.273340:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617216512 00000100:00100000:3.0:1789518530.273353:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617216512 00000100:00100000:3.0:1789518530.273433:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1789518530.273446:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:25567:x1876445617216512:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:3.0:1789518530.273531:0:31624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518530.273577:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784b86 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd601 expref: 9 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518530.273600:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:3.0:1789518530.273607:0:31624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518530.273939:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518530.273957:0:31624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5de expref: 10 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518530.273966:0:31624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518530.274005:0:31624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5de expref: 10 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518530.274022:0:31624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5de expref: 10 pid: 31625 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518530.274037:0:31624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31624:1876445627610752:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518530.274215:0:31624:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518530.276194:0:31624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31624:1876445627610752:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518530.276262:0:31624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518530.276388:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.276465:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617216640 00000100:00100000:2.0:1789518530.276475:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617216640 00010000:00010000:2.0:1789518530.276541:0:33738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5de expref: 11 pid: 31625 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518530.276594:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518530.276604:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:2343:x1876445617216640:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518530.276656:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518530.276664:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5de expref: 11 pid: 31625 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.276678:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5de expref: 11 pid: 31625 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.276716:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784afa lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5de expref: 11 pid: 31625 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.276735:0:33738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:2.0:1789518530.276741:0:33738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.276752:0:33738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.276759:0:33738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.276796:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1789518530.276837:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518530.276863:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:2343:x1876445617216640:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 259us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518530.276872:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00010000:00010000:0.0:1789518530.276988:0:31624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.277000:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518530.277196:0:31624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803797 00000004:00010000:0.0:1789518530.277264:0:31624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b57326e9 reply state 000000001b569edd transno 25769803798 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518530.277275:0:31624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518530.277371:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:25567:x1876445617216512:12345-192.168.206.51@tcp:36:bash.0 Request processed in 3928us (4216us total) trans 25769803798 rc 0/0 00000100:00100000:0.0:1789518530.277380:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000020:00080000:0.0:1789518530.277385:0:31624:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518530.278637:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.278652:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.278660:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.278667:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518530.278672:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.278702:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.278717:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:2.0:1789518530.278721:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518530.278726:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.278732:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784b94 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518530.279113:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.279183:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617216768 00000100:00100000:0.0:1789518530.279199:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617216768 00000100:00100000:0.0:1789518530.279301:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:0.0:1789518530.279313:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:25567:x1876445617216768:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518530.279344:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518530.279375:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784b9b lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd608 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.279437:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784b9b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd608 expref: 11 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.279452:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784b9b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd608 expref: 11 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.279471:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:0.0:1789518530.279474:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518530.279476:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697c00, rc 0) 00000100:00100000:0.0:1789518530.279533:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:25567:x1876445617216768:12345-192.168.206.51@tcp:101:bash.0 Request processed in 223us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518530.279541:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:1.0:1789518530.281553:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.281941:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617217024 00000100:00100000:0.0:1789518530.281953:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617217024 00000100:00100000:0.0:1789518530.282022:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518530.282033:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:25567:x1876445617217024:12345-192.168.206.51@tcp:103:bash.0 00010000:00010000:0.0:1789518530.282059:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518530.282086:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784b9b lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd608 expref: 11 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.282143:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:0.0:1789518530.282149:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518530.282228:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:25567:x1876445617217024:12345-192.168.206.51@tcp:103:bash.0 Request processed in 196us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518530.282236:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1789518530.283786:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.283902:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617217152 00000100:00100000:0.0:1789518530.283912:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617217152 00000100:00100000:0.0:1789518530.284010:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1789518530.284022:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:25567:x1876445617217152:12345-192.168.206.51@tcp:58:bash.0 00010000:00010000:0.0:1789518530.284147:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.284168:0:31625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d0 expref: 9 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.284179:0:31625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.284219:0:31625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d0 expref: 9 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.284252:0:31625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d0 expref: 9 pid: 31624 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518530.284271:0:31625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627610880:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518530.284373:0:31625:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518530.288019:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.288023:0:31625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627610880:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518530.288070:0:31625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518530.288086:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617217280 00000100:00100000:2.0:1789518530.288096:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617217280 00010000:00010000:2.0:1789518530.288145:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d0 expref: 10 pid: 31624 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518530.288187:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518530.288197:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:2343:x1876445617217280:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518530.288217:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518530.288225:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d0 expref: 10 pid: 31624 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.288239:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d0 expref: 10 pid: 31624 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.288264:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784abb lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5d0 expref: 10 pid: 31624 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.288304:0:31611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:2.0:1789518530.288310:0:31611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.288320:0:31611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.288329:0:31611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.288360:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518530.288383:0:31625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.288392:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518530.288429:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:2343:x1876445617217280:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 232us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518530.288438:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000040:00080000:0.0:1789518530.289405:0:31625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518530.289581:0:31625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 64 off8576 00000040:00080000:0.0:1789518530.289718:0:31625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].1, 136 off8328 00000100:00100000:0.0:1789518530.289927:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:25567:x1876445617217152:12345-192.168.206.51@tcp:58:bash.0 Request processed in 5901us (6140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518530.289941:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:3.0:1789518530.291896:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.292033:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617217408 00000100:00100000:2.0:1789518530.292083:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617217408 00000100:00100000:2.0:1789518530.292160:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1789518530.292172:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:25567:x1876445617217408:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518530.292253:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518530.292290:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c784ba9 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd60f expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.292361:0:31626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 2/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.292371:0:31626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c784ba9 lrc: 4/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd60f expref: 11 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.292405:0:31626:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.292422:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c784ba9 lrc: 3/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd60f expref: 11 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.292434:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:2.0:1789518530.292436:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518530.292439:0:31626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c784ba9 lrc: 3/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd60f expref: 11 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.292444:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:2.0:1789518530.292499:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:25567:x1876445617217408:12345-192.168.206.51@tcp:101:bash.0 Request processed in 330us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518530.292507:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00010000:00010000:1.0:1789518530.738905:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518530.930918:0:31656:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1789518530.930928:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518530.930969:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 2 00000040:00080000:2.0:1789518530.930975:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1789518530.931152:0:31656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7881880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:31656:1876445627611008:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518530.931364:0:31656:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518530.933581:0:31656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7881880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:31656:1876445627611008:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518530.934441:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.934575:0:31635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617217536 00000100:00100000:0.0:1789518530.934585:0:31635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617217536 00000100:00100000:0.0:1789518530.934709:0:31635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518530.934720:0:31635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27878:x1876445617217536:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789518530.934824:0:31635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27878:x1876445617217536:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 Request processed in 105us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518530.934831:0:31635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518530.936696:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518530.936796:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617217664 00000100:00100000:1.0:1789518530.936815:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617217664 00000100:00100000:1.0:1789518530.936875:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518530.936885:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27878:x1876445617217664:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518530.936924:0:31624:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b11:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518530.937058:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27878:x1876445617217664:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 165us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518530.937066:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:3.0:1789518530.939610:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.939900:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617217792 00000100:00100000:0.0:1789518530.939911:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617217792 00000100:00100000:0.0:1789518530.940058:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518530.940071:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27878:x1876445617217792:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789518530.940166:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940215:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940232:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940262:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940270:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940277:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940304:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940311:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940317:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518530.940364:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789518530.940369:0:32331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518530.940386:0:32331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940399:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940417:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940425:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940432:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518530.940438:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940446:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940460:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffe6f98b00) 00010000:00010000:0.0:1789518530.940464:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518530.940471:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940477:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940498:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940505:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940511:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940517:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518530.940527:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940534:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940542:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb72e0cac (ffff99ffdfff5300) 00010000:00010000:0.0:1789518530.940545:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518530.940548:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940555:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784bb7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940573:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940578:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940582:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940584:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518530.940586:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940589:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940594:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:0.0:1789518530.940595:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518530.940603:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.940607:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bbe lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518530.940741:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27878:x1876445617217792:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 672us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518530.940751:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:3.0:1789518530.942576:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518530.942738:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617218048 00000100:00100000:1.0:1789518530.942750:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617218048 00000100:00100000:1.0:1789518530.942800:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1789518530.942811:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:27878:x1876445617218048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518530.942835:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518530.942857:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784bc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd616 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.942987:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943004:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943016:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518530.943027:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789518530.943166:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943175:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943182:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943188:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518530.943193:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943212:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943225:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:1.0:1789518530.943228:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518530.943233:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943330:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784bcc lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943382:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784bc5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd616 expref: 11 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943393:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffe6f98b00) 00010000:00010000:1.0:1789518530.943396:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518530.943400:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784bc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd616 expref: 11 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.943410:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1c00, rc 0) 00000100:00100000:1.0:1789518530.943477:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:27878:x1876445617218048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 667us (906us total) trans 25769803799 rc 301/301 00000100:00100000:1.0:1789518530.943484:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:3.0:1789518530.944900:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.945025:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617218176 00000100:00100000:2.0:1789518530.945034:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617218176 00000100:00100000:2.0:1789518530.945118:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:2.0:1789518530.945127:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:27878:x1876445617218176:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518530.945172:0:31626:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b11:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518530.945277:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:27878:x1876445617218176:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 150us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518530.945285:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1789518530.947100:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.947453:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617218432 00000100:00100000:0.0:1789518530.947463:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617218432 00000100:00100000:0.0:1789518530.947567:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1789518530.947579:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:27878:x1876445617218432:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518530.947603:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518530.947651:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bda lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd61d expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518530.948902:0:31625:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x64:0x0], count =62 00000004:00080000:0.0:1789518530.948912:0:31625:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x64:0x0]+62 in llog 00000004:00080000:0.0:1789518530.948961:0:31625:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa2:0x0], index 1: 0 00010000:00010000:0.0:1789518530.949466:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784be1 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.949485:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784be1 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.949499:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784be1 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.949571:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784bda lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd61d expref: 13 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.949608:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784be1 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd61d expref: 12 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.949715:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffdfff5300) 00010000:00010000:0.0:1789518530.949718:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518530.949722:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696c00, rc 0) 00000100:00100000:0.0:1789518530.949805:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+12:27878:x1876445617218432:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2227us (2712us total) trans 25769803800 rc 0/0 00000100:00100000:0.0:1789518530.949814:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:3.0:1789518530.951866:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.952241:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617218688 00000100:00100000:0.0:1789518530.952254:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617218688 00000100:00100000:0.0:1789518530.952402:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1789518530.952414:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+12:27878:x1876445617218688:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518530.952473:0:32331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518530.952505:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784be1 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd61d expref: 12 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952534:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffdfff5300) 00010000:00010000:0.0:1789518530.952545:0:32331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518530.952567:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952591:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952601:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952690:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952700:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952707:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952906:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952914:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952922:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952927:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518530.952932:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952939:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952948:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:0.0:1789518530.952951:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518530.952955:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952961:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784bef lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952980:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952985:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952991:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.952996:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518530.952999:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.953006:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.953014:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0xe32d1f10 (ffff99ffdfff5a00) 00010000:00010000:0.0:1789518530.953016:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518530.953019:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.953026:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784bf6 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0xe32d1f10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518530.953131:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27878:x1876445617218688:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 719us (1271us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518530.953138:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1789518530.955362:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518530.956388:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617218816 00000100:00100000:1.0:1789518530.956403:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617218816 00000100:00100000:1.0:1789518530.956525:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518530.956537:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27878:x1876445617218816:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518530.956563:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518530.956592:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784bfd lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd624 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.956666:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.956682:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.956712:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.956820:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784bfd lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd624 expref: 13 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.956838:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd624 expref: 12 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.956847:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518530.956850:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518530.956854:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1800, rc 0) 00000100:00100000:1.0:1789518530.956927:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+12:27878:x1876445617218816:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 392us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518530.956934:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1789518530.958564:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.958710:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617219072 00000100:00100000:2.0:1789518530.958719:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617219072 00000100:00100000:2.0:1789518530.958838:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:2.0:1789518530.958850:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+12:27878:x1876445617219072:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518530.958937:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.958956:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.958968:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518530.959509:0:31626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].2, 88 off8344 00000004:00080000:2.0:1789518530.959522:0:31626:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584955907201ns, next at 585955903887ns, rc = 0 00000004:00010000:2.0:1789518530.959658:0:31626:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4dee4e5 reply state 00000000ddaa5019 transno 25769803801 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518530.959668:0:31626:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518530.959789:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+14:27878:x1876445617219072:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 940us (1229us total) trans 25769803801 rc 0/0 00000100:00100000:2.0:1789518530.959797:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00010000:00010000:2.0:1789518530.961033:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.961070:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.961079:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.961087:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518530.961092:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.961100:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.961119:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:2.0:1789518530.961122:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518530.961128:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.961135:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c0b lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518530.961508:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.961836:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617219200 00000100:00100000:0.0:1789518530.961847:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617219200 00000100:00100000:0.0:1789518530.961908:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1789518530.961929:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+13:27878:x1876445617219200:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518530.961959:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518530.961981:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd62b expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.962064:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd62b expref: 14 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.962081:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd62b expref: 14 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518530.962105:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:0.0:1789518530.962107:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518530.962110:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697000, rc 0) 00000100:00100000:0.0:1789518530.962170:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+14:27878:x1876445617219200:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 243us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518530.962178:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1789518530.966373:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518530.966481:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617219328 00000100:00100000:1.0:1789518530.966491:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617219328 00000100:00100000:1.0:1789518530.966580:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518530.966592:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2343:x1876445617219328:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789518530.966995:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518530.967061:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617219328:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 470us (696us total) trans 25769803778 rc 0/0 00000100:00100000:1.0:1789518530.967070:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518530.968965:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518530.969031:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617219584 00000100:00100000:1.0:1789518530.969041:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617219584 00000100:00100000:1.0:1789518530.969118:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518530.969130:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+14:27878:x1876445617219584:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518530.969453:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+15:27878:x1876445617219584:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 326us (495us total) trans 25769803802 rc 0/0 00000100:00100000:1.0:1789518530.969461:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518530.971379:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.971654:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617219840 00000100:00100000:0.0:1789518530.971665:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617219840 00000100:00100000:0.0:1789518530.971729:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:0.0:1789518530.971741:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+15:27878:x1876445617219840:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518530.971862:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+15:27878:x1876445617219840:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 123us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518530.971872:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:3.0:1789518530.974893:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518530.975033:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617219968 00000100:00100000:1.0:1789518530.975044:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617219968 00000100:00100000:1.0:1789518530.975119:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1789518530.975129:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+15:27878:x1876445617219968:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518530.975153:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518530.975180:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784c19 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd632 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.975304:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784c20 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.975321:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784c20 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.975336:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784c20 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518530.975380:0:31624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518530.975401:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784c20 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.975431:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784c19 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd632 expref: 17 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.975453:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784c20 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd632 expref: 16 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518530.975485:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518530.975489:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518530.975493:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1400, rc 0) 00000100:00100000:1.0:1789518530.975678:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:27878:x1876445617219968:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 550us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518530.975687:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1789518530.979008:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.979171:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617220096 00000100:00100000:2.0:1789518530.979185:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617220096 00000100:00100000:2.0:1789518530.979354:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1789518530.979367:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617220096:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518530.979393:0:32306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518530.979424:0:32306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd639 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518530.979596:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e2c3, blocks: 0x1 00010000:00010000:2.0:1789518530.979870:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1789518530.979877:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518530.979890:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd639 expref: 7 pid: 32306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.979915:0:32306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd639 expref: 7 pid: 32306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.979931:0:32306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:2.0:1789518530.980100:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617220096:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 735us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518530.980109:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518530.985026:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.985213:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617220352 00000100:00100000:2.0:1789518530.985227:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617220352 00000100:00100000:2.0:1789518530.985299:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:2.0:1789518530.985311:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:27878:x1876445617220352:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518530.985502:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:27878:x1876445617220352:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 193us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518530.985511:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1789518530.987747:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.987820:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617220480 00000100:00100000:2.0:1789518530.987832:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617220480 00000100:00100000:2.0:1789518530.987892:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:2.0:1789518530.987904:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:27878:x1876445617220480:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518530.987946:0:32309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518530.987970:0:32309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd640 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.988009:0:32309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd639 expref: 8 pid: 32306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.988018:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518530.988023:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518530.988028:0:32309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 8 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.988083:0:32309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd639 expref: 8 pid: 32306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.988099:0:32309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd639 expref: 8 pid: 32306 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518530.988117:0:32309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:32309:1876445627611136:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518530.988229:0:32309:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc61540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518530.989921:0:32309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:32309:1876445627611136:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518530.989960:0:32309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 8 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.989981:0:32309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:2.0:1789518530.990065:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:27878:x1876445617220480:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2162us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518530.990074:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518530.990287:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.990368:0:31610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617220608 00000100:00100000:2.0:1789518530.990377:0:31610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617220608 00010000:00010000:2.0:1789518530.990410:0:31610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd639 expref: 8 pid: 32306 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518530.990449:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:2.0:1789518530.990458:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2343:x1876445617220608:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518530.990473:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518530.990500:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd639 expref: 8 pid: 32306 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.990515:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd639 expref: 8 pid: 32306 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.990542:0:31610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084b6d432/0x631fd8698c784c27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd639 expref: 8 pid: 32306 timeout: 684 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.990557:0:31610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518530.990562:0:31610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518530.990570:0:31610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 7 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.990582:0:31610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 7 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518530.990666:0:31610:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 7 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518530.990681:0:31610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:31610:1876445627611264:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518530.990748:0:31610:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc61540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518530.991826:0:31610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:31610:1876445627611264:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518530.991844:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518530.991885:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2343:x1876445617220608:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1428us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518530.991895:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:0.0:1789518530.992961:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518530.993043:0:32314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617220736 00000100:00100000:2.0:1789518530.993062:0:32314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617220736 00002000:00100000:2.0:1789518530.993124:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->8) req@ffff99fff4b1c380 x1876445617220736/t0(0) o4->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:176/0 lens 504/0 e 0 to 0 dl 1789518541 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518530.993136:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1c380 with x1876445617220736 ext(0->8) 00002000:00010000:2.0:1789518530.993142:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1c380 00000100:00100000:2.0:1789518530.993174:0:32314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518530.993183:0:32314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2343:x1876445617220736:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518530.993809:0:32314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:2343:x1876445617220736:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 624us (849us total) trans 25769803779 rc 0/0 00000100:00100000:2.0:1789518530.993818:0:32314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:2.0:1789518530.993826:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->8) req@ffff99fff4b1c380 x1876445617220736/t25769803779(0) o4->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:176/0 lens 504/448 e 0 to 0 dl 1789518541 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518530.993847:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1c380 with x1876445617220736 ext(0->8) 00002000:00010000:2.0:1789518530.993852:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1c380 00000100:00100000:3.0:1789518530.997442:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518530.997564:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617220864 00000100:00100000:0.0:1789518530.997592:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617220864 00000100:00100000:0.0:1789518530.997681:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1789518530.997691:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:27878:x1876445617220864:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789518531.017030:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803800 is committed 00000001:00080000:3.0:1789518531.017069:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803798 is committed 00000001:00080000:3.0:1789518531.017836:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803802 is committed 00000004:00080000:3.0:1789518531.017934:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789518531.017960:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836516 batchid updated 00000100:00100000:2.0:1789518531.018136:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518531.018161:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627611392:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1789518531.018216:0:31663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00000020:00080000:0.0:1789518531.018231:0:31663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00000100:00100000:3.0:1789518531.018246:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+12:27878:x1876445617220864:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 20553us (20891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518531.018261:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:2.0:1789518531.018332:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518531.018390:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627611392 00000100:00100000:0.0:1789518531.018401:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627611392 00000100:00080000:3.0:1789518531.018442:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518531.018462:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518531.018482:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627611392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789518531.018687:0:32579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789518531.018692:0:32579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb mtime from disk: 0 -> 1789518531 00002000:00010000:0.0:1789518531.018695:0:32579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518531.018698:0:32579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb ctime from disk: 1789518531 -> 1789518531 00002000:00010000:0.0:1789518531.018701:0:32579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518531.018742:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627611392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (409us total) trans 25769803780 rc 0/0 00000100:00100000:0.0:1789518531.018749:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:2.0:1789518531.018777:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff7883480/2, rc 0, transno 25769803780 00000100:00100000:2.0:1789518531.018786:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627611392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518531.019940:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.019998:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617220992 00000100:00100000:2.0:1789518531.020005:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617220992 00000100:00100000:2.0:1789518531.020064:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518531.020074:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:2342:x1876445617220992:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789518531.035775:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803780 is committed 00000001:00080000:0.0:1789518531.035797:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803778 is committed 00000001:00080000:0.0:1789518531.035806:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803779 is committed 00000100:00100000:0.0:1789518531.035943:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617220992:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 15863us (16001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518531.035955:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518531.037589:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.037718:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617221248 00000100:00100000:0.0:1789518531.037730:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617221248 00000100:00100000:0.0:1789518531.037854:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:0.0:1789518531.037867:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+12:27878:x1876445617221248:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518531.038005:0:32331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518531.038038:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784c20 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd632 expref: 12 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.038072:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:0.0:1789518531.038078:0:32331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518531.038110:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.038126:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.038136:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518531.038344:0:32331:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d34226d reply state 00000000e2647ce8 transno 25769803803 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.038354:0:32331:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518531.038516:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+13:27878:x1876445617221248:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 651us (934us total) trans 25769803803 rc 0/0 00000100:00100000:0.0:1789518531.038525:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00010000:00010000:2.0:1789518531.039542:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.039556:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.039564:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.039571:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518531.039577:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.039586:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.039600:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:2.0:1789518531.039651:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518531.039658:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.039664:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784c35 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518531.039870:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.039997:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617221376 00000100:00100000:2.0:1789518531.040010:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617221376 00000100:00100000:2.0:1789518531.040090:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518531.040102:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617221376:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518531.040441:0:32306:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789518531.040445:0:32306:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb mtime from disk: 1789518531 -> 1789518530 00002000:00010000:2.0:1789518531.040447:0:32306:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb atime from disk: 0 -> 1789518527 00002000:00010000:2.0:1789518531.040450:0:32306:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb ctime from disk: 1789518531 -> 1789518530 00002000:00010000:2.0:1789518531.040452:0:32306:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789518531.040516:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617221376:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 417us (648us total) trans 25769803781 rc 0/0 00000100:00100000:2.0:1789518531.040525:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518531.041706:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.041781:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617221632 00000100:00100000:1.0:1789518531.041792:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617221632 00000100:00100000:1.0:1789518531.041854:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518531.041868:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+12:27878:x1876445617221632:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789518531.041941:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.041959:0:31624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd624 expref: 12 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.041969:0:31624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.042037:0:31624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd624 expref: 12 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.042065:0:31624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd624 expref: 12 pid: 31624 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.042161:0:31624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31624:1876445627611520:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518531.042276:0:31624:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc30633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518531.043678:0:31624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31624:1876445627611520:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518531.043701:0:31624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518531.043809:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.043859:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617221760 00000100:00100000:2.0:1789518531.043865:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617221760 00010000:00010000:2.0:1789518531.043892:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd624 expref: 13 pid: 31624 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.043925:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1789518531.043936:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+13:2343:x1876445617221760:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518531.043951:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518531.043960:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd624 expref: 13 pid: 31624 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.043986:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd624 expref: 13 pid: 31624 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.044011:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784c04 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd624 expref: 13 pid: 31624 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.044028:0:31611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:2.0:1789518531.044034:0:31611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.044044:0:31611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.044068:0:31611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.044100:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518531.044147:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+12:2343:x1876445617221760:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 213us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518531.044156:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00010000:00010000:0.0:1789518531.044164:0:31624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.044171:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.044206:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.044211:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.044216:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.044220:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518531.044224:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.044230:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.044237:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:0.0:1789518531.044240:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789518531.044243:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.044247:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784c3c lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.044292:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27878:x1876445617221632:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 2426us (2592us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789518531.044299:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:3.0:1789518531.045365:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.045411:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617221888 00000100:00100000:1.0:1789518531.045420:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617221888 00000100:00100000:1.0:1789518531.045505:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518531.045515:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2343:x1876445617221888:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789518531.045559:0:32309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.045580:0:32309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 7 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.045590:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789518531.045595:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518531.045601:0:32309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.045668:0:32309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 7 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.045683:0:32309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 7 pid: 32309 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.045707:0:32309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:32309:1876445627611648:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518531.045809:0:32309:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518531.047837:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.047918:0:32309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:32309:1876445627611648:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518531.047946:0:32309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.047989:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617222016 00000100:00100000:0.0:1789518531.047996:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617222016 00010000:00010000:0.0:1789518531.048028:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 8 pid: 32309 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.048100:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518531.048111:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2342:x1876445617222016:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518531.048128:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518531.048156:0:31609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 8 pid: 32309 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.048171:0:31609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 8 pid: 32309 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.048198:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c784c2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd640 expref: 8 pid: 32309 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.048215:0:31609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518531.048220:0:31609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518531.048227:0:31609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.048239:0:31609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.048271:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518531.048323:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617222016:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 213us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518531.048331:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00010000:00010000:2.0:1789518531.048457:0:32309:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.048480:0:32309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.048509:0:32309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.048519:0:32309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.048528:0:32309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.048536:0:32309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518531.048541:0:32309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.048551:0:32309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.048565:0:32309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.048573:0:32309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c7b855e/0x631fd8698c784c43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.048719:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617221888:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 3205us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518531.048728:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1789518531.050461:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.050527:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617222272 00000100:00100000:2.0:1789518531.050539:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617222272 00000100:00100000:2.0:1789518531.050593:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:2.0:1789518531.050602:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+11:27878:x1876445617222272:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789518531.050726:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.050747:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.050761:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.051044:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.051071:0:31626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd62b expref: 12 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.051079:0:31626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.051119:0:31626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd62b expref: 12 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.051151:0:31626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd62b expref: 12 pid: 31625 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.051166:0:31626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627611776:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518531.051281:0:31626:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518531.052579:0:31626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627611776:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518531.052647:0:31626:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518531.052863:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.053663:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617222400 00000100:00100000:1.0:1789518531.053674:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617222400 00010000:00010000:1.0:1789518531.053776:0:33738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd62b expref: 13 pid: 31625 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.053890:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518531.053901:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff55c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+13:2342:x1876445617222400:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518531.053915:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518531.053923:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd62b expref: 13 pid: 31625 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.053950:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd62b expref: 13 pid: 31625 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.053971:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784c12 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd62b expref: 13 pid: 31625 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.053986:0:33738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:1.0:1789518531.053991:0:33738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.054000:0:33738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.054008:0:33738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.054071:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518531.054119:0:31626:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.054130:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.054136:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff55c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+12:2342:x1876445617222400:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 235us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518531.054146:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000001:00080000:2.0:1789518531.054434:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803804 00000001:00080000:2.0:1789518531.054558:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803805 00000001:00080000:2.0:1789518531.054594:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803806 00000100:00100000:2.0:1789518531.054688:0:31626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31626:1876445627611904:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789518531.054729:0:31626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518531.054759:0:31626:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc11cac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518531.054822:0:31630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627611904 00000100:00100000:0.0:1789518531.054834:0:31630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627611904 00000100:00100000:0.0:1789518531.054895:0:31630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518531.054906:0:31630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31626:x1876445627611904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518531.055035:0:31630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31626:x1876445627611904:12345-0@lo:1000:mdt00_002.0 Request processed in 131us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518531.055059:0:31630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518531.055209:0:31626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803780 gen 2 00000004:00080000:2.0:1789518531.055220:0:31626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff7883480, transno 25769803780 00000100:00100000:2.0:1789518531.055243:0:31626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31626:1876445627611904:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789518531.055936:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803807 00000100:00100000:2.0:1789518531.056004:0:31626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31626:1876445627612032:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789518531.056064:0:31626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518531.056098:0:31626:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518531.056131:0:31630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627612032 00000100:00100000:0.0:1789518531.056137:0:31630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627612032 00000100:00100000:0.0:1789518531.056163:0:31630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518531.056170:0:31630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31626:x1876445627612032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518531.056369:0:31630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31626:x1876445627612032:12345-0@lo:1000:mdt00_002.0 Request processed in 198us (303us total) trans 25769803782 rc 0/0 00000100:00100000:0.0:1789518531.056377:0:31630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518531.056444:0:31626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31626:1876445627612032:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789518531.056535:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056548:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056556:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056563:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518531.056569:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056579:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056595:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffc2fdcd00) 00010000:00010000:2.0:1789518531.056599:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518531.056605:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056611:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784c51 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056760:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056767:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056781:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056786:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518531.056789:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056796:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056818:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:2.0:1789518531.056821:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518531.056828:0:31626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c784ba9 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd60f expref: 7 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056841:0:31626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c784ba9 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd60f expref: 7 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056851:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c784ba9 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd60f expref: 7 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.056879:0:31626:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c784ba9 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd60f expref: 7 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.056891:0:31626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627612160:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518531.056964:0:31626:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518531.059484:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.059512:0:31626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627612160:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518531.059556:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617222528 00010000:00010000:2.0:1789518531.059564:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.059571:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617222528 00010000:00010000:2.0:1789518531.059577:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ba2 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059655:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.059666:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00010000:00010000:2.0:1789518531.059673:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.059683:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+8:25567:x1876445617222528:12345-192.168.206.51@tcp:49:bash.0 00010000:00010000:2.0:1789518531.059695:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059709:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059717:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059724:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059731:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518531.059736:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059744:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059757:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:2.0:1789518531.059767:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518531.059774:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059793:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784c58 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059808:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059815:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.059824:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+8:25567:x1876445617222528:12345-192.168.206.51@tcp:49:bash.0 Request processed in 142us (343us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518531.059828:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059840:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00000100:00100000:1.0:1789518531.059841:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00010000:00010000:2.0:1789518531.059846:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059856:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059975:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:2.0:1789518531.059978:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518531.059982:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.059989:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784c4a lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.060253:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+15:27878:x1876445617222272:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 9650us (9803us total) trans 25769803808 rc 0/0 00000100:00100000:2.0:1789518531.060274:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000020:00080000:2.0:1789518531.060280:0:31626:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789518531.060415:0:31656:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1789518531.060420:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518531.060452:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 2 00000040:00080000:3.0:1789518531.060460:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1789518531.061554:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518531.061609:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617222656 00000100:00100000:3.0:1789518531.061652:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617222656 00000100:00080000:2.0:1789518531.061699:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518531.061741:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1789518531.061749:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:25567:x1876445617222656:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518531.061766:0:32579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518531.061783:0:32579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd647 expref: -99 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518531.061806:0:32579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa2:0x0] initial LVB size: 9, mtime: 0x6aa9e2c2, atime: 0x6aa9e2bf, ctime: 0x6aa9e2c2, blocks: 0xb 00010000:00010000:2.0:1789518531.061827:0:32579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=585s v=(0 0) 00010000:00010000:2.0:1789518531.061831:0:32579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518531.061842:0:32579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 6 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.061855:0:32579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 6 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.061865:0:32579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:2.0:1789518531.061905:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:25567:x1876445617222656:12345-192.168.206.51@tcp:101:bash.0 Request processed in 158us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518531.061910:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1789518531.062349:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.062414:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617222912 00000100:00100000:0.0:1789518531.062421:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617222912 00000100:00100000:0.0:1789518531.062471:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518531.062480:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+15:27878:x1876445617222912:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789518531.063345:0:31627:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789518531.063477:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803809 00010000:00010000:0.0:1789518531.063531:0:31627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.063547:0:31627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.063572:0:31627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.063582:0:31627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.063589:0:31627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.063596:0:31627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.063645:0:31627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518531.063745:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:27878:x1876445617222912:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1264us (1401us total) trans 25769803810 rc 0/0 00000100:00100000:0.0:1789518531.063754:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000020:00080000:0.0:1789518531.063760:0:31627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789518531.063805:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.063961:0:32312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617223040 00000100:00100000:0.0:1789518531.063967:0:32312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617223040 00002000:00010000:0.0:1789518531.063990:0:32312:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/162 (0->18446744073709551615) 00002000:00100000:0.0:1789518531.063994:0:32312:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1008e00 with x1876445617223040 ext(0->18446744073709551615) 00010000:00010000:1.0:1789518531.064001:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1789518531.064005:0:32312:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1008e00. 00010000:00010000:1.0:1789518531.064015:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.064028:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518531.064033:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.064056:0:32312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00010000:00010000:1.0:1789518531.064059:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.064072:0:32312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2342:x1876445617223040:12345-192.168.206.51@tcp:10:bash.0 00010000:00010000:1.0:1789518531.064099:0:31613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff99ffdfff5300) 00010000:00010000:1.0:1789518531.064104:0:31613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518531.064109:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 1/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.064139:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784c66 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.064171:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518531.064180:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518531.064182:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518531.064363:0:32312:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789518531.064368:0:32312:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb mtime from disk: 1789518530 -> 1789518530 00002000:00010000:0.0:1789518531.064372:0:32312:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb atime from disk: 1789518527 -> 1789518527 00002000:00010000:0.0:1789518531.064374:0:32312:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb ctime from disk: 1789518530 -> 1789518530 00002000:00010000:0.0:1789518531.064385:0:32312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789518531.064429:0:32312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:2342:x1876445617223040:12345-192.168.206.51@tcp:10:bash.0 Request processed in 363us (624us total) trans 25769803783 rc 0/0 00000100:00100000:0.0:1789518531.064438:0:32312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00002000:00010000:0.0:1789518531.064443:0:32312:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/162 (0->18446744073709551615) 00002000:00100000:0.0:1789518531.064446:0:32312:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1008e00 with x1876445617223040 ext(0->18446744073709551615) 00002000:00010000:0.0:1789518531.064454:0:32312:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1008e00. 00000100:00100000:2.0:1789518531.065781:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518531.065858:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617223296 00000100:00100000:3.0:1789518531.065868:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617223296 00000100:00100000:3.0:1789518531.065997:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:3.0:1789518531.066007:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+8:25567:x1876445617223296:12345-192.168.206.51@tcp:55:bash.0 00010000:00010000:3.0:1789518531.066077:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.066092:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.066102:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.066310:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.066318:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.066324:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.066330:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518531.066334:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.066341:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.066350:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:3.0:1789518531.066353:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789518531.066358:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.066363:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c6d lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518531.066438:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:25567:x1876445617223296:12345-192.168.206.51@tcp:55:bash.0 Request processed in 433us (666us total) trans 25769803811 rc 0/0 00000100:00100000:3.0:1789518531.066446:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:3.0:1789518531.068375:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.068448:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617223552 00000100:00100000:1.0:1789518531.068455:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617223552 00000100:00100000:1.0:1789518531.068556:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518531.068567:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:25567:x1876445617223552:12345-192.168.206.51@tcp:35:bash.0 00000001:00080000:1.0:1789518531.068870:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803812 00000100:00100000:1.0:1789518531.068990:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:25567:x1876445617223552:12345-192.168.206.51@tcp:35:bash.0 Request processed in 423us (619us total) trans 25769803813 rc 0/0 00000100:00100000:1.0:1789518531.068998:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000020:00080000:1.0:1789518531.069004:0:31628:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789518531.104678:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.104808:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617223808 00000100:00100000:0.0:1789518531.104818:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617223808 00000100:00100000:0.0:1789518531.104871:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:0.0:1789518531.104942:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:27888:x1876445617223808:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518531.104967:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518531.104987:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784c74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd64e expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518531.105074:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789518531.105196:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784c74 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd64e expref: 19 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.105209:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98700) 00010000:00010000:0.0:1789518531.105212:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518531.105218:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784c74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd64e expref: 19 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.105231:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696200, rc 0) 00000100:00100000:0.0:1789518531.105289:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:27888:x1876445617223808:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 409us (620us total) trans 25769803814 rc 301/301 00000100:00100000:0.0:1789518531.105305:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:2.0:1789518531.108088:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518531.108676:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617223936 00000100:00100000:3.0:1789518531.108685:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617223936 00000100:00100000:3.0:1789518531.108741:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1789518531.108751:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:27888:x1876445617223936:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1789518531.108819:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.108834:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.108844:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.108858:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.108865:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.108872:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109117:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109127:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109135:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518531.109172:0:31625:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109182:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109194:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109458:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109464:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518531.109467:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109519:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109529:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:3.0:1789518531.109531:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518531.109536:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109542:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784c82 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109556:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109562:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109568:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109573:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518531.109584:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109591:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109599:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff99ffe6f98600) 00010000:00010000:3.0:1789518531.109601:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518531.109605:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109611:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784c89 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109663:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109669:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109676:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109681:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518531.109684:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109691:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109699:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:3.0:1789518531.109702:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518531.109712:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.109719:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784c90 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518531.110040:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:27888:x1876445617223936:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1279us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518531.110061:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1789518531.112368:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.112417:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617224192 00000100:00100000:0.0:1789518531.112426:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617224192 00000100:00100000:0.0:1789518531.112516:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518531.112526:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:27888:x1876445617224192:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518531.112758:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+19:27888:x1876445617224192:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 232us (397us total) trans 25769803815 rc 0/0 00000100:00100000:0.0:1789518531.112766:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518531.153729:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.153809:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617224448 00000100:00100000:2.0:1789518531.153819:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617224448 00000100:00100000:2.0:1789518531.153871:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1789518531.153881:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+19:27895:x1876445617224448:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1789518531.153904:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518531.153924:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c784c97 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd655 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.153993:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154006:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154016:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154029:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154036:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154042:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154430:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154440:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154460:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518531.154471:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:2.0:1789518531.154559:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154567:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154574:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154580:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518531.154584:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154592:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154603:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:2.0:1789518531.154606:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518531.154638:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154645:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784c9e lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154659:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154665:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154678:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154683:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518531.154686:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154692:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154774:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff99ffd8a16b00) 00010000:00010000:2.0:1789518531.154781:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518531.154785:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154790:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784ca5 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154854:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c784c97 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd655 expref: 22 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154933:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd655 expref: 21 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.154940:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:2.0:1789518531.154942:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518531.154945:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7000, rc 0) 00000100:00100000:2.0:1789518531.155007:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+21:27895:x1876445617224448:12345-192.168.206.51@tcp:101:cat.0 Request processed in 1127us (1288us total) trans 25769803816 rc 0/0 00000100:00100000:2.0:1789518531.155023:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1789518531.158553:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.158734:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617224576 00000100:00100000:0.0:1789518531.158744:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617224576 00000100:00100000:0.0:1789518531.158824:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1789518531.158832:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617224576:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:0.0:1789518531.158847:0:32308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518531.158862:0:32308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c784cba lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd65c expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.158929:0:32308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:32308:1876445627612288:192.168.206.51@tcp:106: 00000100:00100000:0.0:1789518531.159015:0:32308:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1840 going to sleep for 11 seconds 00002000:00010000:0.0:1789518531.161915:0:32308:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb size: 0 -> 14 00002000:00010000:0.0:1789518531.161926:0:32308:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb mtime: 1789518530 -> 1789518531 00002000:00010000:0.0:1789518531.161929:0:32308:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb ctime: 1789518530 -> 1789518531 00000100:00100000:0.0:1789518531.161952:0:32308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:32308:1876445627612288:192.168.206.51@tcp:106: 00010000:00010000:0.0:1789518531.162083:0:32308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c784cba lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd65c expref: 7 pid: 32308 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.162192:0:32308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c784cba lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd65c expref: 7 pid: 32308 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.162204:0:32308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696200, rc 0) 00000100:00100000:0.0:1789518531.162303:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617224576:12345-192.168.206.51@tcp:101:cat.0 Request processed in 3470us (3760us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518531.162312:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:1.0:1789518531.165743:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.165870:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617224704 00000100:00100000:0.0:1789518531.165880:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617224704 00000100:00100000:0.0:1789518531.165937:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1789518531.165947:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:27895:x1876445617224704:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:0.0:1789518531.165962:0:32306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518531.165979:0:32306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd663 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.166009:0:32306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 6 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.166018:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518531.166023:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518531.166029:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.166075:0:32306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 6 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.166102:0:32306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 6 pid: 32579 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.166116:0:32306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:32306:1876445627612416:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518531.166287:0:32306:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518531.168539:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518531.168691:0:32314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617224832 00000100:00100000:3.0:1789518531.168698:0:32314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617224832 00002000:00100000:3.0:1789518531.168735:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->13) req@ffff99ffd1009c00 x1876445617224832/t0(0) o4->e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp:177/0 lens 504/0 e 0 to 0 dl 1789518542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518531.168743:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1009c00 with x1876445617224832 ext(0->13) 00010000:00010000:3.0:1789518531.168750:0:32314:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 7 pid: 32579 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.168761:0:32314:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 7 pid: 32579 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518531.168767:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ffd1009c00 00000100:00100000:3.0:1789518531.168817:0:32314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518531.168824:0:32314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:2342:x1876445617224832:12345-192.168.206.51@tcp:4:bash.0 00000100:00100000:0.0:1789518531.169129:0:32306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:32306:1876445627612416:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518531.169155:0:32306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.169246:0:32306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697400, rc 0) 00000100:00100000:3.0:1789518531.169274:0:32314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:2342:x1876445617224832:12345-192.168.206.51@tcp:4:bash.0 Request processed in 448us (742us total) trans 25769803784 rc 0/0 00000100:00100000:0.0:1789518531.169274:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:27895:x1876445617224704:12345-192.168.206.51@tcp:101:cat.0 Request processed in 3327us (3540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518531.169282:0:32314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518531.169282:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00002000:00100000:3.0:1789518531.169293:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->13) req@ffff99ffd1009c00 x1876445617224832/t25769803784(0) o4->e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp:177/0 lens 504/448 e 0 to 0 dl 1789518542 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518531.169301:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1009c00 with x1876445617224832 ext(0->13) 00010000:00010000:3.0:1789518531.169307:0:32314:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 9 pid: 32579 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.169319:0:32314:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 9 pid: 32579 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518531.169326:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ffd1009c00 00000100:00100000:3.0:1789518531.171690:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.172082:0:31610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617224960 00000100:00100000:2.0:1789518531.172092:0:31610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617224960 00010000:00010000:2.0:1789518531.172127:0:31610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 9 pid: 32579 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.172171:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518531.172181:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:2345:x1876445617224960:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518531.172197:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518531.172218:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 9 pid: 32579 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.172232:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 9 pid: 32579 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.172354:0:31610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078dfac31/0x631fd8698c784c5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd647 expref: 9 pid: 32579 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.172373:0:31610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518531.172378:0:31610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518531.172387:0:31610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 6 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.172415:0:31610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 6 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.172452:0:31610:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 6 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.172467:0:31610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:31610:1876445627612544:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518531.172605:0:31610:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9216c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518531.179724:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.179807:0:32312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617225088 00000100:00100000:0.0:1789518531.179816:0:32312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617225088 00002000:00100000:0.0:1789518531.179863:0:32312:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa2:0x0] (0->4095) req@ffff99fec28af480 x1876445617225088/t0(0) o3->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:177/0 lens 488/0 e 0 to 0 dl 1789518542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518531.179873:0:32312:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28af480 with x1876445617225088 ext(0->4095) 00002000:00010000:0.0:1789518531.179880:0:32312:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28af480 00000100:00100000:0.0:1789518531.179912:0:32312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1789518531.179922:0:32312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2343:x1876445617225088:12345-192.168.206.51@tcp:3:cat.0 00000100:00100000:0.0:1789518531.180182:0:32312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2343:x1876445617225088:12345-192.168.206.51@tcp:3:cat.0 Request processed in 260us (470us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518531.180200:0:32312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:0.0:1789518531.180207:0:32312:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa2:0x0] (0->4095) req@ffff99fec28af480 x1876445617225088/t0(0) o3->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:177/0 lens 488/4536 e 0 to 0 dl 1789518542 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518531.180215:0:32312:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28af480 with x1876445617225088 ext(0->4095) 00002000:00010000:0.0:1789518531.180218:0:32312:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28af480 00000100:00100000:2.0:1789518531.180451:0:31610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:31610:1876445627612544:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518531.180466:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518531.181471:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+8:2345:x1876445617224960:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 9283us (9783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518531.181482:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518531.186022:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.186131:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617225344 00000100:00100000:2.0:1789518531.186140:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617225344 00000100:00100000:2.0:1789518531.186243:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1789518531.186253:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+21:27895:x1876445617225344:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:2.0:1789518531.186478:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+22:27895:x1876445617225344:12345-192.168.206.51@tcp:35:cat.0 Request processed in 226us (467us total) trans 25769803817 rc 0/0 00000100:00100000:2.0:1789518531.186485:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000001:00080000:3.0:1789518531.206790:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803780 is committed 00000001:00080000:3.0:1789518531.206805:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803778 is committed 00000100:00100000:0.0:1789518531.255906:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.256004:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617225600 00000100:00100000:1.0:1789518531.256014:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617225600 00000100:00100000:1.0:1789518531.256082:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518531.256092:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+22:27853:x1876445617225600:12345-192.168.206.51@tcp:35:multiop.0 00000100:00100000:1.0:1789518531.256647:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+23:27853:x1876445617225600:12345-192.168.206.51@tcp:35:multiop.0 Request processed in 554us (752us total) trans 25769803818 rc 0/0 00000100:00100000:1.0:1789518531.256670:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518531.289593:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.289769:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617225856 00000100:00100000:0.0:1789518531.289780:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617225856 00000100:00100000:0.0:1789518531.289838:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1789518531.289848:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+23:27916:x1876445617225856:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:0.0:1789518531.289870:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518531.289889:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784cc8 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd66a expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.289985:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c784ccf lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.289995:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c784ccf lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.290003:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c784ccf lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518531.290011:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:0.0:1789518531.290137:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784cc8 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd66a expref: 26 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.290155:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c784ccf lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd66a expref: 25 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.290175:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:0.0:1789518531.290178:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789518531.290181:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696a00, rc 0) 00000100:00100000:0.0:1789518531.290300:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+25:27916:x1876445617225856:12345-192.168.206.51@tcp:101:cat.0 Request processed in 452us (716us total) trans 25769803819 rc 0/0 00000100:00100000:0.0:1789518531.290308:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1789518531.300741:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518531.300952:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617226112 00000100:00100000:0.0:1789518531.300964:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617226112 00000100:00100000:0.0:1789518531.301112:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:0.0:1789518531.301125:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:27917:x1876445617226112:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:0.0:1789518531.301160:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518531.301184:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784cdd lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd671 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301278:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301304:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301318:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301336:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301343:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301372:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301699:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301710:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301718:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518531.301793:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:0.0:1789518531.301902:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301912:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301919:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301925:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518531.301930:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301939:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301951:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:0.0:1789518531.301954:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518531.301966:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301973:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c784ce4 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301986:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.301993:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.302000:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.302005:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518531.302008:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.302014:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.302020:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff99ffdfff5a00) 00010000:00010000:0.0:1789518531.302022:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518531.302025:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.302032:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784ceb lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.302090:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784cdd lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd671 expref: 14 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.302116:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd671 expref: 13 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.302123:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:0.0:1789518531.302126:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518531.302129:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696000, rc 0) 00000100:00100000:0.0:1789518531.302478:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+13:27917:x1876445617226112:12345-192.168.206.51@tcp:101:cat.0 Request processed in 1355us (1757us total) trans 25769803820 rc 0/0 00000100:00100000:0.0:1789518531.302488:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:2.0:1789518531.305322:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.305410:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617226240 00000100:00100000:1.0:1789518531.305425:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617226240 00000100:00100000:1.0:1789518531.305503:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1789518531.305516:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+8:2344:x1876445617226240:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:1.0:1789518531.305534:0:32309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518531.305551:0:32309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd678 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.305578:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518531.305582:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518531.305590:0:32309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd678 expref: 9 pid: 32309 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.305606:0:32309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd678 expref: 9 pid: 32309 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.305644:0:32309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0200, rc 0) 00000100:00100000:1.0:1789518531.305718:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:2344:x1876445617226240:12345-192.168.206.51@tcp:101:cat.0 Request processed in 205us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518531.305726:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518531.308208:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.308338:0:32314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617226368 00000100:00100000:2.0:1789518531.308353:0:32314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617226368 00002000:00100000:2.0:1789518531.308407:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->4095) req@ffff99ffdfee8e00 x1876445617226368/t0(0) o3->e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp:177/0 lens 488/0 e 0 to 0 dl 1789518542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518531.308433:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfee8e00 with x1876445617226368 ext(0->4095) 00002000:00010000:2.0:1789518531.308440:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfee8e00 00000100:00100000:2.0:1789518531.308477:0:32314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518531.308487:0:32314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:2343:x1876445617226368:12345-192.168.206.51@tcp:3:cat.0 00000100:00100000:2.0:1789518531.308834:0:32314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:2343:x1876445617226368:12345-192.168.206.51@tcp:3:cat.0 Request processed in 347us (635us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789518531.308842:0:32314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00002000:00100000:2.0:1789518531.308849:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->4095) req@ffff99ffdfee8e00 x1876445617226368/t0(0) o3->e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp:177/0 lens 488/4536 e 0 to 0 dl 1789518542 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518531.308911:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfee8e00 with x1876445617226368 ext(0->4095) 00002000:00010000:2.0:1789518531.308915:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfee8e00 00000100:00100000:3.0:1789518531.311141:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.311211:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617226624 00000100:00100000:2.0:1789518531.311222:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617226624 00000100:00100000:2.0:1789518531.311283:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518531.311301:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+13:27917:x1876445617226624:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:2.0:1789518531.311641:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+14:27917:x1876445617226624:12345-192.168.206.51@tcp:35:cat.0 Request processed in 316us (479us total) trans 25769803821 rc 0/0 00000100:00100000:2.0:1789518531.311649:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518531.314272:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.314346:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617226880 00000100:00100000:1.0:1789518531.314357:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617226880 00000100:00100000:1.0:1789518531.314522:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:1.0:1789518531.314535:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+14:25567:x1876445617226880:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518531.314589:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518531.314652:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784d07 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd67f expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.314895:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.314916:0:31624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd655 expref: 24 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.314925:0:31624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd671 expref: 15 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.314934:0:31624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 5/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.314975:0:31624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd671 expref: 15 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.314990:0:31624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd671 expref: 15 pid: 32331 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.315005:0:31624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31624:1876445627612672:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518531.315148:0:31624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd655 expref: 24 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.315160:0:31624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd655 expref: 24 pid: 31626 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.315180:0:31624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31624:1876445627612800:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518531.315201:0:31624:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518531.316962:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.317035:0:31624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31624:1876445627612672:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518531.317057:0:31624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31624:1876445627612800:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518531.317080:0:31624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.317143:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617227008 00000100:00100000:2.0:1789518531.317152:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617227008 00010000:00010000:2.0:1789518531.317189:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd671 expref: 16 pid: 32331 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.317225:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518531.317246:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+16:2342:x1876445617227008:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518531.317261:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518531.317268:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd671 expref: 16 pid: 32331 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.317280:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd671 expref: 16 pid: 32331 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.317301:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784cf2 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd671 expref: 16 pid: 32331 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.317317:0:31611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:2.0:1789518531.317322:0:31611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.317330:0:31611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.317336:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518531.317386:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+15:2342:x1876445617227008:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 140us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518531.317395:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518531.317434:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.317798:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617227136 00000100:00100000:1.0:1789518531.317804:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617227136 00010000:00010000:1.0:1789518531.317826:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd655 expref: 25 pid: 31626 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.317851:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518531.317858:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+25:2342:x1876445617227136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518531.317867:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518531.317871:0:31609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd655 expref: 25 pid: 31626 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.317880:0:31609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd655 expref: 25 pid: 31626 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.317894:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784cac lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd655 expref: 25 pid: 31626 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.317907:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:1.0:1789518531.317919:0:31609:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.317929:0:31609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.317938:0:31609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.317967:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518531.318005:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+24:2342:x1876445617227136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 147us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518531.318013:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00010000:00010000:0.0:1789518531.318193:0:31624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.318218:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518531.318243:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:0.0:1789518531.318439:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784d07 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd67f expref: 16 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.318458:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd67f expref: 15 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.318467:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:0.0:1789518531.318470:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518531.318473:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1800, rc 0) 00000100:00100000:0.0:1789518531.318517:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+15:25567:x1876445617226880:12345-192.168.206.51@tcp:101:bash.0 Request processed in 3985us (4251us total) trans 25769803822 rc 0/0 00000100:00100000:0.0:1789518531.318531:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1789518531.320805:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.320855:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617227392 00000100:00100000:2.0:1789518531.320866:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617227392 00000100:00100000:2.0:1789518531.320945:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1789518531.320954:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+15:25567:x1876445617227392:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:2.0:1789518531.321286:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.321320:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.321335:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518531.321397:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803823 00000004:00010000:2.0:1789518531.321425:0:31626:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a60c03c reply state 00000000f1d4290c transno 25769803824 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.321434:0:31626:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518531.321524:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+18:25567:x1876445617227392:12345-192.168.206.51@tcp:36:bash.0 Request processed in 571us (729us total) trans 25769803824 rc 0/0 00000100:00100000:2.0:1789518531.321530:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000020:00080000:2.0:1789518531.321535:0:31626:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789518531.323576:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518531.323683:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.323704:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.323713:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.323741:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518531.323747:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.323756:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.323777:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:3.0:1789518531.323780:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518531.323828:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518531.323836:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784d1c lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.323913:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617227520 00000100:00100000:0.0:1789518531.323924:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617227520 00000100:00100000:0.0:1789518531.323984:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1789518531.323995:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:25567:x1876445617227520:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518531.324013:0:32579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518531.324031:0:32579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c784d23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd686 expref: -99 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.324077:0:32579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 6 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.324088:0:32579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd678 expref: 10 pid: 32309 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.324098:0:32579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518531.324104:0:32579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518531.324109:0:32579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c784d23 lrc: 5/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd686 expref: 10 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.324150:0:32579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd678 expref: 10 pid: 32309 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.324166:0:32579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd678 expref: 10 pid: 32309 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.324196:0:32579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:32579:1876445627612928:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518531.324308:0:32579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 6 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.324319:0:32579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 6 pid: 32306 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.324485:0:32579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:32579:1876445627613056:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518531.324544:0:32579:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9216480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518531.326591:0:32579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:32579:1876445627612928:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518531.326959:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518531.326995:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518531.327091:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617227648 00000100:00100000:2.0:1789518531.327100:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617227648 00010000:00010000:2.0:1789518531.327143:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd678 expref: 11 pid: 32309 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518531.327190:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617227776 00000100:00100000:2.0:1789518531.327193:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617227776 00010000:00010000:2.0:1789518531.327220:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 7 pid: 32306 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518531.327236:0:32579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:32579:1876445627613056:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518531.327251:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1789518531.327262:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:2342:x1876445617227648:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518531.327301:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518531.327309:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd678 expref: 11 pid: 32309 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.327316:0:32579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c784d23 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd686 expref: 11 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.327329:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd678 expref: 11 pid: 32309 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.327400:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:1.0:1789518531.327411:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2343:x1876445617227776:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518531.327420:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518531.327425:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 7 pid: 32306 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518531.327469:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b7427a2/0x631fd8698c784d00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd678 expref: 11 pid: 32309 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518531.327473:0:32579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696800, rc 0) 00010000:00010000:2.0:1789518531.327489:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518531.327541:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:25567:x1876445617227520:12345-192.168.206.51@tcp:101:bash.0 Request processed in 3547us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518531.327551:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518531.328123:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:2342:x1876445617227648:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 861us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518531.328132:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00010000:00010000:1.0:1789518531.328227:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 7 pid: 32306 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.328246:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c784cc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd663 expref: 7 pid: 32306 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.328259:0:33738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518531.328264:0:33738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518531.328272:0:33738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c784d23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd686 expref: 8 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.328294:0:33738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c784d23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd686 expref: 8 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518531.328337:0:33738:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c784d23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd686 expref: 8 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518531.328352:0:33738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:33738:1876445627613184:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518531.328414:0:33738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518531.330309:0:33738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:33738:1876445627613184:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518531.330333:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518531.330379:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617227776:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2970us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518531.330390:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1789518531.330509:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518531.330560:0:32313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617227904 00000100:00100000:1.0:1789518531.330567:0:32313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617227904 00002000:00010000:1.0:1789518531.330603:0:32313:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/162 (0->18446744073709551615) 00002000:00100000:1.0:1789518531.330609:0:32313:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1fb80 with x1876445617227904 ext(0->18446744073709551615) 00002000:00010000:1.0:1789518531.330640:0:32313:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1fb80. 00000100:00100000:1.0:1789518531.330663:0:32313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518531.330734:0:32313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+9:2343:x1876445617227904:12345-192.168.206.51@tcp:10:bash.0 00002000:00010000:1.0:1789518531.331097:0:32313:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb size from disk: 14 -> 0 00002000:00010000:1.0:1789518531.331101:0:32313:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb mtime from disk: 1789518531 -> 1789518531 00002000:00010000:1.0:1789518531.331104:0:32313:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb atime from disk: 1789518527 -> 1789518527 00002000:00010000:1.0:1789518531.331121:0:32313:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb ctime from disk: 1789518531 -> 1789518531 00002000:00010000:1.0:1789518531.331123:0:32313:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789518531.331161:0:32313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:2343:x1876445617227904:12345-192.168.206.51@tcp:10:bash.0 Request processed in 489us (652us total) trans 25769803785 rc 0/0 00000100:00100000:1.0:1789518531.331175:0:32313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00002000:00010000:1.0:1789518531.331179:0:32313:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/162 (0->18446744073709551615) 00002000:00100000:1.0:1789518531.331181:0:32313:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1fb80 with x1876445617227904 ext(0->18446744073709551615) 00002000:00010000:1.0:1789518531.331191:0:32313:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1fb80. 00010000:00010000:1.0:1789518531.763001:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518532.499149:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518532.499218:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617228032 00000100:00100000:2.0:1789518532.499231:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617228032 00000100:00100000:1.0:1789518532.499278:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518532.499307:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:1.0:1789518532.499315:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518532.499323:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:2344:x1876445617228032:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518532.499353:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518532.499356:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617228288 00000100:00100000:0.0:1789518532.499371:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617228288 00000100:00100000:1.0:1789518532.499383:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518532.499416:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518532.499439:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:2344:x1876445617228032:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 120us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518532.499448:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:0.0:1789518532.499530:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617228800 00000100:00100000:0.0:1789518532.499537:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617228800 00000100:00100000:1.0:1789518532.499542:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617228416 00000100:00100000:1.0:1789518532.499549:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617228416 00000100:00100000:1.0:1789518532.499609:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518532.500169:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2344:x1876445617228288:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518532.500197:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518532.500285:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2344:x1876445617228288:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 120us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518532.500294:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518532.500314:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617228672 00000100:00100000:1.0:1789518532.500318:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617228672 00000100:00100000:1.0:1789518532.500341:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518532.500346:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2344:x1876445617228416:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518532.500386:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518532.500404:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:2344:x1876445617228800:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518532.500423:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2344:x1876445617228416:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 73us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518532.500429:0:32306:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789518532.500442:0:32306:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789518532.500479:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:2344:x1876445617228800:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 81us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518532.500503:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1789518532.500514:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:1.0:1789518532.500535:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518532.500566:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2344:x1876445617228672:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518532.500567:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617228544 00000100:00100000:0.0:1789518532.500576:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617228544 00000100:00100000:1.0:1789518532.500642:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2344:x1876445617228672:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 95us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518532.500654:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518532.500655:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617228160 00000100:00100000:0.0:1789518532.500661:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617228160 00000100:00100000:0.0:1789518532.500705:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518532.500718:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+17:2344:x1876445617228544:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:1.0:1789518532.500719:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518532.500730:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518532.500735:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518532.500756:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518532.500769:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+24:2344:x1876445617228160:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518532.500775:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+17:2344:x1876445617228544:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 56us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518532.500786:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518532.500823:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+24:2344:x1876445617228160:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 56us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518532.500831:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00010000:00010000:2.0:1789518532.787028:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518533.810880:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518533.817499:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518533.817872:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617228928 00000100:00100000:0.0:1789518533.817884:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617228928 00000100:00100000:1.0:1789518533.818072:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:1.0:1789518533.818084:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+24:27805:x1876445617228928:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789518533.818262:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+24:27805:x1876445617228928:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 180us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518533.818270:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:2.0:1789518533.820440:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518533.820524:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617229184 00000100:00100000:1.0:1789518533.820533:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617229184 00000100:00100000:2.0:1789518533.820878:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518533.820891:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+24:27805:x1876445617229184:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518533.821206:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+25:27805:x1876445617229184:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 317us (773us total) trans 25769803825 rc 0/0 00000100:00100000:2.0:1789518533.821214:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518534.259062:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627613312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518534.259120:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518534.259133:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518534.259135:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627613568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518534.259174:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518534.259188:0:32311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627613312 00000100:00100000:0.0:1789518534.259194:0:32311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627613312 00000100:00100000:2.0:1789518534.259207:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627613824:0@lo:400:kworker.0 00000100:00100000:3.0:1789518534.259210:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627613440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518534.259239:0:32311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518534.259248:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518534.259249:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518534.259250:0:32311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627613312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518534.259289:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627614080:0@lo:400:kworker.0 00002000:00000024:0.0:1789518534.259298:0:32311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789518534.259311:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518534.259326:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518534.259331:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627613952:0@lo:400:kworker.0 00000100:00100000:2.0:1789518534.259363:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627613312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518534.259377:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789518534.259385:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627613696:0@lo:400:kworker.0 00000100:00080000:1.0:1789518534.259392:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518534.259404:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627613440 00000100:00100000:1.0:1789518534.259408:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627613440 00000100:00100000:1.0:1789518534.259435:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518534.259442:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627613440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518534.259460:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518534.259494:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518534.259537:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627614080 00000100:00100000:3.0:1789518534.259542:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627614080 00000100:00100000:3.0:1789518534.259570:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627613952 00000100:00100000:3.0:1789518534.259572:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627613952 00000100:00100000:3.0:1789518534.259591:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789518534.259718:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627613440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 276us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518534.259725:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518534.259819:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518534.259841:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627614208:0@lo:400:kworker.0 00000100:00100000:0.0:1789518534.259862:0:32311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627613312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 613us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518534.259865:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518534.259875:0:32311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518534.259893:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627613824 00000100:00100000:2.0:1789518534.259898:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627613824 00000100:00100000:0.0:1789518534.259902:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627613568 00000100:00100000:0.0:1789518534.259907:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627613568 00000100:00100000:3.0:1789518534.259911:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627614080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518534.259943:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627614080:12345-0@lo:400:kworker.0 Request processed in 36us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518534.259979:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789518534.259987:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627613952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518534.259995:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789518534.260007:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+19:3283:x1876445627613568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518534.260041:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627613952:12345-0@lo:400:kworker.0 Request processed in 43us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518534.260042:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f013254-1301-45d1-9493-6d558799b39e+19:3283:x1876445627613568:12345-0@lo:400:kworker.0 Request processed in 25us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518534.260047:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518534.260048:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789518534.260059:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627614208 00000100:00100000:1.0:1789518534.260062:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627614208 00000100:00100000:1.0:1789518534.260078:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789518534.260083:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627614208:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789518534.260087:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518534.260091:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518534.260110:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627613696 00000100:00100000:2.0:1789518534.260116:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627613696 00000100:00100000:1.0:1789518534.260121:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627614208:12345-0@lo:400:kworker.0 Request processed in 36us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518534.260128:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518534.260145:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518534.260152:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518534.260158:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627613824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518534.260164:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627613696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518534.260201:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627613824:12345-0@lo:400:kworker.0 Request processed in 47us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518534.260209:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627613696:12345-0@lo:400:kworker.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518534.260210:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518534.260225:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518534.260254:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803780 gen 2 00000004:00080000:2.0:1789518534.260260:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803779 committed transno 25769803780 00000100:00100000:3.0:1789518534.260284:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1789518534.260289:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff7881f80, transno 25769803780 00000100:00100000:2.0:1789518534.260310:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627613696:0@lo:400:kworker.0 00000100:00100000:3.0:1789518534.260319:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627613952:0@lo:400:kworker.0 00000100:00100000:2.0:1789518534.260329:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627614208:0@lo:400:kworker.0 00000100:00100000:3.0:1789518534.260338:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627614080:0@lo:400:kworker.0 00000100:00100000:2.0:1789518534.260347:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627613824:0@lo:400:kworker.0 00000100:00100000:3.0:1789518534.260355:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627613568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518534.260374:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627613440:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789518534.752349:0:33943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 3a: Repeat attach/detach operations === 20:28:54 (1789518534) 00010000:00010000:1.0:1789518534.834839:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518534.900988:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518534.901091:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617229440 00000100:00100000:1.0:1789518534.901102:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617229440 00000100:00100000:1.0:1789518534.901183:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:1.0:1789518534.901194:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+25:28547:x1876445617229440:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518534.901218:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1789518534.901233:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789518534.901239:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784d2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd68d expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901321:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901336:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901349:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901364:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901371:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901379:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901707:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784d3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901717:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784d3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901737:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784d3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518534.901749:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789518534.901832:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901840:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901847:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901854:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518534.901859:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901867:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901880:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffd8a16700) 00010000:00010000:1.0:1789518534.901883:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518534.901888:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901895:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901907:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901914:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901926:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901931:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518534.901935:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901941:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901949:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518534.901952:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518534.901955:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.901961:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784d38 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.902450:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784d2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd68d expref: 28 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.902466:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784d3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd68d expref: 27 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518534.902474:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffe6f98b00) 00010000:00010000:1.0:1789518534.902476:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518534.902479:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0600, rc 0) 00000100:00100000:1.0:1789518534.902544:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:28547:x1876445617229440:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1352us (1567us total) trans 25769803826 rc 0/0 00000100:00100000:1.0:1789518534.902563:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1789518534.905754:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518534.905842:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617229568 00000100:00100000:2.0:1789518534.905852:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617229568 00000100:00100000:2.0:1789518534.905907:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:2.0:1789518534.905917:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:28547:x1876445617229568:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789518534.906012:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:28547:x1876445617229568:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518534.906019:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:2.0:1789518534.910179:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518534.910383:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617229696 00000100:00100000:3.0:1789518534.910392:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617229696 00000100:00100000:3.0:1789518534.910454:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518534.910464:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:2343:x1876445617229696:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518534.910479:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518534.910500:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c784d3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd68d expref: 27 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518534.910516:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffe6f98b00) 00010000:00010000:3.0:1789518534.910521:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518534.910575:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+26:2343:x1876445617229696:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 112us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518534.910604:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518535.007212:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.008083:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617229952 00000100:00100000:2.0:1789518535.008095:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617229952 00000100:00100000:2.0:1789518535.008161:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1789518535.008171:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+26:28562:x1876445617229952:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:2.0:1789518535.008229:0:31625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518535.008260:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c7849f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd583 expref: 26 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.008279:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98700) 00010000:00010000:2.0:1789518535.008285:0:31625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518535.011262:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.011292:0:31625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5f3 expref: 16 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.011301:0:31625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.011341:0:31625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5f3 expref: 16 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.011357:0:31625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5f3 expref: 16 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518535.011372:0:31625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627614336:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518535.011500:0:31625:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518535.015321:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.015433:0:31625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627614336:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518535.015461:0:31625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518535.016348:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617230080 00000100:00100000:1.0:1789518535.016357:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617230080 00010000:00010000:1.0:1789518535.016418:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5f3 expref: 17 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518535.016453:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518535.016463:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff55e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+17:2343:x1876445617230080:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518535.016475:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518535.016482:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5f3 expref: 17 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.016494:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5f3 expref: 17 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.016514:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784b4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5f3 expref: 17 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.016529:0:31611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98700) 00010000:00010000:1.0:1789518535.016534:0:31611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.016543:0:31611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.016550:0:31611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789518535.016667:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789518535.016795:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518535.016847:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff55e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+16:2343:x1876445617230080:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 386us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518535.016855:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00010000:00010000:3.0:1789518535.018495:0:31625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.018509:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.018536:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.018547:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.018560:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518535.020668:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00010000:00010000:3.0:1789518535.020684:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.020693:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.020700:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.020706:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518535.020710:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.020718:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.020742:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffe6f98700) 00010000:00010000:3.0:1789518535.020745:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518535.020750:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.020756:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d4d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518535.020776:0:31625:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001210de3d reply state 0000000060e7bc03 transno 25769803827 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518535.020784:0:31625:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518535.020881:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:28562:x1876445617229952:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 12706us (13675us total) trans 25769803827 rc 0/0 00000100:00100000:3.0:1789518535.020889:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00010000:00010000:2.0:1789518535.022913:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.022928:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.022935:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.022962:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518535.022966:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.022971:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.022981:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff99ffe6f98400) 00010000:00010000:2.0:1789518535.022983:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518535.022986:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.022990:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d54 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518535.028066:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.028292:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617230208 00000100:00100000:2.0:1789518535.028300:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617230208 00000100:00100000:2.0:1789518535.028342:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:2.0:1789518535.028349:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+16:28563:x1876445617230208:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518535.028365:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518535.028430:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd694 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.028482:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c784d62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.028492:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c784d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.028513:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c784d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518535.028541:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518535.028544:0:31624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518535.028579:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c784d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.028671:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784d5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd694 expref: 18 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.028686:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c784d62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd694 expref: 17 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.028692:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16b00) 00010000:00010000:2.0:1789518535.028695:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518535.028697:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6400, rc 0) 00000100:00100000:2.0:1789518535.028785:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+17:28563:x1876445617230208:12345-192.168.206.51@tcp:101:dd.0 Request processed in 437us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518535.028790:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:0.0:1789518535.030910:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.031294:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617230336 00000100:00100000:1.0:1789518535.031303:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617230336 00000100:00100000:1.0:1789518535.031355:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:1.0:1789518535.031366:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+17:28563:x1876445617230336:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1789518535.031384:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518535.031402:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c784d69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd69b expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031455:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031468:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031480:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031493:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031500:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031506:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031645:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d7e lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031654:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d7e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031662:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d7e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518535.031687:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:1.0:1789518535.031691:0:32331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518535.031717:0:32331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d7e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031729:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031735:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031741:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031747:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518535.031751:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031758:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031769:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16b00) 00010000:00010000:1.0:1789518535.031777:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518535.031783:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031790:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784d70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031803:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031809:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031815:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031820:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518535.031823:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031829:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031838:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518535.031840:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518535.031843:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031848:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784d77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031878:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0000/0x631fd8698c784d69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd69b expref: 19 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031903:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d7e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd69b expref: 18 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.031910:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:1.0:1789518535.031912:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518535.031914:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0200, rc 0) 00000100:00100000:1.0:1789518535.032022:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+18:28563:x1876445617230336:12345-192.168.206.51@tcp:101:dd.0 Request processed in 657us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518535.032044:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:1.0:1789518535.035919:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.036002:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617230592 00000100:00100000:3.0:1789518535.036012:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617230592 00000100:00100000:3.0:1789518535.036118:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1789518535.036129:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+18:28563:x1876445617230592:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518535.036149:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518535.036169:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784d85 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6a2 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.036281:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.036296:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.036324:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.036339:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.036347:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.036353:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518535.037194:0:31626:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa3:0x0], index 0: 0 00010000:00010000:3.0:1789518535.037353:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037365:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037373:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037405:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037413:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037420:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037426:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518535.037436:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037445:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037455:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:3.0:1789518535.037458:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518535.037463:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037468:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784d8c lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518535.037479:0:31626:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033875ddd reply state 000000004f8f9ecf transno 25769803828 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518535.037487:0:31626:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518535.037517:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784d85 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a2 expref: 21 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037530:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a2 expref: 20 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.037536:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:3.0:1789518535.037538:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518535.037541:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980e00, rc 0) 00000100:00100000:3.0:1789518535.037602:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+21:28563:x1876445617230592:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1475us (1694us total) trans 25769803828 rc 0/0 00000100:00100000:3.0:1789518535.037609:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00010000:00010000:3.0:1789518535.039148:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.039163:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.039171:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.039179:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518535.039183:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.039191:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.039206:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffe6f98700) 00010000:00010000:3.0:1789518535.039210:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518535.039214:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.039221:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784d93 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518535.043451:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518535.043508:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617230720 00000100:00100000:0.0:1789518535.043518:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617230720 00000100:00100000:0.0:1789518535.043596:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518535.043608:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:28563:x1876445617230720:12345-192.168.206.51@tcp:101:dd.0 00000100:00080000:1.0:1789518535.043648:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789518535.043654:0:33813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518535.043675:0:33813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6a9 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518535.043700:0:33813:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518535.043730:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=589s v=(0 0) 00010000:00010000:0.0:1789518535.043736:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518535.043756:0:33813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 6 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.043815:0:33813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 6 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.043841:0:33813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697c00, rc 0) 00000100:00100000:0.0:1789518535.043902:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:28563:x1876445617230720:12345-192.168.206.51@tcp:101:dd.0 Request processed in 296us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518535.043909:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518535.047891:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.047986:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617230976 00000100:00100000:2.0:1789518535.047993:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617230976 00000100:00100000:2.0:1789518535.048043:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518535.048050:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+20:28563:x1876445617230976:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:2.0:1789518535.048362:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+21:28563:x1876445617230976:12345-192.168.206.51@tcp:35:dd.0 Request processed in 310us (477us total) trans 25769803829 rc 0/0 00000100:00100000:2.0:1789518535.048370:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518535.079107:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.079192:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617231104 00000100:00100000:3.0:1789518535.079201:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617231104 00000100:00100000:3.0:1789518535.079309:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1789518535.079320:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+26:28569:x1876445617231104:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518535.079341:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518535.079360:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6b0 expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.079448:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784db6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.079462:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.079475:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518535.079507:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518535.079511:0:31625:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518535.079527:0:31625:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.079550:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6b0 expref: 28 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.079568:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6b0 expref: 27 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.079577:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16b00) 00010000:00010000:3.0:1789518535.079580:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518535.079584:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980c00, rc 0) 00000100:00100000:3.0:1789518535.079693:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:28569:x1876445617231104:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 365us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518535.079702:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1789518535.081299:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.081360:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617231232 00000100:00100000:2.0:1789518535.081367:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617231232 00000100:00100000:2.0:1789518535.081434:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1789518535.081445:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:28569:x1876445617231232:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518535.081460:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518535.081474:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6b7 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081518:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081529:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081540:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081553:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081561:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081568:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081678:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c784dd2 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081699:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c784dd2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081718:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c784dd2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518535.081741:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:2.0:1789518535.081745:0:31624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518535.081759:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c784dd2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081769:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081776:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081783:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081790:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518535.081794:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081802:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081822:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16b00) 00010000:00010000:2.0:1789518535.081826:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518535.081830:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081837:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081859:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081867:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081873:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081879:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518535.081882:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081888:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081897:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518535.081899:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518535.081902:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081908:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784dcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081935:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6b7 expref: 29 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081948:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c784dd2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6b7 expref: 28 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.081966:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:2.0:1789518535.081968:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518535.081971:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:2.0:1789518535.082022:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+28:28569:x1876445617231232:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 579us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518535.082056:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1789518535.084366:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.084428:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617231360 00000100:00100000:1.0:1789518535.084436:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617231360 00000100:00100000:1.0:1789518535.084576:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1789518535.084586:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+28:28569:x1876445617231360:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518535.084603:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518535.084647:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784dd9 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6be expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084698:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084711:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084737:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084757:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084765:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084772:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084847:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084857:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084864:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518535.084892:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:1.0:1789518535.084897:0:32331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518535.084912:0:32331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084923:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084931:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084948:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084955:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084962:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518535.084966:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084974:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084985:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:1.0:1789518535.084988:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518535.084992:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.084999:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784de0 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085024:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085039:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085045:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085051:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518535.085060:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085071:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085079:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffc2fdc900) 00010000:00010000:1.0:1789518535.085082:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518535.085085:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085091:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c784de7 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085130:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c784dd9 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6be expref: 30 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085143:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6be expref: 29 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.085150:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:1.0:1789518535.085153:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518535.085155:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1000, rc 0) 00000100:00100000:1.0:1789518535.085211:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+29:28569:x1876445617231360:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 627us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518535.085218:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1789518535.088291:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.088351:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617231488 00000100:00100000:2.0:1789518535.088361:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617231488 00000100:00100000:2.0:1789518535.088456:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1789518535.088466:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc53e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2344:x1876445617231488:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518535.088483:0:32306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1789518535.088495:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789518535.088500:0:32306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c784df5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6c5 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518535.088573:0:32306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:32306:1876445627614464:192.168.206.51@tcp:106: 00000100:00100000:2.0:1789518535.088695:0:32306:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5e40 going to sleep for 11 seconds 00002000:00010000:0.0:1789518535.090679:0:32306:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb size: 0 -> 1024 00002000:00010000:0.0:1789518535.090685:0:32306:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb mtime: 0 -> 1789518535 00002000:00010000:0.0:1789518535.090688:0:32306:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb atime: 0 -> 1789518535 00002000:00010000:0.0:1789518535.090690:0:32306:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb ctime: 0 -> 1789518535 00000100:00100000:0.0:1789518535.090712:0:32306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:32306:1876445627614464:192.168.206.51@tcp:106: 00010000:00010000:0.0:1789518535.090742:0:32306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c784df5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6c5 expref: 6 pid: 32306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.090763:0:32306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c784df5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6c5 expref: 6 pid: 32306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.090775:0:32306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6000, rc 0) 00000100:00100000:0.0:1789518535.090824:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc53e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2344:x1876445617231488:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2359us (2542us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518535.090832:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1789518535.092958:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.093093:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617231744 00000100:00100000:3.0:1789518535.093102:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617231744 00000100:00100000:3.0:1789518535.093231:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:3.0:1789518535.093241:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+29:28569:x1876445617231744:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518535.093259:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518535.093288:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784dfc lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6cc expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.093375:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e03 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.093389:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e03 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.093401:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e03 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518535.093412:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:3.0:1789518535.093530:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784dfc lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6cc expref: 32 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.093548:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e03 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6cc expref: 31 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.093557:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:3.0:1789518535.093560:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518535.093564:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980400, rc 0) 00000100:00100000:3.0:1789518535.093663:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+31:28569:x1876445617231744:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 423us (712us total) trans 25769803830 rc 0/0 00000100:00100000:3.0:1789518535.093670:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1789518535.095953:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.095993:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617231872 00000100:00100000:3.0:1789518535.096018:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617231872 00000100:00100000:3.0:1789518535.096091:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518535.096100:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+31:2343:x1876445617231872:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518535.096113:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518535.096134:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e03 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6cc expref: 31 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.096151:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:3.0:1789518535.096155:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518535.096248:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+30:2343:x1876445617231872:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 147us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518535.096257:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:1.0:1789518535.097979:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.098490:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617232128 00000100:00100000:3.0:1789518535.098499:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617232128 00000100:00100000:3.0:1789518535.098598:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1789518535.098608:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+30:28569:x1876445617232128:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518535.098672:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518535.098703:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e11 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6d3 expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.098797:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784e18 lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.098812:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784e18 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.098829:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784e18 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518535.098871:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:3.0:1789518535.098991:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e11 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6d3 expref: 33 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.099006:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784e18 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6d3 expref: 32 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.099082:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:3.0:1789518535.099085:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518535.099088:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980000, rc 0) 00000100:00100000:3.0:1789518535.099182:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+32:28569:x1876445617232128:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 575us (1208us total) trans 25769803831 rc 0/0 00000100:00100000:3.0:1789518535.099254:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:0.0:1789518535.117446:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.117567:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617232256 00000100:00100000:1.0:1789518535.117666:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617232256 00000100:00100000:1.0:1789518535.117731:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1789518535.117742:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:28569:x1876445617232256:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518535.117757:0:32309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518535.117776:0:32309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6da expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.117858:0:32309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 5 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.117869:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518535.117874:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518535.117880:0:32309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 4/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 6 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.117911:0:32309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 5 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.117925:0:32309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 5 pid: 33813 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518535.117940:0:32309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:32309:1876445627614592:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518535.118035:0:32309:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc30636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518535.123326:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.123412:0:32314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617232384 00000100:00100000:3.0:1789518535.123422:0:32314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617232384 00002000:00100000:3.0:1789518535.123466:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa3:0x0] (0->1023) req@ffff99fff4b1df80 x1876445617232384/t0(0) o4->e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp:181/0 lens 1512/0 e 0 to 0 dl 1789518546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518535.123478:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1df80 with x1876445617232384 ext(0->1023) 00010000:00010000:3.0:1789518535.123492:0:32314:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 6 pid: 33813 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.123510:0:32314:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 6 pid: 33813 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518535.123518:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99fff4b1df80 00000100:00100000:3.0:1789518535.123550:0:32314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518535.123572:0:32314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2342:x1876445617232384:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518535.124227:0:32309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:32309:1876445627614592:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518535.124257:0:32309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 3/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 6 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.124288:0:32309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1400, rc 0) 00000100:00100000:1.0:1789518535.124351:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:28569:x1876445617232256:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 6611us (6915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518535.124359:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1789518535.124942:0:32314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+8:2342:x1876445617232384:12345-192.168.206.51@tcp:4:dd.0 Request processed in 1369us (1624us total) trans 25769803781 rc 0/0 00000100:00100000:3.0:1789518535.124950:0:32314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:3.0:1789518535.124958:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa3:0x0] (0->1023) req@ffff99fff4b1df80 x1876445617232384/t25769803781(0) o4->e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp:181/0 lens 1512/448 e 0 to 0 dl 1789518546 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518535.124967:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1df80 with x1876445617232384 ext(0->1023) 00010000:00010000:3.0:1789518535.124974:0:32314:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 8 pid: 33813 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.124989:0:32314:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 8 pid: 33813 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518535.124996:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99fff4b1df80 00000100:00100000:0.0:1789518535.128364:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.128469:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617232512 00000100:00100000:2.0:1789518535.128478:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617232512 00010000:00010000:2.0:1789518535.128516:0:33738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 8 pid: 33813 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518535.128608:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1789518535.128637:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+8:2343:x1876445617232512:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518535.128652:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518535.128688:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 8 pid: 33813 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.128702:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 8 pid: 33813 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.128731:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d192ce/0x631fd8698c784da8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a9 expref: 8 pid: 33813 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.128750:0:33738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518535.128755:0:33738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518535.128765:0:33738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 5 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.128776:0:33738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 5 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.128818:0:33738:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 5 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518535.128835:0:33738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:33738:1876445627614720:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518535.128930:0:33738:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789518535.131895:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.132254:0:33738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:33738:1876445627614720:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518535.132279:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518535.132376:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+7:2343:x1876445617232512:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3740us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518535.132387:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518535.132437:0:32313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617232640 00000100:00100000:3.0:1789518535.132445:0:32313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617232640 00002000:00100000:3.0:1789518535.132499:0:32313:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa3:0x0] (0->4095) req@ffff99ffc6388700 x1876445617232640/t0(0) o3->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:181/0 lens 488/0 e 0 to 0 dl 1789518546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518535.132508:0:32313:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6388700 with x1876445617232640 ext(0->4095) 00002000:00010000:3.0:1789518535.132513:0:32313:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6388700 00000100:00100000:3.0:1789518535.132542:0:32313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518535.132551:0:32313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617232640:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518535.135949:0:32313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617232640:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 3385us (4049us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789518535.135983:0:32313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00002000:00100000:3.0:1789518535.135998:0:32313:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa3:0x0] (0->4095) req@ffff99ffc6388700 x1876445617232640/t0(0) o3->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:181/0 lens 488/4536 e 0 to 0 dl 1789518546 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518535.136007:0:32313:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6388700 with x1876445617232640 ext(0->4095) 00002000:00010000:3.0:1789518535.136013:0:32313:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6388700 00000100:00100000:2.0:1789518535.140789:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518535.140855:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617232768 00000100:00100000:0.0:1789518535.140863:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617232768 00000100:00100000:0.0:1789518535.140909:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:0.0:1789518535.140919:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617232768:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:0.0:1789518535.140961:0:33813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.140980:0:33813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 6 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.140989:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518535.140993:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518535.140998:0:33813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.141047:0:33813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 6 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.141062:0:33813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 6 pid: 32309 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518535.141076:0:33813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff667100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:33813:1876445627614848:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518535.141144:0:33813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518535.145516:0:33813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff667100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:33813:1876445627614848:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518535.145559:0:33813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518535.147700:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.148232:0:31610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617232896 00000100:00100000:3.0:1789518535.148244:0:31610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617232896 00010000:00010000:3.0:1789518535.148286:0:31610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 7 pid: 32309 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518535.148386:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518535.148397:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617232896:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518535.148413:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518535.148436:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 7 pid: 32309 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.148451:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 7 pid: 32309 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.148475:0:31610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000643cfe4d/0x631fd8698c784e26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6da expref: 7 pid: 32309 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.148492:0:31610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518535.148497:0:31610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518535.148503:0:31610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.148527:0:31610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.148574:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518535.148665:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617232896:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 269us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518535.148673:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00010000:00010000:0.0:1789518535.151153:0:33813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.151196:0:33813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.151230:0:33813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.151238:0:33813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.151246:0:33813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.151253:0:33813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518535.151258:0:33813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.151267:0:33813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.151285:0:33813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.151294:0:33813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4169b8e/0x631fd8698c784e2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518535.151417:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2343:x1876445617232768:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 10494us (10632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518535.151427:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518535.153430:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.153902:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617233152 00000100:00100000:1.0:1789518535.154041:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617233152 00000100:00100000:1.0:1789518535.154097:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518535.154109:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+32:28569:x1876445617233152:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:1.0:1789518535.154165:0:31627:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b12:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784e18 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6d3 expref: 32 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518535.154432:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803832 00000001:00080000:1.0:1789518535.154494:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803833 00000040:00080000:3.0:1789518535.154798:0:31656:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1789518535.154804:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518535.154834:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 2 00000040:00080000:3.0:1789518535.154840:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000001:00080000:1.0:1789518535.155562:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803834 00010000:00010000:1.0:1789518535.156134:0:31627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.156163:0:31627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a2 expref: 20 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.156173:0:31627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6be expref: 36 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.156181:0:31627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 5/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.156217:0:31627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6be expref: 36 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.156232:0:31627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6be expref: 36 pid: 32331 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518535.156246:0:31627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31627:1876445627614976:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518535.156335:0:31627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a2 expref: 20 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.156346:0:31627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a2 expref: 20 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518535.156355:0:31627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31627:1876445627615104:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518535.156382:0:31627:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc30636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518535.158547:0:31627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31627:1876445627614976:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518535.158565:0:31627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31627:1876445627615104:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518535.158603:0:31627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518535.159420:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.159568:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617233280 00000100:00100000:1.0:1789518535.159576:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617233280 00010000:00010000:1.0:1789518535.159606:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6be expref: 37 pid: 32331 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518535.159730:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518535.159741:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+37:2343:x1876445617233280:12345-192.168.206.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789518535.159754:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518535.159756:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518535.159765:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6be expref: 37 pid: 32331 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.159781:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6be expref: 37 pid: 32331 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.159800:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1000/0x631fd8698c784dee lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6be expref: 37 pid: 32331 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.159816:0:31611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:1.0:1789518535.159821:0:31611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.159828:0:31611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.159834:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518535.159884:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+36:2343:x1876445617233280:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 145us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518535.159891:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518535.159933:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617233408 00000100:00100000:1.0:1789518535.159937:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617233408 00010000:00010000:1.0:1789518535.159950:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a2 expref: 21 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518535.159988:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1789518535.159997:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+21:2342:x1876445617233408:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518535.160007:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518535.160012:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a2 expref: 21 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.160039:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a2 expref: 21 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.160053:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c784d9a lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6a2 expref: 21 pid: 31626 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.160063:0:33738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:2.0:1789518535.160067:0:33738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.160074:0:33738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.160082:0:33738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 4/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.160110:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518535.160140:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+20:2342:x1876445617233408:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 145us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518535.160147:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00010000:00010000:3.0:1789518535.160185:0:31627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.160195:0:31627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518535.160453:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803835 00000001:00080000:1.0:1789518535.160801:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803836 00000001:00080000:1.0:1789518535.160862:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803837 00000100:00100000:1.0:1789518535.160932:0:31627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31627:1876445627615232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518535.160973:0:31627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518535.161006:0:31627:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518535.161073:0:31629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627615232 00000100:00100000:3.0:1789518535.161078:0:31629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627615232 00000100:00100000:3.0:1789518535.161119:0:31629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518535.161128:0:31629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31627:x1876445627615232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518535.161344:0:31627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31627:1876445627615232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789518535.161801:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803838 00000100:00100000:1.0:1789518535.161849:0:31627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31627:1876445627615360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518535.161911:0:31629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31627:x1876445627615232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 784us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518535.161918:0:31629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518535.162081:0:31627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518535.162105:0:31627:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518535.162132:0:31630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627615360 00000100:00100000:0.0:1789518535.162138:0:31630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627615360 00000100:00100000:0.0:1789518535.162221:0:31630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518535.162230:0:31630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31627:x1876445627615360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789518535.162377:0:31630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31627:x1876445627615360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 148us (296us total) trans 25769803782 rc 0/0 00000100:00100000:0.0:1789518535.162384:0:31630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518535.162449:0:31627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31627:1876445627615360:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:1.0:1789518535.162523:0:31627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.162531:0:31627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.162535:0:31627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.162548:0:31627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518535.162551:0:31627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.162557:0:31627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.162566:0:31627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:1.0:1789518535.162568:0:31627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789518535.162571:0:31627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.162575:0:31627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e34 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518535.163852:0:31627:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789518535.164007:0:31627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].3, 64 off8384 00000004:00080000:1.0:1789518535.164020:0:31627:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 589160406019ns, next at 590160403284ns, rc = 0 00000001:00080000:1.0:1789518535.164044:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803839 00010000:00010000:1.0:1789518535.164091:0:31627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffe6f98f00) 00010000:00010000:1.0:1789518535.164095:0:31627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518535.164104:0:31627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c784e18 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6d3 expref: 40 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518535.164237:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+39:28569:x1876445617233152:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 10130us (10816us total) trans 25769803840 rc 0/0 00000100:00100000:1.0:1789518535.164246:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000020:00080000:1.0:1789518535.164252:0:31627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789518535.168848:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.170290:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617233536 00000100:00100000:2.0:1789518535.170305:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617233536 00000100:00100000:2.0:1789518535.170377:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518535.170401:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+39:28569:x1876445617233536:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518535.170426:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518535.170447:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784e3b lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6e1 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.170503:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784e3b lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6e1 expref: 40 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.170517:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784e3b lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6e1 expref: 40 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.170780:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518535.170783:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518535.170787:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:2.0:1789518535.170843:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+40:28569:x1876445617233536:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 445us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518535.170850:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518535.176004:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.176772:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617233792 00000100:00100000:1.0:1789518535.176814:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617233792 00000100:00100000:2.0:1789518535.176948:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1789518535.176961:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+40:28569:x1876445617233792:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518535.177208:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+41:28569:x1876445617233792:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 250us (1215us total) trans 25769803841 rc 0/0 00000100:00100000:2.0:1789518535.177215:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518535.217893:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.218284:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617234048 00000100:00100000:1.0:1789518535.218293:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617234048 00000100:00100000:1.0:1789518535.218353:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:1.0:1789518535.218363:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+41:28579:x1876445617234048:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518535.218395:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518535.218414:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6e8 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518535.218497:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00010000:00010000:1.0:1789518535.218652:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6e8 expref: 43 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.218667:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16b00) 00010000:00010000:1.0:1789518535.218670:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518535.218676:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c784e42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6e8 expref: 43 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.218689:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1c00, rc 0) 00000100:00100000:1.0:1789518535.219433:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+42:28579:x1876445617234048:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1066us (1547us total) trans 25769803842 rc 301/301 00000100:00100000:1.0:1789518535.219443:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:0.0:1789518535.226832:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.227304:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617234176 00000100:00100000:3.0:1789518535.227313:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617234176 00000100:00100000:3.0:1789518535.227418:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1789518535.227428:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+42:28579:x1876445617234176:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1789518535.227498:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227517:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227529:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227544:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227552:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227559:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227680:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227688:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227696:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518535.227735:0:31626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227747:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227759:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227765:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227771:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518535.227776:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227784:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227796:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:3.0:1789518535.227799:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518535.227804:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227810:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784e50 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227823:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227829:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227835:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.227840:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518535.227850:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228007:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228019:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffe6f98700) 00010000:00010000:3.0:1789518535.228021:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518535.228039:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228046:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784e57 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228061:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228067:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228072:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228077:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518535.228080:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228188:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228198:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:3.0:1789518535.228200:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518535.228210:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.228215:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784e5e lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518535.228330:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+42:28579:x1876445617234176:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 902us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518535.228337:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:2.0:1789518535.230704:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.230865:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617234432 00000100:00100000:1.0:1789518535.230878:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617234432 00000100:00100000:1.0:1789518535.230945:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518535.230957:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+42:28579:x1876445617234432:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518535.231411:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+43:28579:x1876445617234432:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 455us (716us total) trans 25769803843 rc 0/0 00000100:00100000:1.0:1789518535.231437:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518535.269790:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.269924:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617234560 00000100:00100000:2.0:1789518535.269936:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617234560 00000100:00100000:2.0:1789518535.270065:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1789518535.270079:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+43:28585:x1876445617234560:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518535.270108:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518535.270133:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784e65 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6ef expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270229:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270246:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270264:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270284:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270292:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270300:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270426:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270434:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270441:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518535.270597:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1789518535.270601:0:31625:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518535.270642:0:31625:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270654:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270664:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270670:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270678:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270684:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518535.270689:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270697:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270709:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:2.0:1789518535.270713:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518535.270719:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270727:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c784e6c lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270749:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270755:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270761:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270767:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518535.270770:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270776:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270783:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffd8a16400) 00010000:00010000:2.0:1789518535.270785:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518535.270787:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270792:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c784e73 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270826:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c784e65 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6ef expref: 45 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270839:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6ef expref: 44 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.270856:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518535.270858:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518535.270861:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:2.0:1789518535.270942:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+44:28585:x1876445617234560:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 867us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518535.270949:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1789518535.274546:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.274667:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617234816 00000100:00100000:2.0:1789518535.274919:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617234816 00000100:00100000:2.0:1789518535.274995:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:2.0:1789518535.275008:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+44:28585:x1876445617234816:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518535.275049:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518535.275077:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c784e81 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6f6 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.275212:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784e88 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.275230:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784e88 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.275245:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784e88 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518535.275259:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:2.0:1789518535.275430:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c784e81 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6f6 expref: 47 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.275476:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784e88 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6f6 expref: 46 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.275487:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518535.275491:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518535.275495:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518535.275584:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+46:28585:x1876445617234816:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 579us (1049us total) trans 25769803844 rc 0/0 00000100:00100000:2.0:1789518535.275592:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:3.0:1789518535.284012:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.284063:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518535.284099:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617234944 00000100:00100000:0.0:1789518535.284110:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617234944 00000100:00100000:2.0:1789518535.284141:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617235200 00000100:00100000:2.0:1789518535.284147:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617235200 00000100:00100000:2.0:1789518535.284194:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1789518535.284195:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518535.284210:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+47:28585:x1876445617235200:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518535.284211:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+47:2343:x1876445617234944:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518535.284244:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518535.284269:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784e88 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6f6 expref: 47 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.284288:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:0.0:1789518535.284293:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518535.284361:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+47:2343:x1876445617234944:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 155us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518535.284369:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518535.284385:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+46:28585:x1876445617235200:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 181us (321us total) trans 25769803845 rc 0/0 00000100:00100000:2.0:1789518535.284391:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518535.324691:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518535.324777:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617235456 00000100:00100000:0.0:1789518535.324786:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617235456 00000100:00100000:0.0:1789518535.324839:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:0.0:1789518535.324849:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+46:28595:x1876445617235456:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518535.324871:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518535.324890:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784e96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd6fd expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.324970:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784e9d lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.324983:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784e9d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.324995:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784e9d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518535.325005:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00010000:00010000:0.0:1789518535.325844:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6fd expref: 49 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.325867:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784e9d lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6fd expref: 48 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.325875:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518535.325878:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518535.325897:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697000, rc 0) 00000100:00100000:0.0:1789518535.326185:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+48:28595:x1876445617235456:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1336us (1501us total) trans 25769803846 rc 0/0 00000100:00100000:0.0:1789518535.326193:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:0.0:1789518535.366532:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518535.366648:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617235712 00000100:00100000:3.0:1789518535.366659:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617235712 00000100:00100000:3.0:1789518535.366725:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1789518535.366735:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+48:28601:x1876445617235712:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518535.366756:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518535.366775:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784eab lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd704 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.366866:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.366880:0:31626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6ef expref: 49 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.366888:0:31626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 4/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.366918:0:31626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6ef expref: 49 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.366948:0:31626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6ef expref: 49 pid: 31625 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518535.366960:0:31626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627615488:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518535.367130:0:31626:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0d64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518535.368463:0:31626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627615488:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518535.368488:0:31626:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518535.369200:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.369571:0:31610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617235840 00000100:00100000:2.0:1789518535.369658:0:31610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617235840 00010000:00010000:2.0:1789518535.369694:0:31610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6ef expref: 50 pid: 31625 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518535.369812:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1789518535.369823:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff55f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+50:2342:x1876445617235840:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518535.369840:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518535.369846:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6ef expref: 50 pid: 31625 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.369859:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6ef expref: 50 pid: 31625 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.369881:0:31610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c784e7a lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6ef expref: 50 pid: 31625 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.369897:0:31610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518535.369903:0:31610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.369913:0:31610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.369920:0:31610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 4/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.369952:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518535.370022:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff55f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+49:2342:x1876445617235840:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 201us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518535.370041:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00010000:00010000:3.0:1789518535.370171:0:31626:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.370180:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518535.370197:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:3.0:1789518535.370352:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784eab lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd704 expref: 50 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.370368:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd704 expref: 49 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518535.370375:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:3.0:1789518535.370378:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518535.370381:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980400, rc 0) 00000100:00100000:3.0:1789518535.370406:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+49:28601:x1876445617235712:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 3672us (3883us total) trans 25769803847 rc 0/0 00000100:00100000:3.0:1789518535.370414:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1789518535.374542:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518535.374714:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617236096 00000100:00100000:2.0:1789518535.374736:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617236096 00000100:00100000:2.0:1789518535.374785:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:2.0:1789518535.374794:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+49:28601:x1876445617236096:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518535.374828:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518535.374832:0:31625:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518535.374854:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c784eb2 lrc: 0/0,0 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd704 expref: 49 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.374871:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518535.374875:0:31625:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518535.374888:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ec0 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd70b expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.374971:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784ec7 lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.374984:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784ec7 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.374993:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784ec7 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518535.375004:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:2.0:1789518535.375141:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784ec0 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd70b expref: 51 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.375155:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784ec7 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd70b expref: 50 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518535.375162:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518535.375170:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518535.375172:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:2.0:1789518535.375226:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+50:28601:x1876445617236096:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 433us (693us total) trans 25769803848 rc 0/0 00000100:00100000:2.0:1789518535.375232:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1789518535.379050:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.379197:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617236352 00000100:00100000:1.0:1789518535.379209:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617236352 00000100:00100000:1.0:1789518535.379342:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:1.0:1789518535.379368:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+50:28601:x1876445617236352:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:1.0:1789518535.379389:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518535.379420:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c784e3b lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6e1 expref: 50 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518535.379445:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:1.0:1789518535.379452:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518535.379524:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+49:28601:x1876445617236352:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 160us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518535.379533:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518535.381302:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518535.381384:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617236480 00000100:00100000:0.0:1789518535.381396:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617236480 00000100:00100000:0.0:1789518535.381456:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:0.0:1789518535.381577:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+49:28601:x1876445617236480:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:0.0:1789518535.381800:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.381820:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.381834:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518535.383076:0:31624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].2, 136 off8464 00000100:00100000:0.0:1789518535.383216:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+49:28601:x1876445617236480:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 1747us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518535.383227:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:3.0:1789518535.385075:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518535.385151:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617236608 00000100:00100000:0.0:1789518535.385173:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617236608 00000100:00100000:0.0:1789518535.385244:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:0.0:1789518535.385255:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+49:28601:x1876445617236608:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518535.385280:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518535.385321:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd712 expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.385398:0:31625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 2/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.385410:0:31625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 4/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 50 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.385433:0:31625:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.385449:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 3/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 50 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.385465:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:0.0:1789518535.385468:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518535.385472:0:31625:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 3/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 50 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518535.385481:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697400, rc 0) 00000100:00100000:0.0:1789518535.385550:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+50:28601:x1876445617236608:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 295us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518535.385558:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1789518535.567751:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518535.567820:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518535.567990:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617236864 00000100:00100000:0.0:1789518535.568011:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617236864 00000100:00100000:0.0:1789518535.568133:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:0.0:1789518535.568147:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:2342:x1876445617236864:12345-192.168.206.51@tcp:16:kworker.0 00000100:00100000:3.0:1789518535.568299:0:32314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617236736 00000100:00100000:3.0:1789518535.568304:0:32314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617236736 00002000:00100000:3.0:1789518535.568340:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->13) req@ffff99fec28ae300 x1876445617236736/t0(0) o4->e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp:181/0 lens 504/0 e 0 to 0 dl 1789518546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518535.568353:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28ae300 with x1876445617236736 ext(0->13) 00002000:00010000:3.0:1789518535.568360:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28ae300 00000100:00100000:3.0:1789518535.568388:0:32314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518535.568396:0:32314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:2343:x1876445617236736:12345-192.168.206.51@tcp:4:bash.0 00000100:00080000:1.0:1789518535.568436:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518535.569004:0:32314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+13:2343:x1876445617236736:12345-192.168.206.51@tcp:4:bash.0 Request processed in 603us (1177us total) trans 25769803786 rc 0/0 00000100:00100000:3.0:1789518535.569013:0:32314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00002000:00100000:3.0:1789518535.569022:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa2:0x0] (0->13) req@ffff99fec28ae300 x1876445617236736/t25769803786(0) o4->e799ac01-e98f-4a49-8744-b8fd7980bcc5@192.168.206.51@tcp:181/0 lens 504/448 e 0 to 0 dl 1789518546 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518535.569046:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28ae300 with x1876445617236736 ext(0->13) 00002000:00010000:3.0:1789518535.569051:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28ae300 00000001:00080000:1.0:1789518535.594989:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803783 is committed 00000001:00080000:1.0:1789518535.595009:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803782 is committed 00000001:00080000:1.0:1789518535.595014:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803785 is committed 00000001:00080000:1.0:1789518535.595021:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803781 is committed 00000001:00080000:1.0:1789518535.595039:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803786 is committed 00000100:00100000:0.0:1789518535.595346:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2342:x1876445617236864:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 27193us (27601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518535.595376:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00010000:00010000:2.0:1789518535.860238:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518536.179580:0:31656:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1789518536.179589:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518536.179726:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:3.0:1789518536.179735:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1789518536.179850:0:31656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:31656:1876445627615616:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518536.180012:0:31656:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518536.183911:0:31656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:31656:1876445627615616:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518536.185672:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.185839:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617236992 00000100:00100000:2.0:1789518536.185855:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617236992 00000100:00100000:2.0:1789518536.186034:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:2.0:1789518536.186048:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+50:28602:x1876445617236992:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518536.186083:0:31626:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b12:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518536.186189:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+50:28602:x1876445617236992:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 144us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.186197:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00080000:0.0:1789518536.186355:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518536.191122:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.191339:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617237120 00000100:00100000:0.0:1789518536.191348:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617237120 00000100:00100000:0.0:1789518536.191404:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:0.0:1789518536.191414:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+50:28602:x1876445617237120:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789518536.191477:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191494:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191508:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191524:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191531:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191538:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191559:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191568:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191591:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518536.191655:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:0.0:1789518536.191660:0:31625:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518536.191671:0:31625:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191683:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191689:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191696:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191702:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.191706:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191714:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191724:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffe6f98b00) 00010000:00010000:0.0:1789518536.191727:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.191732:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191738:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784ee3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191763:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191769:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191775:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191780:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.191783:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191790:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191798:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x31298142 (ffff99ffdfff5100) 00010000:00010000:0.0:1789518536.191800:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.191803:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191808:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784eea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191822:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191828:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191833:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191844:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.191847:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191853:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191860:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:0.0:1789518536.191863:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.191866:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.191871:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784ef1 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.191946:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+50:28602:x1876445617237120:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 533us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.191954:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1789518536.194777:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.194890:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617237376 00000100:00100000:3.0:1789518536.194899:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617237376 00000100:00100000:3.0:1789518536.194970:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:3.0:1789518536.194981:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+50:28602:x1876445617237376:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518536.195000:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518536.195017:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784ef8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd719 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195124:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 3/1,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195138:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195150:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518536.195160:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:3.0:1789518536.195257:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195265:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195272:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195278:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518536.195282:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195290:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195310:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:3.0:1789518536.195313:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518536.195318:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195324:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784eff lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195363:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784ef8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd719 expref: 52 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195373:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffe6f98b00) 00010000:00010000:3.0:1789518536.195375:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518536.195379:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784ef8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd719 expref: 52 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.195388:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981400, rc 0) 00000100:00100000:3.0:1789518536.195443:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+51:28602:x1876445617237376:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 464us (670us total) trans 25769803849 rc 301/301 00000100:00100000:3.0:1789518536.195451:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:3.0:1789518536.197895:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.198543:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617237504 00000100:00100000:0.0:1789518536.198552:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617237504 00000100:00100000:0.0:1789518536.199103:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:0.0:1789518536.199115:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+51:28602:x1876445617237504:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518536.199146:0:31625:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200002b12:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518536.199234:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+51:28602:x1876445617237504:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 122us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.199242:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:1.0:1789518536.201819:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.201909:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617237760 00000100:00100000:0.0:1789518536.201917:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617237760 00000100:00100000:0.0:1789518536.201974:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:0.0:1789518536.201985:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+51:28602:x1876445617237760:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518536.202002:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.202005:0:31624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518536.202042:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c784dd2 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6b7 expref: 51 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.202057:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518536.202062:0:31624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518536.202074:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784f0d lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd720 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518536.202505:0:31624:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa3:0x0], index 1: 0 00010000:00010000:0.0:1789518536.202725:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784f14 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.202737:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784f14 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.202747:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784f14 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.202794:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c784f0d lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd720 expref: 53 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.202808:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784f14 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd720 expref: 52 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.202814:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffdfff5100) 00010000:00010000:0.0:1789518536.202823:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518536.202826:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697c00, rc 0) 00000100:00100000:0.0:1789518536.202938:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+52:28602:x1876445617237760:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 954us (1124us total) trans 25769803850 rc 0/0 00000100:00100000:0.0:1789518536.202945:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:1.0:1789518536.205162:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.205263:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617237888 00000100:00100000:0.0:1789518536.205272:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617237888 00000100:00100000:0.0:1789518536.205323:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:0.0:1789518536.205332:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+52:28602:x1876445617237888:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518536.205352:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.205368:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784f22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd727 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205431:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205443:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205452:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205464:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205470:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205476:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205568:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784f37 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205577:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784f37 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205584:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784f37 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518536.205607:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:0.0:1789518536.205611:0:32331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518536.205643:0:32331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784f37 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205653:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205659:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205666:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205672:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.205676:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205683:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205693:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16b00) 00010000:00010000:0.0:1789518536.205703:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.205708:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205715:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c784f29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205727:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205733:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205739:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205744:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.205747:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205753:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205761:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff99ffdfff5000) 00010000:00010000:0.0:1789518536.205763:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.205766:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205772:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c784f30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205813:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c784f22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd727 expref: 54 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205838:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784f37 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd727 expref: 53 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.205845:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518536.205847:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789518536.205849:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bcc00, rc 0) 00000100:00100000:0.0:1789518536.206494:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+53:28602:x1876445617237888:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1160us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.206502:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:0.0:1789518536.210272:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.210347:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617238144 00000100:00100000:3.0:1789518536.210356:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617238144 00000100:00100000:3.0:1789518536.210422:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1789518536.210430:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+53:28602:x1876445617238144:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518536.210470:0:31626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518536.210490:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c784f14 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd720 expref: 53 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210516:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffdfff5100) 00010000:00010000:3.0:1789518536.210526:0:31626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518536.210543:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210554:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210561:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210572:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210589:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210594:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210658:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210663:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210669:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210675:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518536.210679:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210692:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210701:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:3.0:1789518536.210704:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518536.210708:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210714:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784f3e lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210764:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210770:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210776:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.210780:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518536.210783:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.211575:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.211585:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0xbfac690b (ffff99ffe6f98700) 00010000:00010000:3.0:1789518536.211587:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518536.211590:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.211607:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f45 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0xbfac690b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.211712:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+52:28602:x1876445617238144:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1282us (1445us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518536.211721:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:1.0:1789518536.214324:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.214602:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617238272 00000100:00100000:2.0:1789518536.214726:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617238272 00000100:00100000:2.0:1789518536.214782:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:2.0:1789518536.214793:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+52:28602:x1876445617238272:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518536.214810:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518536.214830:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784f4c lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd72e expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.214861:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.214872:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.214888:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.214965:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784f4c lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd72e expref: 54 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.214979:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd72e expref: 53 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.214997:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.215000:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518536.215003:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:2.0:1789518536.215173:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+53:28602:x1876445617238272:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 382us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.215179:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:1.0:1789518536.217038:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.217110:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617238528 00000100:00100000:0.0:1789518536.217117:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617238528 00000100:00100000:0.0:1789518536.217158:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:0.0:1789518536.217167:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+53:28602:x1876445617238528:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518536.217225:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.217238:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.217248:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518536.218009:0:31624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].3, 88 off8432 00000004:00080000:0.0:1789518536.218035:0:31624:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 590214420193ns, next at 591214417025ns, rc = 0 00000004:00010000:0.0:1789518536.218120:0:31624:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c9d88c2 reply state 000000004a214cf0 transno 25769803851 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.218141:0:31624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518536.218217:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+55:28602:x1876445617238528:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1050us (1194us total) trans 25769803851 rc 0/0 00000100:00100000:0.0:1789518536.218224:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00010000:00010000:2.0:1789518536.219851:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.219865:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.219873:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.219879:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.219883:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.219891:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.219915:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.219918:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518536.219924:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.219930:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c784f5a lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518536.220767:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.220852:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617238656 00000100:00100000:0.0:1789518536.220861:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617238656 00000100:00100000:0.0:1789518536.220905:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:0.0:1789518536.220915:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+54:28602:x1876445617238656:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518536.220934:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.221010:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd735 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.221077:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd735 expref: 55 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.221090:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd735 expref: 55 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.221107:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:0.0:1789518536.221111:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518536.221113:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:0.0:1789518536.221206:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+55:28602:x1876445617238656:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 292us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.221213:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:3.0:1789518536.222940:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518536.222994:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617238784 00000100:00100000:1.0:1789518536.223000:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617238784 00000100:00100000:1.0:1789518536.223060:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518536.223068:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2343:x1876445617238784:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789518536.223339:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518536.223368:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617238784:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 299us (428us total) trans 25769803787 rc 0/0 00000100:00100000:1.0:1789518536.223387:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518536.226012:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.226161:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617239040 00000100:00100000:2.0:1789518536.226169:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617239040 00000100:00100000:2.0:1789518536.226226:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518536.226236:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+55:28602:x1876445617239040:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518536.226454:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+56:28602:x1876445617239040:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 218us (448us total) trans 25769803852 rc 0/0 00000100:00100000:2.0:1789518536.226462:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518536.227842:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.227923:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617239296 00000100:00100000:2.0:1789518536.227929:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617239296 00000100:00100000:2.0:1789518536.228010:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:2.0:1789518536.228030:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+56:28602:x1876445617239296:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518536.228115:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+56:28602:x1876445617239296:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.228121:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:0.0:1789518536.230075:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.232641:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617239424 00000100:00100000:2.0:1789518536.232653:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617239424 00000100:00100000:2.0:1789518536.232714:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:2.0:1789518536.232724:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+56:28602:x1876445617239424:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518536.232751:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518536.232768:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784f68 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd73c expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.232824:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784f6f lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.232837:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784f6f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.232848:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784f6f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518536.232881:0:31625:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518536.232897:0:31625:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784f6f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.232921:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784f68 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd73c expref: 58 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.232937:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784f6f lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd73c expref: 57 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.232944:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.232947:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518536.232950:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518536.233014:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+57:28602:x1876445617239424:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 291us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.233031:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:1.0:1789518536.236397:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.236490:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617239552 00000100:00100000:0.0:1789518536.236498:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617239552 00000100:00100000:0.0:1789518536.236586:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1789518536.236596:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617239552:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518536.236630:0:33813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.236649:0:33813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd743 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518536.236670:0:33813:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e2c8, blocks: 0x1 00010000:00010000:0.0:1789518536.236686:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1789518536.236689:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518536.236696:0:33813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd743 expref: 7 pid: 33813 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.236710:0:33813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd743 expref: 7 pid: 33813 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.236720:0:33813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:0.0:1789518536.236798:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617239552:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 204us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.236802:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1789518536.238478:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.238553:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617239808 00000100:00100000:0.0:1789518536.238560:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617239808 00000100:00100000:0.0:1789518536.238682:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:0.0:1789518536.238689:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+57:28602:x1876445617239808:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518536.238748:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+57:28602:x1876445617239808:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 60us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.238763:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1789518536.240531:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.240576:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617239936 00000100:00100000:0.0:1789518536.240590:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617239936 00000100:00100000:0.0:1789518536.240689:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1789518536.240698:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:28602:x1876445617239936:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518536.240721:0:32306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.240736:0:32306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd74a expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.240766:0:32306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd743 expref: 8 pid: 33813 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.240775:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518536.240780:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518536.240785:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 8 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.240815:0:32306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd743 expref: 8 pid: 33813 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.240828:0:32306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd743 expref: 8 pid: 33813 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.240841:0:32306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:32306:1876445627615744:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518536.240939:0:32306:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518536.243671:0:32306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:32306:1876445627615744:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518536.243701:0:32306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 8 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.243720:0:32306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:0.0:1789518536.243768:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:28602:x1876445617239936:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3070us (3250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.243776:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1789518536.243861:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.243945:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617240064 00000100:00100000:2.0:1789518536.243951:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617240064 00010000:00010000:2.0:1789518536.243980:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd743 expref: 8 pid: 33813 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.244031:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518536.244040:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2343:x1876445617240064:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518536.244052:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518536.244091:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd743 expref: 8 pid: 33813 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.244104:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd743 expref: 8 pid: 33813 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.244125:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c784f76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd743 expref: 8 pid: 33813 timeout: 690 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.244145:0:31611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518536.244150:0:31611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518536.244172:0:31611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.244182:0:31611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.244263:0:31611:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.244287:0:31611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:31611:1876445627615872:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518536.244333:0:31611:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518536.247728:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518536.247842:0:32313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617240192 00000100:00100000:1.0:1789518536.247849:0:32313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617240192 00002000:00100000:1.0:1789518536.247883:0:32313:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa3:0x0] (0->1023) req@ffff99ffd100b100 x1876445617240192/t0(0) o4->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:182/0 lens 1512/0 e 0 to 0 dl 1789518547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518536.247891:0:32313:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd100b100 with x1876445617240192 ext(0->1023) 00002000:00010000:1.0:1789518536.247895:0:32313:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd100b100 00000100:00100000:1.0:1789518536.247918:0:32313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518536.247926:0:32313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2343:x1876445617240192:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518536.248224:0:31611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:31611:1876445627615872:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518536.248243:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518536.248356:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:2343:x1876445617240064:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4316us (4495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518536.248356:0:32313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+10:2343:x1876445617240192:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 429us (638us total) trans 25769803788 rc 0/0 00000100:00100000:1.0:1789518536.248364:0:32313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518536.248365:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00002000:00100000:1.0:1789518536.248371:0:32313:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa3:0x0] (0->1023) req@ffff99ffd100b100 x1876445617240192/t25769803788(0) o4->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:182/0 lens 1512/448 e 0 to 0 dl 1789518547 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518536.248389:0:32313:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd100b100 with x1876445617240192 ext(0->1023) 00002000:00010000:1.0:1789518536.248392:0:32313:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd100b100 00000100:00100000:3.0:1789518536.250849:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.251939:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617240320 00000100:00100000:2.0:1789518536.251948:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617240320 00000100:00100000:2.0:1789518536.251991:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:2.0:1789518536.252014:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+57:28602:x1876445617240320:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789518536.281073:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803851 is committed 00000004:00080000:3.0:1789518536.281085:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1789518536.281135:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+56:28602:x1876445617240320:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 29116us (30285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.281147:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000001:00080000:3.0:1789518536.281385:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803822 is committed 00000100:00100000:0.0:1789518536.281385:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627616000:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1789518536.281407:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789518536.281431:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc3063600 refcount 2 committed 0 result 0 batchid 21474836518 00000100:00100000:0.0:1789518536.281431:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789518536.281434:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffc89fbf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc3063a80 00000020:00080000:3.0:1789518536.281438:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffc89fb300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffeedf7400 00000001:00080000:3.0:1789518536.281470:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803852 is committed 00000100:00100000:0.0:1789518536.281479:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627616000 00000001:00080000:3.0:1789518536.281481:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803829 is committed 00000100:00100000:0.0:1789518536.281485:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627616000 00000020:00080000:3.0:1789518536.281497:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc11ca0c0 refcount 2 committed 0 result 0 batchid 21474836517 00000020:00080000:3.0:1789518536.281500:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fffdc2e700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc61540c0 00000020:00080000:3.0:1789518536.281503:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fffdc2ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec1291800 00000100:00100000:0.0:1789518536.281527:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518536.281534:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627616000:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1789518536.281537:0:31663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836518 committed batchid 21474836516 00000100:00100000:2.0:1789518536.281696:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627616128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518536.281723:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789518536.281726:0:31663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00002000:00010000:0.0:1789518536.281833:0:32308:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1789518536.281837:0:32308:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb mtime from disk: 0 -> 1789518536 00002000:00010000:0.0:1789518536.281839:0:32308:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518536.281842:0:32308:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb ctime from disk: 1789518536 -> 1789518536 00002000:00010000:0.0:1789518536.281845:0:32308:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518536.281927:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627616000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 393us (494us total) trans 25769803789 rc 0/0 00000100:00100000:0.0:1789518536.281934:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518536.281953:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627616128 00000100:00100000:0.0:1789518536.281957:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627616128 00000100:00100000:0.0:1789518536.281979:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789518536.281986:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627616128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789518536.282000:0:32308:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:163 count 1 00002000:00010000:0.0:1789518536.282035:0:32308:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6aa9e2c7, atime: 0x0, ctime: 0x6aa9e2c7, blocks: 0x1 00010000:00010000:0.0:1789518536.282042:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.282058:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1789518536.282062:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518536.282068:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.282085:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.282094:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.282103:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.282118:0:32308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518536.282133:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518536.282139:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.282146:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518536.282150:0:31613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.282159:0:31613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.282174:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.282180:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005603f09/0x631fd8698c784f84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.282197:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518536.282199:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518536.282200:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518536.282480:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803782 gen 2 00000004:00080000:2.0:1789518536.282486:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803782 committed transno 25769803782 00000100:00100000:0.0:1789518536.282500:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627616128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 514us (776us total) trans 25769803783 rc 0/0 00000100:00100000:2.0:1789518536.282504:0:3281:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99ffc6389500 x1876445627616000/t25769803789(25769803789) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518552 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518536.282507:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789518536.282515:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffc6389500/2, rc 0, transno 25769803789 00000100:00100000:2.0:1789518536.282519:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627616000:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789518536.282533:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518536.282536:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789518536.282587:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffc638b800/2, rc 0, transno 25769803783 00000100:00100000:1.0:1789518536.282592:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627616128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789518536.283253:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.283336:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617240448 00000100:00100000:0.0:1789518536.283342:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617240448 00000100:00100000:0.0:1789518536.283387:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:0.0:1789518536.283395:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:2342:x1876445617240448:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789518536.309696:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:2342:x1876445617240448:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 26282us (26425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.309708:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000001:00080000:1.0:1789518536.310212:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803789 is committed 00000001:00080000:1.0:1789518536.310231:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803788 is committed 00000100:00100000:1.0:1789518536.317185:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.317282:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617240704 00000100:00100000:3.0:1789518536.317291:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617240704 00000100:00100000:3.0:1789518536.317345:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:3.0:1789518536.317354:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:28602:x1876445617240704:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518536.317402:0:31626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518536.317427:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784f6f lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd73c expref: 17 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.317441:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:3.0:1789518536.317444:0:31626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518536.317466:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.317476:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.317483:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518536.317636:0:31626:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e86662b reply state 000000007eb75125 transno 25769803853 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.317644:0:31626:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518536.317730:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:28602:x1876445617240704:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 377us (553us total) trans 25769803853 rc 0/0 00000100:00100000:3.0:1789518536.317739:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:1.0:1789518536.320839:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518536.320873:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.320884:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.320893:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.320899:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980600 already unused, calling callback (ffffffffc1f3e4f0) 00000100:00100000:2.0:1789518536.320901:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617240832 00010000:00010000:1.0:1789518536.320905:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.320912:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617240832 00010000:00010000:1.0:1789518536.320915:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.320932:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:1.0:1789518536.320935:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518536.320939:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.320946:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784f8b lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.320965:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:2.0:1789518536.320977:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617240832:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518536.321249:0:32308:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:2.0:1789518536.321254:0:32308:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb mtime from disk: 1789518536 -> 1789518535 00002000:00010000:2.0:1789518536.321256:0:32308:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb atime from disk: 0 -> 1789518535 00002000:00010000:2.0:1789518536.321258:0:32308:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb ctime from disk: 1789518536 -> 1789518535 00002000:00010000:2.0:1789518536.321260:0:32308:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789518536.321322:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617240832:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 347us (490us total) trans 25769803790 rc 0/0 00000100:00100000:2.0:1789518536.321329:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518536.325972:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.326752:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617241088 00000100:00100000:0.0:1789518536.326762:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617241088 00000100:00100000:0.0:1789518536.326821:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:0.0:1789518536.326831:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:28602:x1876445617241088:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789518536.326888:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.326902:0:32331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd72e expref: 17 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.326911:0:32331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.326938:0:32331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd72e expref: 17 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.326950:0:32331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd72e expref: 17 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.326976:0:32331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32331:1876445627616256:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518536.327069:0:32331:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518536.329039:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.329107:0:32331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32331:1876445627616256:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518536.329120:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617241216 00000100:00100000:1.0:1789518536.329126:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617241216 00010000:00010000:0.0:1789518536.329134:0:32331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.329156:0:33738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd72e expref: 18 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518536.329213:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518536.329222:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:2343:x1876445617241216:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518536.329236:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518536.329243:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd72e expref: 18 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.329256:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd72e expref: 18 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.329277:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784f53 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd72e expref: 18 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.329291:0:33738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:1.0:1789518536.329296:0:33738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.329315:0:33738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.329323:0:33738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.329353:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518536.329407:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:2343:x1876445617241216:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 185us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518536.329415:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00010000:00010000:3.0:1789518536.329447:0:32331:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.329464:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.329494:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.329502:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.329509:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.329515:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518536.329520:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.329526:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.329535:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:3.0:1789518536.329538:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789518536.329542:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.329548:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c784f92 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.329701:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:28602:x1876445617241088:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 2870us (3737us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789518536.329710:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:3.0:1789518536.331383:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518536.331458:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617241344 00000100:00100000:1.0:1789518536.331476:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617241344 00000100:00100000:1.0:1789518536.331528:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:1.0:1789518536.331540:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2343:x1876445617241344:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789518536.331594:0:33813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.331643:0:33813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.331654:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518536.331659:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518536.331664:0:33813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.331698:0:33813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.331713:0:33813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 7 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518536.331727:0:33813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:33813:1876445627616384:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518536.331808:0:33813:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063900 going to sleep for 11 seconds 00000001:00080000:3.0:1789518536.331871:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803783 is committed 00000001:00080000:3.0:1789518536.331889:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803781 is committed 00000100:00100000:1.0:1789518536.335116:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.335230:0:31610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617241472 00000100:00100000:2.0:1789518536.335240:0:31610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617241472 00010000:00010000:2.0:1789518536.335276:0:31610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 8 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.335367:0:33813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:33813:1876445627616384:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518536.335373:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1789518536.335385:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2342:x1876445617241472:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518536.335397:0:33813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.335406:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518536.335430:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 8 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.335445:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 8 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.335467:0:31610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c784f7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd74a expref: 8 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.335486:0:31610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518536.335504:0:31610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518536.335510:0:31610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.335519:0:31610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.335553:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518536.335578:0:33813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.335589:0:33813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.335603:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617241472:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 219us (495us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518536.335635:0:33813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.335643:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00010000:00010000:0.0:1789518536.335646:0:33813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.335657:0:33813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.335677:0:33813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518536.335682:0:33813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.335692:0:33813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.335706:0:33813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.335714:0:33813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000643cfe4d/0x631fd8698c784f99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.335759:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2343:x1876445617241344:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 4222us (4380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.335767:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518536.338309:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.338536:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617241728 00000100:00100000:3.0:1789518536.338545:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617241728 00000100:00100000:3.0:1789518536.338594:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:3.0:1789518536.338604:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:28602:x1876445617241728:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518536.338693:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.338710:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.338722:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.338996:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.339009:0:31626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd735 expref: 17 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.339016:0:31626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.339065:0:31626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd735 expref: 17 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.339078:0:31626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd735 expref: 17 pid: 32331 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.339109:0:31626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627616512:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518536.339185:0:31626:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518536.342014:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.342178:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617241856 00000100:00100000:0.0:1789518536.342186:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617241856 00000100:00100000:2.0:1789518536.342223:0:31626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627616512:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518536.342223:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd735 expref: 18 pid: 32331 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.342253:0:31626:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.342276:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1789518536.342286:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:2342:x1876445617241856:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518536.342299:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518536.342316:0:31609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd735 expref: 18 pid: 32331 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.342329:0:31609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd735 expref: 18 pid: 32331 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.342349:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c784f61 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd735 expref: 18 pid: 32331 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.342365:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:0.0:1789518536.342370:0:31609:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.342379:0:31609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.342387:0:31609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.342415:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518536.342453:0:31626:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.342462:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.342466:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:2342:x1876445617241856:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 179us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.342479:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000001:00080000:2.0:1789518536.342673:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803854 00000001:00080000:2.0:1789518536.342839:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803855 00000100:00100000:2.0:1789518536.342925:0:31626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31626:1876445627616640:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789518536.342966:0:31626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518536.343202:0:31629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627616640 00000100:00100000:3.0:1789518536.343207:0:31629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627616640 00000100:00100000:3.0:1789518536.343247:0:31629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518536.343255:0:31629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31626:x1876445627616640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789518536.343931:0:31626:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff78010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518536.343946:0:31629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31626:x1876445627616640:12345-0@lo:1000:mdt00_002.0 Request processed in 690us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.343951:0:31626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803789 gen 2 00000100:00100000:3.0:1789518536.343956:0:31629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789518536.343957:0:31626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffc6389500, transno 25769803789 00000100:00100000:2.0:1789518536.344331:0:31626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31626:1876445627616640:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789518536.346236:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803856 00000100:00100000:2.0:1789518536.346318:0:31626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31626:1876445627616768:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789518536.346373:0:31626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518536.346401:0:31626:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801900 going to sleep for 11 seconds 00000100:00100000:0.0:1789518536.346462:0:31630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627616768 00000100:00100000:0.0:1789518536.346469:0:31630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627616768 00000100:00100000:0.0:1789518536.346527:0:31630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518536.346536:0:31630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31626:x1876445627616768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518536.346762:0:31630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31626:x1876445627616768:12345-0@lo:1000:mdt00_002.0 Request processed in 227us (388us total) trans 25769803791 rc 0/0 00000100:00100000:0.0:1789518536.346780:0:31630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518536.346851:0:31626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31626:1876445627616768:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789518536.346899:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803857 00000001:00080000:2.0:1789518536.346976:0:31626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803858 00010000:00010000:2.0:1789518536.347031:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347043:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347050:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347055:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.347059:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347067:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347081:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.347084:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518536.347089:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347095:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981c00/0x631fd8698c784fa7 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347134:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347141:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347147:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347152:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.347155:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347161:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347169:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.347172:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518536.347178:0:31626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 21 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.347189:0:31626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 21 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.348985:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 21 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.349039:0:31626:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 21 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.349079:0:31626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627616896:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518536.349203:0:31626:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518536.354242:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.354365:0:31626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31626:1876445627616896:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518536.354458:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354470:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c784ed5 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.354501:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617241984 00010000:00010000:2.0:1789518536.354503:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.354510:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617241984 00010000:00010000:2.0:1789518536.354520:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354533:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354544:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354550:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354557:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354564:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc1f3e4f0) 00000100:00100000:3.0:1789518536.354567:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00010000:00010000:2.0:1789518536.354570:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.354579:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+22:28601:x1876445617241984:12345-192.168.206.51@tcp:49:lfs.0 00010000:00010000:2.0:1789518536.354597:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354610:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.354642:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.354648:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354654:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c784fae lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354665:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354671:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354678:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354683:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.354686:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354692:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 4/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354701:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.354704:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518536.354707:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 2/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.354725:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c784fa0 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.354945:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+22:28602:x1876445617241728:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 16341us (16642us total) trans 25769803859 rc 0/0 00000100:00100000:2.0:1789518536.354955:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000020:00080000:2.0:1789518536.354960:0:31626:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1789518536.355060:0:31656:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1789518536.355065:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518536.355100:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:0.0:1789518536.355110:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1789518536.356190:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+21:28601:x1876445617241984:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 1608us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518536.356201:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1789518536.358503:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.358924:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617242240 00000100:00100000:2.0:1789518536.358933:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617242240 00000100:00100000:2.0:1789518536.358986:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518536.358996:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+21:28602:x1876445617242240:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789518536.359744:0:31628:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789518536.359843:0:31628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803860 00010000:00010000:2.0:1789518536.359951:0:31628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.359969:0:31628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.359982:0:31628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.359992:0:31628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.359998:0:31628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.360321:0:31628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518536.360439:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:2.0:1789518536.360492:0:31628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518536.360540:0:32306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617242368 00000100:00100000:0.0:1789518536.360547:0:32306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617242368 00000100:00100000:2.0:1789518536.360587:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+23:28602:x1876445617242240:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1591us (2093us total) trans 25769803861 rc 0/0 00000100:00100000:0.0:1789518536.360594:0:32306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518536.360601:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1789518536.360607:0:32306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:28601:x1876445617242368:12345-192.168.206.51@tcp:101:lfs.0 00000020:00080000:2.0:1789518536.360608:0:31628:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789518536.360647:0:32306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.360663:0:32306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd751 expref: -99 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518536.360686:0:32306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6aa9e2c7, atime: 0x6aa9e2c7, ctime: 0x6aa9e2c7, blocks: 0xb 00010000:00010000:0.0:1789518536.360704:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1789518536.360709:0:32306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518536.360720:0:32306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd751 expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.360734:0:32306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd751 expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.360745:0:32306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:0.0:1789518536.360770:0:32306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:28601:x1876445617242368:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 166us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.360778:0:32306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00010000:00010000:3.0:1789518536.361033:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518536.361041:0:31612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.361049:0:31612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518536.361052:0:31612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.361060:0:31612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.361078:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:3.0:1789518536.361081:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518536.361086:0:31612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 1/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.361092:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c784fb5 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.361108:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518536.361110:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518536.361112:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518536.362569:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.362763:0:32312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617242496 00000100:00100000:0.0:1789518536.362771:0:32312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617242496 00002000:00100000:0.0:1789518536.362807:0:32312:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff99ffffe5b480 x1876445617242496/t0(0) o3->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:182/0 lens 488/0 e 0 to 0 dl 1789518547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518536.362817:0:32312:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe5b480 with x1876445617242496 ext(0->4095) 00002000:00010000:0.0:1789518536.362822:0:32312:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffffe5b480 00000100:00100000:0.0:1789518536.362844:0:32312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518536.362852:0:32312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617242496:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:0.0:1789518536.363032:0:32312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2342:x1876445617242496:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 181us (469us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518536.363039:0:32312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00002000:00100000:0.0:1789518536.363045:0:32312:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff99ffffe5b480 x1876445617242496/t0(0) o3->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:182/0 lens 488/4536 e 0 to 0 dl 1789518547 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518536.363053:0:32312:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe5b480 with x1876445617242496 ext(0->4095) 00002000:00010000:0.0:1789518536.363057:0:32312:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffffe5b480 00000100:00100000:1.0:1789518536.366924:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.367083:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617242624 00000100:00100000:2.0:1789518536.367092:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617242624 00000100:00100000:2.0:1789518536.367234:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:2.0:1789518536.367245:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2345:x1876445617242624:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:2.0:1789518536.367565:0:32308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.367584:0:32308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd751 expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.367593:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518536.367607:0:32308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518536.367646:0:32308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.367679:0:32308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd751 expref: 7 pid: 32306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.367693:0:32308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd751 expref: 7 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.367724:0:32308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:32308:1876445627617024:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518536.367793:0:32308:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518536.371820:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.371948:0:32308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:32308:1876445627617024:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518536.371971:0:32308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.372049:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617242752 00000100:00100000:3.0:1789518536.372057:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617242752 00010000:00010000:3.0:1789518536.372091:0:31611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd751 expref: 8 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.372162:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1789518536.372171:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2343:x1876445617242752:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518536.372185:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518536.372206:0:31611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd751 expref: 8 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.372219:0:31611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd751 expref: 8 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.372238:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c784fbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd751 expref: 8 pid: 32306 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.372358:0:31611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518536.372363:0:31611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518536.372368:0:31611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.372377:0:31611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.372446:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518536.372507:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+7:2343:x1876445617242752:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 336us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518536.372514:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00010000:00010000:2.0:1789518536.372985:0:32308:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.372995:0:32308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.373029:0:32308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.373038:0:32308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.373046:0:32308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.373053:0:32308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518536.373057:0:32308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.373078:0:32308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.373092:0:32308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.373100:0:32308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a5f349/0x631fd8698c784fc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.373202:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2345:x1876445617242624:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 5958us (6284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.373210:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:1.0:1789518536.375339:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.375410:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617243008 00000100:00100000:3.0:1789518536.375426:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617243008 00000100:00100000:3.0:1789518536.375499:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518536.375512:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+23:28601:x1876445617243008:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:3.0:1789518536.375653:0:31627:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b12:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784ec7 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd70b expref: 23 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518536.376093:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803862 00000001:00080000:3.0:1789518536.376479:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803863 00010000:00010000:3.0:1789518536.376556:0:31627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.376573:0:31627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 26 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.376605:0:31627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 4/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.376702:0:31627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 26 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.376722:0:31627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 26 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518536.376739:0:31627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31627:1876445627617152:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518536.376846:0:31627:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc5171cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518536.379256:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.379429:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617243136 00000100:00100000:0.0:1789518536.379438:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617243136 00010000:00010000:0.0:1789518536.379488:0:31609:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 5/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 27 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.379528:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:0.0:1789518536.379538:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff55c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+27:2343:x1876445617243136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518536.379550:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518536.379558:0:31609:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 5/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 27 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.379572:0:31627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31627:1876445627617152:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518536.379593:0:31609:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 27 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.379609:0:31627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.379823:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c784edc lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd712 expref: 27 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.379841:0:31609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:0.0:1789518536.379846:0:31609:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.379855:0:31609:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.379863:0:31609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 4/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.379894:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518536.379991:0:31627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.379999:0:31627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518536.380143:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803864 00000001:00080000:2.0:1789518536.380373:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803865 00000001:00080000:2.0:1789518536.380429:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803866 00000100:00100000:2.0:1789518536.380521:0:31627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31627:1876445627617280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789518536.380574:0:31627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518536.380610:0:31627:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518536.380681:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff55c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+29:2343:x1876445617243136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1143us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518536.380683:0:31630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627617280 00000100:00100000:3.0:1789518536.380698:0:31630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627617280 00000100:00100000:0.0:1789518536.380698:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518536.380774:0:31630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518536.380786:0:31630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31627:x1876445627617280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518536.381286:0:31630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31627:x1876445627617280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 499us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518536.381297:0:31630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518536.381467:0:31627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31627:1876445627617280:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789518536.381980:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803867 00000100:00100000:2.0:1789518536.382064:0:31627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31627:1876445627617408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789518536.382103:0:31627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518536.382127:0:31627:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801240 going to sleep for 11 seconds 00000100:00100000:3.0:1789518536.382153:0:31630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627617408 00000100:00100000:3.0:1789518536.382160:0:31630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627617408 00000100:00100000:3.0:1789518536.382203:0:31630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518536.382212:0:31630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31627:x1876445627617408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518536.382453:0:31630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:31627:x1876445627617408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 242us (349us total) trans 25769803792 rc 0/0 00000100:00100000:3.0:1789518536.382462:0:31630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518536.382487:0:31627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31627:1876445627617408:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:2.0:1789518536.382521:0:31627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.382530:0:31627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.382537:0:31627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.382542:0:31627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.382546:0:31627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.382552:0:31627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.382565:0:31627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.382568:0:31627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789518536.382573:0:31627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.382579:0:31627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980600/0x631fd8698c784fca lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518536.382860:0:31627:0:(mdd_object.c:4014:mdd_close()) Object [0x200002b11:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789518536.382947:0:31627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].4, 64 off8496 00000001:00080000:2.0:1789518536.382956:0:31627:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803868 00010000:00010000:2.0:1789518536.382992:0:31627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.382995:0:31627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518536.383002:0:31627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784ec7 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd70b expref: 30 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.383098:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+29:28601:x1876445617243008:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 7590us (7766us total) trans 25769803869 rc 0/0 00000100:00100000:2.0:1789518536.383106:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000020:00080000:2.0:1789518536.383110:0:31627:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1789518536.386778:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.387161:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617243264 00000100:00100000:2.0:1789518536.387170:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617243264 00000100:00100000:2.0:1789518536.387235:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:2.0:1789518536.387247:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+29:28601:x1876445617243264:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518536.387277:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518536.387298:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784fd1 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd758 expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.387356:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784fd1 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd758 expref: 30 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.387371:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784fd1 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd758 expref: 30 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.387390:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.387405:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518536.387409:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518536.387475:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+30:28601:x1876445617243264:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 230us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.387482:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:1.0:1789518536.391193:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.391257:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617243520 00000100:00100000:2.0:1789518536.391267:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617243520 00000100:00100000:2.0:1789518536.391323:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518536.391334:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+30:28601:x1876445617243520:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518536.391554:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+31:28601:x1876445617243520:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 222us (369us total) trans 25769803870 rc 0/0 00000100:00100000:2.0:1789518536.391562:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:1.0:1789518536.435299:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.435489:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617243648 00000100:00100000:0.0:1789518536.435498:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617243648 00000100:00100000:0.0:1789518536.435607:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:0.0:1789518536.435649:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+31:28612:x1876445617243648:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518536.435726:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.435743:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.435767:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.435782:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.435790:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.435796:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436098:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436107:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436114:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518536.436222:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436234:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436240:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436246:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436262:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.436267:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436275:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436287:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518536.436290:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.436295:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436302:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c784fd8 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436314:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436320:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436326:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436331:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.436334:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436340:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436358:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffdfff5800) 00010000:00010000:0.0:1789518536.436360:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.436363:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436369:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784fdf lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436386:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436391:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436396:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436401:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.436403:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436408:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436414:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:0.0:1789518536.436416:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.436419:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.436424:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fe6 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.436511:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+31:28612:x1876445617243648:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 894us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.436519:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1789518536.470056:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.470914:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617243776 00000100:00100000:0.0:1789518536.470923:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617243776 00000100:00100000:0.0:1789518536.470991:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:0.0:1789518536.471001:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+31:28618:x1876445617243776:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518536.471030:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.471054:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd75f expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.471114:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784ff4 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.471127:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784ff4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.471138:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784ff4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518536.471172:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:0.0:1789518536.471176:0:32331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518536.471192:0:32331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784ff4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.471216:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c784fed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd75f expref: 33 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.471234:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784ff4 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd75f expref: 32 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.471256:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518536.471259:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518536.471262:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd200, rc 0) 00000100:00100000:0.0:1789518536.471325:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+32:28618:x1876445617243776:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 325us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.471332:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:1.0:1789518536.473212:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.473311:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617243904 00000100:00100000:2.0:1789518536.473319:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617243904 00000100:00100000:2.0:1789518536.473373:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:2.0:1789518536.473383:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+32:28618:x1876445617243904:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518536.473401:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518536.473419:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784ffb lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd766 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473473:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473485:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473497:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473528:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473536:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473543:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473898:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473906:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473913:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518536.473943:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1789518536.473948:0:31626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518536.473965:0:31626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473976:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473983:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.473989:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474005:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474011:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.474015:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474036:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474048:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:2.0:1789518536.474051:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.474056:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474062:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c785002 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474074:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474080:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474085:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474089:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.474092:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474110:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474117:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.474119:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.474122:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474127:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785009 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474158:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c784ffb lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd766 expref: 34 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474171:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd766 expref: 33 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.474178:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.474180:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518536.474183:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:2.0:1789518536.474290:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+33:28618:x1876445617243904:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 907us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.474298:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:1.0:1789518536.477339:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.477575:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617244160 00000100:00100000:2.0:1789518536.477588:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617244160 00000100:00100000:2.0:1789518536.477837:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:2.0:1789518536.477853:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+33:28618:x1876445617244160:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518536.477900:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518536.477925:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785017 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd76d expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.478069:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.478086:0:31625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd766 expref: 34 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.478095:0:31625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 4/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.478261:0:31625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd766 expref: 34 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.478337:0:31625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd766 expref: 34 pid: 31626 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.478355:0:31625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627617536:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518536.478536:0:31625:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518536.480366:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.480398:0:31625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627617536:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518536.480431:0:31625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.480467:0:31610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617244288 00000100:00100000:0.0:1789518536.480479:0:31610:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617244288 00010000:00010000:0.0:1789518536.480525:0:31610:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd766 expref: 35 pid: 31626 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.481105:0:31610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1789518536.481115:0:31610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+35:2342:x1876445617244288:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518536.481130:0:31610:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518536.481138:0:31610:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd766 expref: 35 pid: 31626 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.481153:0:31610:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd766 expref: 35 pid: 31626 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.481290:0:31610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785010 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd766 expref: 35 pid: 31626 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.481307:0:31610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:0.0:1789518536.481311:0:31610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.481331:0:31610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.481339:0:31610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 4/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.481368:0:31610:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518536.481410:0:31625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.481421:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.481425:0:31610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+34:2342:x1876445617244288:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 309us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.481433:0:31610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000004:00200000:2.0:1789518536.481469:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:2.0:1789518536.481675:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785017 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd76d expref: 35 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.481695:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd76d expref: 34 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.481704:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.481707:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518536.481710:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:2.0:1789518536.481766:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+34:28618:x1876445617244160:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 3918us (4441us total) trans 25769803871 rc 0/0 00000100:00100000:2.0:1789518536.481774:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:1.0:1789518536.518232:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.518320:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617244416 00000100:00100000:2.0:1789518536.518333:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617244416 00000100:00100000:2.0:1789518536.518408:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:2.0:1789518536.518421:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+34:28628:x1876445617244416:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518536.518532:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.518554:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.518570:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.518599:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.518647:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.518654:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519013:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519038:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519049:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518536.519104:0:31626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519118:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519126:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519133:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519140:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.519145:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519153:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519174:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:2.0:1789518536.519178:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.519184:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519191:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78502c lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519206:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519212:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519219:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519224:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.519227:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519234:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519241:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.519244:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.519247:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519252:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785033 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519280:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519286:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519292:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519297:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.519300:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519306:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519314:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.519317:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.519320:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.519325:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78503a lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.519415:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+34:28628:x1876445617244416:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 996us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.519426:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:1.0:1789518536.534800:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.535105:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617244544 00000100:00100000:0.0:1789518536.535118:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617244544 00000100:00100000:0.0:1789518536.535258:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:0.0:1789518536.535271:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+34:28629:x1876445617244544:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:0.0:1789518536.535312:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.535341:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785041 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd774 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.535441:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.535459:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.535472:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.535491:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.535525:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.535535:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.535968:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.535980:0:32331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 2/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd76d expref: 35 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.535986:0:32331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 4/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.536032:0:32331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd76d expref: 35 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.536044:0:32331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 4/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd76d expref: 35 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.536056:0:32331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32331:1876445627617664:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518536.536186:0:32331:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc516c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518536.537505:0:32331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32331:1876445627617664:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518536.537534:0:32331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518536.538832:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.538887:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617244800 00000100:00100000:3.0:1789518536.538899:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617244800 00000100:00100000:3.0:1789518536.538974:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1789518536.538986:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+36:27199:x1876445617244800:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789518536.539482:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+37:27199:x1876445617244800:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 496us (654us total) trans 25769803872 rc 0/0 00000100:00100000:3.0:1789518536.539491:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518536.544015:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.544164:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617244928 00000100:00100000:2.0:1789518536.544177:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617244928 00010000:00010000:2.0:1789518536.544231:0:33738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 4/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd76d expref: 37 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.544672:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1789518536.544687:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+37:2342:x1876445617244928:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518536.544721:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518536.544739:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 4/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd76d expref: 37 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.544757:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd76d expref: 37 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.544796:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78501e lrc: 0/0,0 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd76d expref: 37 pid: 31625 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.544821:0:33738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.544828:0:33738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.544839:0:33738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.544855:0:33738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 4/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.544892:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518536.544943:0:32331:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.544955:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.544964:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+36:2342:x1876445617244928:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 280us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.544973:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000004:00200000:3.0:1789518536.545014:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:3.0:1789518536.545033:0:32331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518536.545060:0:32331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545075:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545086:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545093:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545107:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545113:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518536.545127:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545136:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545146:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:3.0:1789518536.545150:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518536.545155:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545161:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc600/0x631fd8698c785048 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545173:0:32331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545179:0:32331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545185:0:32331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545189:0:32331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bdc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518536.545192:0:32331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545198:0:32331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545204:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffdfff5800) 00010000:00010000:3.0:1789518536.545207:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518536.545216:0:32331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545222:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bdc00/0x631fd8698c78504f lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545737:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785041 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd774 expref: 36 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545756:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd774 expref: 35 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.545764:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:3.0:1789518536.545766:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518536.545769:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:3.0:1789518536.545818:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+35:28629:x1876445617244544:12345-192.168.206.51@tcp:101:rm.0 Request processed in 10550us (11030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518536.545826:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:1.0:1789518536.547871:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.547948:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617245184 00000100:00100000:0.0:1789518536.547973:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617245184 00000100:00100000:2.0:1789518536.548154:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:2.0:1789518536.548178:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+35:28629:x1876445617245184:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:2.0:1789518536.548276:0:31626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789518536.548308:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785056 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd774 expref: 35 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.548348:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c784fd1 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd758 expref: 34 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.548361:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16c00) 00010000:00010000:2.0:1789518536.548386:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c784ff4 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd75f expref: 33 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.548396:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:2.0:1789518536.548399:0:31626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518536.548433:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.548459:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.548471:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.548487:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.548494:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.548501:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.549243:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.549256:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.549264:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550295:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550309:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550320:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550328:0:31626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 4/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550335:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 4/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550342:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550370:0:31626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518536.550394:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550398:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550409:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550413:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518536.550503:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518536.550512:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.550519:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518536.550524:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.550533:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.550546:0:32583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16600) 00010000:00010000:1.0:1789518536.550550:0:32583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518536.550565:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 1/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.550572:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785072 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.550588:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518536.550590:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518536.550591:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518536.550658:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550665:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550673:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff99ffd8a16600) 00010000:00010000:2.0:1789518536.550676:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789518536.550679:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550685:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78506b lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550829:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.550837:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.551131:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.551137:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.551141:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.551159:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.551170:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:2.0:1789518536.551172:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.551176:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.551181:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78505d lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518536.551192:0:31626:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a55f0af4 reply state 0000000084922a1c transno 25769803873 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.551202:0:31626:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518536.551314:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+34:28629:x1876445617245184:12345-192.168.206.51@tcp:36:rm.0 Request processed in 3135us (3449us total) trans 25769803873 rc 0/0 00000100:00100000:2.0:1789518536.551326:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00010000:00010000:2.0:1789518536.553202:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.553224:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.553232:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.553239:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.553245:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.553274:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.553292:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.553295:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.553301:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.553307:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785064 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518536.556069:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.556123:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617245440 00000100:00100000:2.0:1789518536.556136:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617245440 00000100:00100000:2.0:1789518536.556207:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:2.0:1789518536.556220:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+33:28378:x1876445617245440:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518536.556250:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518536.556275:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785079 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd77b expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.556446:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.556463:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.556477:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.556495:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.556519:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.556526:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518536.557296:0:31625:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa4:0x0], index 0: 0 00010000:00010000:2.0:1789518536.557502:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78508e lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557512:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78508e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557520:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78508e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557556:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557563:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557569:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557574:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.557578:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557585:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557609:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:2.0:1789518536.557644:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.557651:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557658:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785080 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518536.557673:0:31625:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e252116 reply state 00000000847fabb0 transno 25769803874 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.557682:0:31625:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518536.557719:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785079 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd77b expref: 36 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557735:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78508e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd77b expref: 35 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.557743:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:2.0:1789518536.557746:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518536.557748:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:2.0:1789518536.557842:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+36:28378:x1876445617245440:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1625us (1787us total) trans 25769803874 rc 0/0 00000100:00100000:2.0:1789518536.557852:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:1.0:1789518536.561478:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518536.561651:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.561667:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.561675:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.561682:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518536.561688:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.561718:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.561739:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffd8a16900) 00010000:00010000:3.0:1789518536.561742:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518536.561749:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.561755:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785087 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.563261:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617245568 00000100:00100000:0.0:1789518536.563280:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617245568 00000100:00100000:0.0:1789518536.563367:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1789518536.563378:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:28378:x1876445617245568:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518536.563400:0:33813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.563424:0:33813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78509c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd782 expref: -99 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518536.563456:0:33813:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518536.563485:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=590s v=(0 0) 00010000:00010000:0.0:1789518536.563490:0:33813:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518536.563502:0:33813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78509c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd782 expref: 6 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.563519:0:33813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78509c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd782 expref: 6 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.563533:0:33813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:0.0:1789518536.563946:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:28378:x1876445617245568:12345-192.168.206.51@tcp:101:bash.0 Request processed in 562us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.563953:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:1.0:1789518536.567038:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.567122:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617245824 00000100:00100000:2.0:1789518536.567133:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617245824 00000100:00100000:2.0:1789518536.567188:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1789518536.567200:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+35:28378:x1876445617245824:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:2.0:1789518536.567776:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+36:28378:x1876445617245824:12345-192.168.206.51@tcp:35:bash.0 Request processed in 576us (761us total) trans 25769803875 rc 0/0 00000100:00100000:2.0:1789518536.567785:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518536.598564:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.598682:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617245952 00000100:00100000:0.0:1789518536.598775:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617245952 00000100:00100000:0.0:1789518536.598870:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:0.0:1789518536.598882:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+36:28635:x1876445617245952:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518536.598919:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.598971:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7850a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd789 expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.599095:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7850aa lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.599116:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7850aa lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.599129:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7850aa lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518536.599172:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 16384 00000004:00200000:0.0:1789518536.599175:0:31624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518536.599193:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7850aa lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.599229:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7850a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd789 expref: 38 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.599255:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7850aa lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd789 expref: 37 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.599265:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518536.599268:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518536.599287:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:0.0:1789518536.599379:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+37:28635:x1876445617245952:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 500us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.599386:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:1.0:1789518536.602496:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.602569:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617246208 00000100:00100000:3.0:1789518536.602585:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617246208 00000100:00100000:3.0:1789518536.602681:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:3.0:1789518536.602692:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+37:28635:x1876445617246208:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518536.602713:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518536.602734:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7850b1 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd790 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.602830:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c7850b8 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.602852:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c7850b8 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.602861:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c7850b8 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518536.602883:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:3.0:1789518536.602980:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c7850b1 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd790 expref: 40 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.602994:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c7850b8 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd790 expref: 39 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.602999:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:3.0:1789518536.603001:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518536.603004:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980000, rc 0) 00000100:00100000:3.0:1789518536.603146:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+39:28635:x1876445617246208:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 456us (662us total) trans 25769803876 rc 0/0 00000100:00100000:3.0:1789518536.603153:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:1.0:1789518536.606310:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.606391:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617246464 00000100:00100000:2.0:1789518536.606409:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617246464 00000100:00100000:2.0:1789518536.606473:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:2.0:1789518536.606487:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+39:28635:x1876445617246464:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518536.606508:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518536.606511:0:31626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1789518536.606532:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980000/0x631fd8698c7850b8 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd790 expref: 39 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606561:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78508e lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd77b expref: 38 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606571:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16400) 00010000:00010000:2.0:1789518536.606581:0:31626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518536.606593:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850c6 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd797 expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606669:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 3/1,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606679:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606689:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606717:0:31626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606724:0:31626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606730:0:31626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606736:0:31626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.606750:0:31626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606757:0:31626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606764:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.606766:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518536.606770:0:31626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 2/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606775:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850cd lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606795:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7850d4 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606802:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7850d4 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.606808:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7850d4 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.607011:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7850d4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd797 expref: 40 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.607031:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.607034:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518536.607044:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850c6 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd797 expref: 40 pid: 31626 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.607057:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7850d4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd797 expref: 39 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.607087:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.607089:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518536.607092:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17c00, rc 0) 00000100:00100000:2.0:1789518536.607153:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+39:28635:x1876445617246464:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 672us (852us total) trans 25769803877 rc 0/0 00000100:00100000:2.0:1789518536.607161:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518536.610226:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.610302:0:32313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617246592 00000100:00100000:3.0:1789518536.610320:0:32313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617246592 00002000:00100000:3.0:1789518536.610446:0:32313:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa4:0x0] (0->10) req@ffff99ffeda6a680 x1876445617246592/t0(0) o4->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:182/0 lens 504/0 e 0 to 0 dl 1789518547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518536.610459:0:32313:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6a680 with x1876445617246592 ext(0->10) 00002000:00010000:3.0:1789518536.610466:0:32313:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda6a680 00000100:00100000:3.0:1789518536.610693:0:32313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518536.610706:0:32313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617246592:12345-192.168.206.51@tcp:4:bash.0 00000100:00100000:3.0:1789518536.611415:0:32313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2342:x1876445617246592:12345-192.168.206.51@tcp:4:bash.0 Request processed in 709us (1193us total) trans 25769803784 rc 0/0 00000100:00100000:3.0:1789518536.611425:0:32313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00002000:00100000:3.0:1789518536.611435:0:32313:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa4:0x0] (0->10) req@ffff99ffeda6a680 x1876445617246592/t25769803784(0) o4->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:182/0 lens 504/448 e 0 to 0 dl 1789518547 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518536.611451:0:32313:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6a680 with x1876445617246592 ext(0->10) 00002000:00010000:3.0:1789518536.611456:0:32313:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda6a680 00000100:00100000:1.0:1789518536.614556:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.614653:0:32314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617246720 00000100:00100000:3.0:1789518536.614666:0:32314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617246720 00002000:00100000:3.0:1789518536.614731:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa4:0x0] (0->4095) req@ffff99ffeda69500 x1876445617246720/t0(0) o3->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:182/0 lens 488/0 e 0 to 0 dl 1789518547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518536.614743:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda69500 with x1876445617246720 ext(0->4095) 00002000:00010000:3.0:1789518536.614750:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda69500 00000100:00100000:3.0:1789518536.614854:0:32314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1789518536.614866:0:32314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2343:x1876445617246720:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518536.615119:0:32314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2343:x1876445617246720:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 255us (577us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789518536.615128:0:32314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00002000:00100000:3.0:1789518536.615136:0:32314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa4:0x0] (0->4095) req@ffff99ffeda69500 x1876445617246720/t0(0) o3->6936f0a4-eb5d-4d72-b5d0-1923c9b1191c@192.168.206.51@tcp:182/0 lens 488/4536 e 0 to 0 dl 1789518547 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518536.615143:0:32314:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda69500 with x1876445617246720 ext(0->4095) 00002000:00010000:3.0:1789518536.615147:0:32314:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda69500 00000100:00100000:1.0:1789518536.619225:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.619365:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617246976 00000100:00100000:3.0:1789518536.619378:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617246976 00000100:00100000:3.0:1789518536.619560:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518536.619573:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+39:28635:x1876445617246976:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518536.619967:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+40:28635:x1876445617246976:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 395us (757us total) trans 25769803878 rc 0/0 00000100:00100000:3.0:1789518536.619995:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1789518536.673191:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.673298:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617247104 00000100:00100000:2.0:1789518536.673313:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617247104 00000100:00100000:2.0:1789518536.673387:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:2.0:1789518536.673399:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+40:28645:x1876445617247104:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518536.673467:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673484:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673511:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673522:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673527:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673531:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673598:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673602:0:31625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673606:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518536.673674:0:31625:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673685:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673692:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673697:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673713:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.673717:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673726:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673738:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:2.0:1789518536.673742:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.673746:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673753:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7850db lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673766:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673773:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673778:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673788:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.673792:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673798:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673815:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffd8a16400) 00010000:00010000:2.0:1789518536.673817:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.673821:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673826:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7850e2 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673841:0:31625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673847:0:31625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673853:0:31625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673858:0:31625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518536.673860:0:31625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673866:0:31625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673874:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.673876:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518536.673879:0:31625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.673883:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c7850e9 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.673961:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+40:28645:x1876445617247104:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 565us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518536.673967:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:1.0:1789518536.722401:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.722669:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617247232 00000100:00100000:0.0:1789518536.722708:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617247232 00000100:00100000:0.0:1789518536.722808:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:0.0:1789518536.722821:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+40:28651:x1876445617247232:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518536.722856:0:31624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518536.722891:0:31624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7850f0 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd79e expref: -99 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723002:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723037:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723051:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723069:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723077:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723084:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723218:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723226:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723233:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518536.723287:0:31624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00000004:00200000:0.0:1789518536.723292:0:31624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518536.723315:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723330:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723339:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723346:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723354:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723361:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.723366:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723374:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723386:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518536.723390:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.723395:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723402:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c7850f7 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723428:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723435:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723442:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723448:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.723451:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723457:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723465:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffdfff5600) 00010000:00010000:0.0:1789518536.723467:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.723470:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723476:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c7850fe lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723914:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7850f0 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd79e expref: 42 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723930:0:31624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd79e expref: 41 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.723951:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:0.0:1789518536.723953:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518536.723956:0:31624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:0.0:1789518536.724058:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+41:28651:x1876445617247232:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1239us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.724067:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:1.0:1789518536.727429:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.728325:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617247488 00000100:00100000:3.0:1789518536.728339:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617247488 00000100:00100000:3.0:1789518536.728403:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1789518536.728416:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+41:28651:x1876445617247488:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518536.728439:0:32331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518536.728461:0:32331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c78510c lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd7a5 expref: -99 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.728567:0:32331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c785113 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.729241:0:32331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c785113 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.729254:0:32331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c785113 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518536.729270:0:32331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:3.0:1789518536.729400:0:32331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980400/0x631fd8698c78510c lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7a5 expref: 44 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.729421:0:32331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c785113 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7a5 expref: 43 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518536.729430:0:32331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:3.0:1789518536.729433:0:32331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518536.729437:0:32331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980e00, rc 0) 00000100:00100000:3.0:1789518536.729742:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+43:28651:x1876445617247488:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1328us (2323us total) trans 25769803879 rc 0/0 00000100:00100000:3.0:1789518536.729751:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1789518536.732124:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518536.732163:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.732292:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617247616 00000100:00100000:0.0:1789518536.732320:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617247616 00000100:00100000:2.0:1789518536.732374:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617247872 00000100:00100000:2.0:1789518536.732385:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617247872 00000100:00100000:0.0:1789518536.732428:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518536.732441:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518536.732450:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+44:2342:x1876445617247616:12345-192.168.206.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789518536.732465:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+44:28651:x1876445617247872:12345-192.168.206.51@tcp:35:lfs.0 00010000:00010000:0.0:1789518536.732492:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518536.732528:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980e00/0x631fd8698c785113 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7a5 expref: 44 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.732555:0:31611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:0.0:1789518536.732562:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518536.732687:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+43:2342:x1876445617247616:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 246us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.732698:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518536.732961:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+43:28651:x1876445617247872:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 505us (795us total) trans 25769803880 rc 0/0 00000100:00100000:2.0:1789518536.732970:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1789518536.799298:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.799672:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617248128 00000100:00100000:2.0:1789518536.799681:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617248128 00000100:00100000:2.0:1789518536.799805:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:2.0:1789518536.799816:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+43:28667:x1876445617248128:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518536.799840:0:31626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518536.799859:0:31626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c785121 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd7ac expref: -99 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.799948:0:31626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785128 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.799962:0:31626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785128 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.799975:0:31626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785128 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518536.800003:0:31626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:2.0:1789518536.800139:0:31626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c785121 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7ac expref: 46 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.800158:0:31626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785128 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7ac expref: 45 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.800167:0:31626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.800169:0:31626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789518536.800173:0:31626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:2.0:1789518536.800240:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+45:28667:x1876445617248128:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 423us (947us total) trans 25769803881 rc 0/0 00000100:00100000:2.0:1789518536.800247:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1789518536.873715:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518536.873869:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617248384 00000100:00100000:2.0:1789518536.873878:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617248384 00000100:00100000:2.0:1789518536.873933:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:2.0:1789518536.873943:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+45:28683:x1876445617248384:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518536.873963:0:31625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518536.873982:0:31625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c785136 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd7b3 expref: -99 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.874082:0:31625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 3/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.874097:0:31625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd79e expref: 46 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.874121:0:31625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 4/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.874172:0:31625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd79e expref: 46 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.874186:0:31625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd79e expref: 46 pid: 31624 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.874199:0:31625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627617792:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518536.874293:0:31625:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7801a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518536.876468:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518536.876564:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617248512 00000100:00100000:1.0:1789518536.876578:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617248512 00010000:00010000:1.0:1789518536.876708:0:33738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd79e expref: 47 pid: 31624 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518536.876755:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518536.876767:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+47:2343:x1876445617248512:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518536.876781:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518536.876787:0:33738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd79e expref: 47 pid: 31624 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.876812:0:33738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd79e expref: 47 pid: 31624 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.876834:0:33738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:1.0:1789518536.876838:0:33738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 3/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.876847:0:33738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.876855:0:33738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518536.876872:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518536.876925:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+47:2343:x1876445617248512:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 159us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518536.876934:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00010000:00010000:2.0:1789518536.877278:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd400/0x631fd8698c785105 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd79e expref: 46 pid: 31624 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518536.877300:0:31625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31625:1876445627617792:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518536.877320:0:31625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.877328:0:31625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.877334:0:31625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31625 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518536.877350:0:31625:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:2.0:1789518536.877897:0:31625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c785136 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7b3 expref: 47 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.877925:0:31625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7b3 expref: 46 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518536.877933:0:31625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:2.0:1789518536.877936:0:31625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518536.877939:0:31625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:2.0:1789518536.877983:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+46:28683:x1876445617248384:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 4041us (4277us total) trans 25769803882 rc 0/0 00000100:00100000:2.0:1789518536.877990:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00010000:00010000:1.0:1789518536.882908:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518536.913961:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518536.914057:0:31624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617248640 00000100:00100000:0.0:1789518536.914071:0:31624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617248640 00000100:00100000:0.0:1789518536.914142:0:31624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:0.0:1789518536.914152:0:31624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+46:28693:x1876445617248640:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518536.914233:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914265:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914277:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914292:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914299:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914305:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914392:0:31624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914401:0:31624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914408:0:31624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518536.914443:0:31624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914454:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914460:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914477:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914483:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.914487:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914495:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914505:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518536.914508:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.914513:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914519:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78514b lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914532:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914538:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914544:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914549:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bde00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.914551:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914565:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914573:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff99ffdfff5600) 00010000:00010000:0.0:1789518536.914575:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.914578:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914583:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bde00/0x631fd8698c785152 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914599:0:31624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914605:0:31624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914611:0:31624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914657:0:31624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518536.914660:0:31624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914671:0:31624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914679:0:31624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:0.0:1789518536.914681:0:31624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518536.914685:0:31624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518536.914699:0:31624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc200/0x631fd8698c785159 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518536.914777:0:31624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+46:28693:x1876445617248640:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 626us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518536.914785:0:31624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1789518537.613318:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518537.613386:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617248768 00000100:00100000:0.0:1789518537.613396:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617248768 00000100:00100000:0.0:1789518537.613448:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:0.0:1789518537.613458:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:2342:x1876445617248768:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518537.613527:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1083850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:2342:x1876445617248768:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 70us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518537.613534:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1789518537.614967:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518537.614999:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518537.615039:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518537.615062:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518537.615085:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518537.615109:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617249024 00000100:00100000:1.0:1789518537.615114:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617249024 00000100:00100000:1.0:1789518537.615147:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617249280 00000100:00100000:1.0:1789518537.615149:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617249280 00000100:00100000:1.0:1789518537.615174:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617248896 00000100:00100000:1.0:1789518537.615177:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617248896 00000100:00100000:1.0:1789518537.615186:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617249408 00000100:00100000:1.0:1789518537.615188:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617249408 00000100:00100000:1.0:1789518537.615202:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518537.615209:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617249024:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518537.615256:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617249024:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518537.615263:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518537.615276:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518537.615282:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2342:x1876445617249280:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518537.615302:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2342:x1876445617249280:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518537.615307:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518537.615317:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518537.615323:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2342:x1876445617248896:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518537.615340:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+8:2342:x1876445617248896:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 18us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518537.615346:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518537.615355:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518537.615361:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2342:x1876445617249408:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518537.615378:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2342:x1876445617249408:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 18us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518537.615384:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518537.615399:0:32331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617249152 00000100:00100000:1.0:1789518537.615407:0:32331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617249152 00000100:00100000:1.0:1789518537.615439:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518537.615445:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:2342:x1876445617249152:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518537.615475:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:2342:x1876445617249152:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518537.615481:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00080000:0.0:1789518537.615636:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518537.615641:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518537.615643:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518537.906831:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518538.930881:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518539.368554:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518539.368657:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617249536 00000100:00100000:2.0:1789518539.368664:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617249536 00000100:00100000:2.0:1789518539.368826:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:2.0:1789518539.368834:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+46:28547:x1876445617249536:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789518539.368911:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+46:28547:x1876445617249536:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 79us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518539.368916:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00080000:0.0:1789518539.368952:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518539.372812:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518539.372912:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617249792 00000100:00100000:3.0:1789518539.372922:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617249792 00000100:00100000:3.0:1789518539.372976:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1789518539.372986:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+46:28547:x1876445617249792:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518539.373217:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+47:28547:x1876445617249792:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 231us (413us total) trans 25769803883 rc 0/0 00000100:00100000:3.0:1789518539.373224:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1789518539.378868:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627617920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518539.378870:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627618304:0@lo:400:kworker.0 00000100:00100000:3.0:1789518539.378911:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627618176:0@lo:400:kworker.0 00000004:00080000:0.0:1789518539.378985:0:31649:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 593375370370ns, next at 594375368013ns, rc = 0 00000100:00100000:3.0:1789518539.378995:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518539.379027:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627618048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518539.379035:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518539.379082:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518539.379085:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627618432:0@lo:400:kworker.0 00000100:00100000:0.0:1789518539.379118:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627618560:0@lo:400:kworker.0 00000100:00100000:1.0:1789518539.379120:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518539.379156:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518539.379180:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627617920 00000100:00100000:1.0:1789518539.379188:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627617920 00000100:00100000:3.0:1789518539.379190:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627618688:0@lo:400:kworker.0 00000100:00100000:0.0:1789518539.379197:0:32311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627618048 00000100:00100000:0.0:1789518539.379202:0:32311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627618048 00000100:00100000:3.0:1789518539.379216:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518539.379254:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627618176 00000100:00100000:0.0:1789518539.379257:0:32311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518539.379258:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627618176 00000100:00100000:3.0:1789518539.379286:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789518539.379288:0:32311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627618048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518539.379293:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:3281:x1876445627618176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518539.379298:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789518539.379307:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627617920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518539.379329:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 1703936 free 3859808256 avail 3857711104 00002000:00000024:0.0:1789518539.379333:0:32311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789518539.379341:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1082050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f013254-1301-45d1-9493-6d558799b39e+19:3281:x1876445627618176:12345-0@lo:400:kworker.0 Request processed in 48us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518539.379355:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789518539.379370:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627617920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518539.379375:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518539.379391:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627618560 00000100:00100000:3.0:1789518539.379396:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627618560 00000100:00100000:0.0:1789518539.379397:0:32311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627618048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518539.379398:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627618432 00000100:00100000:1.0:1789518539.379403:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627618432 00000100:00100000:0.0:1789518539.379411:0:32311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518539.379423:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627618688 00000100:00100000:3.0:1789518539.379427:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627618688 00000100:00100000:1.0:1789518539.379432:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789518539.379443:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627618432:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789518539.379450:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518539.379454:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789518539.379456:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518539.379459:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518539.379463:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627618560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518539.379485:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627618432:12345-0@lo:400:kworker.0 Request processed in 45us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518539.379497:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627618048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518539.379501:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627618560:12345-0@lo:400:kworker.0 Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518539.379503:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518539.379510:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627618560:0@lo:400:kworker.0 00000100:00100000:3.0:1789518539.379512:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789518539.379531:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789518539.379538:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627618688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518539.379561:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803783 gen 2 00000004:00080000:0.0:1789518539.379568:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803782 committed transno 25769803783 00000100:00100000:3.0:1789518539.379570:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627618176:0@lo:400:kworker.0 00000100:00100000:1.0:1789518539.379579:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627618688:12345-0@lo:400:kworker.0 Request processed in 41us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518539.379584:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627618688:0@lo:400:kworker.0 00000100:00100000:1.0:1789518539.379590:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00080000:0.0:1789518539.379608:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffc638b800, transno 25769803783 00000100:00100000:0.0:1789518539.379647:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627617920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518539.379661:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627618432:0@lo:400:kworker.0 00000100:00100000:2.0:1789518539.379800:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518539.379863:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627618816:0@lo:400:kworker.0 00000100:00100000:2.0:1789518539.379883:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518539.379924:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627618816 00000100:00100000:1.0:1789518539.379929:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627618816 00000100:00100000:0.0:1789518539.379938:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627618304 00000100:00100000:0.0:1789518539.379945:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627618304 00000100:00100000:1.0:1789518539.380019:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789518539.380030:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627618816:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518539.380035:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518539.380037:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518539.380048:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627618304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518539.380069:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627618816:12345-0@lo:400:kworker.0 Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518539.380076:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518539.380116:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627618816:0@lo:400:kworker.0 00000100:00100000:0.0:1789518539.380125:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627618304:12345-0@lo:400:kworker.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518539.380132:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518539.380144:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627618304:0@lo:400:kworker.0 00010000:00010000:1.0:1789518539.957522:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518540.222505:0:34141:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 3b: Repeat attach/detach operations on multiple clients ========================================================== 20:29:00 (1789518540) 00000040:00080000:1.0:1789518540.466857:0:31656:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1789518540.466865:0:31656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518540.466896:0:31656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:1.0:1789518540.466901:0:31656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1789518540.979728:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789518541.090392:0:34189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_3b Need 3 or more clients, have 1 00000001:00080000:2.0:1789518541.466305:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803791 is committed 00000001:00080000:2.0:1789518541.466324:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803790 is committed 00000001:00080000:2.0:1789518541.466331:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803792 is committed 00000001:00080000:0.0:1789518541.469729:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803784 is committed 00000004:00080000:3.0:1789518541.471515:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1789518541.471801:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627618944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789518541.471867:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518541.471935:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627618944 00000100:00100000:0.0:1789518541.471942:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627618944 00000100:00100000:0.0:1789518541.472006:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518541.472014:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627618944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789518541.472038:0:32309:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:163 count 1 00002000:00010000:0.0:1789518541.472069:0:32309:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6aa9e2c7, atime: 0x6aa9e2c7, ctime: 0x6aa9e2c7, blocks: 0xb 00010000:00010000:0.0:1789518541.472077:0:32309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518541.472091:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789518541.472096:0:32309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518541.472101:0:32309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518541.472116:0:32309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518541.472126:0:32309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518541.472133:0:32309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518541.472149:0:32309:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1789518541.472246:0:34206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803882 is committed 00000020:00080000:1.0:1789518541.472282:0:34206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff7801540 refcount 2 committed 0 result 0 batchid 21474836520 00000020:00080000:1.0:1789518541.472286:0:34206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7801d80 00000020:00080000:1.0:1789518541.472289:0:34206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec18d2400 00000020:00080000:1.0:1789518541.472313:0:34206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff78010c0 refcount 2 committed 0 result 0 batchid 21474836519 00000020:00080000:1.0:1789518541.472316:0:34206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7801480 00000020:00080000:1.0:1789518541.472319:0:34206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffee04c400 00000001:00080000:1.0:1789518541.472337:0:34206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803883 is committed 00000020:00080000:1.0:1789518541.472354:0:34206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836518 batchid updated 00000020:00080000:1.0:1789518541.472363:0:31663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836520 committed batchid 21474836518 00000020:00080000:1.0:1789518541.472497:0:31663:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836518 00000100:00100000:0.0:1789518541.472725:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627618944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 710us (856us total) trans 25769803793 rc 0/0 00000100:00100000:0.0:1789518541.472738:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518541.472761:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803792 gen 2 00010000:00010000:0.0:1789518541.472761:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:1.0:1789518541.472766:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803791 committed transno 25769803792 00010000:00010000:0.0:1789518541.472767:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518541.472775:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518541.472779:0:32583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518541.472780:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803792 committed transno 25769803792 00010000:00010000:0.0:1789518541.472788:0:32583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518541.472791:0:3283:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fec28ad880 x1876445627618944/t25769803793(25769803793) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518557 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789518541.472801:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec28ad880/2, rc 0, transno 25769803793 00010000:00010000:0.0:1789518541.472803:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518541.472805:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627618944:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789518541.472811:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba704a2e/0x631fd8698c785160 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518541.472828:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518541.472830:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518541.472832:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518541.472975:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789518542.006036:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518542.038523:0:34244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 4: Auto cache test for mmap =========== 20:29:01 (1789518541) 00000100:00100000:3.0:1789518542.734826:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518542.734863:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518542.734892:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518542.734915:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518542.734936:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518542.734955:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518542.734977:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518542.735013:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617250432 00000100:00100000:3.0:1789518542.735021:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617250432 00000100:00100000:3.0:1789518542.735072:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617250048 00000100:00100000:3.0:1789518542.735075:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617250048 00000100:00100000:3.0:1789518542.735098:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518542.735115:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:2342:x1876445617250432:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518542.735179:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:2342:x1876445617250432:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518542.735187:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518542.735203:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518542.735209:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:2343:x1876445617250048:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518542.735237:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:2343:x1876445617250048:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518542.735243:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518542.735262:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617250176 00000100:00100000:3.0:1789518542.735265:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617250176 00000100:00100000:3.0:1789518542.735288:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617250688 00000100:00100000:3.0:1789518542.735291:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617250688 00000100:00100000:3.0:1789518542.735303:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617250304 00000100:00100000:3.0:1789518542.735305:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617250304 00000100:00100000:3.0:1789518542.735315:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617250560 00000100:00100000:3.0:1789518542.735317:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617250560 00000100:00100000:3.0:1789518542.735329:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518542.735335:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617250176:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518542.735359:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2342:x1876445617250176:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518542.735365:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518542.735376:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518542.735382:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2342:x1876445617250688:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518542.735402:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2342:x1876445617250688:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518542.735414:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518542.735426:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518542.735432:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2343:x1876445617250304:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518542.735454:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2343:x1876445617250304:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518542.735460:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518542.735470:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518542.735476:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2343:x1876445617250560:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518542.735496:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2343:x1876445617250560:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518542.735502:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00080000:3.0:1789518542.735523:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518542.735527:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518542.735530:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518542.735812:0:31618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617249920 00000100:00100000:0.0:1789518542.735817:0:31618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617249920 00000100:00100000:0.0:1789518542.735855:0:31618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:0.0:1789518542.735862:0:31618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:2342:x1876445617249920:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518542.735895:0:31618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:2342:x1876445617249920:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518542.735908:0:31618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00010000:00010000:3.0:1789518543.027726:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518543.796957:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518543.797263:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617250944 00000100:00100000:2.0:1789518543.797273:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617250944 00000100:00100000:2.0:1789518543.797333:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1789518543.797343:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+16:29614:x1876445617250944:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:2.0:1789518543.797741:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:29614:x1876445617250944:12345-192.168.206.51@tcp:35:umount.0 Request processed in 399us (792us total) trans 25769803884 rc 0/0 00000100:00100000:2.0:1789518543.797749:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1789518543.802348:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518543.802460:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617251200 00000100:00100000:2.0:1789518543.802469:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617251200 00000100:00100000:2.0:1789518543.802576:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518543.802598:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+17:29614:x1876445617251200:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:2.0:1789518543.802868:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:29614:x1876445617251200:12345-192.168.206.51@tcp:35:umount.0 Request processed in 282us (527us total) trans 25769803885 rc 0/0 00000100:00100000:2.0:1789518543.802876:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1789518543.804742:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518543.805019:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617251456 00000100:00100000:2.0:1789518543.805028:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617251456 00000100:00100000:2.0:1789518543.805060:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1789518543.805068:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+18:29614:x1876445617251456:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:2.0:1789518543.805245:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+19:29614:x1876445617251456:12345-192.168.206.51@tcp:35:umount.0 Request processed in 176us (568us total) trans 25769803886 rc 0/0 00000100:00100000:2.0:1789518543.805252:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:0.0:1789518543.807253:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518543.808504:0:31628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617251712 00000100:00100000:2.0:1789518543.808513:0:31628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617251712 00000100:00100000:2.0:1789518543.808799:0:31628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1789518543.808822:0:31628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+19:29614:x1876445617251712:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:2.0:1789518543.809212:0:31628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+20:29614:x1876445617251712:12345-192.168.206.51@tcp:35:umount.0 Request processed in 393us (1964us total) trans 25769803887 rc 0/0 00000100:00100000:2.0:1789518543.809220:0:31628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1789518543.813698:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518543.813738:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518543.813774:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518543.813960:0:31611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617251840 00000100:00100000:3.0:1789518543.813970:0:31611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617251840 00000100:00100000:2.0:1789518543.813981:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617251968 00000100:00100000:2.0:1789518543.813999:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617251968 00000100:00100000:0.0:1789518543.814005:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518543.814042:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617252224 00000100:00100000:2.0:1789518543.814047:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617252224 00000100:00100000:3.0:1789518543.814057:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518543.814070:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+15:2343:x1876445617251840:12345-192.168.206.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789518543.814078:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00010000:00010000:3.0:1789518543.814086:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518543.814104:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c784925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4b1 expref: 15 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.814120:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518543.814166:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+14:2343:x1876445617251840:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 100us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518543.814221:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518543.814227:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+14:2343:x1876445617251968:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518543.814239:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789518543.814245:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00010000:00010000:1.0:1789518543.814252:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16a00/0x631fd8698c78492c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4db expref: 13 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518543.814257:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff55f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+13:2342:x1876445617252224:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518543.814280:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518543.814304:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+12:2343:x1876445617251968:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 84us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518543.814310:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518543.814340:0:33813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617252096 00000100:00100000:1.0:1789518543.814344:0:33813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617252096 00010000:00010000:3.0:1789518543.814371:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789518543.814372:0:33813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518543.814382:0:33813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+5:2341:x1876445617252096:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:1.0:1789518543.814413:0:33813:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784948 00000100:00080000:1.0:1789518543.814428:0:33813:0:(import.c:65:import_set_state_nolock()) ffff99fec216f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518543.814470:0:33813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803793 00000100:00100000:1.0:1789518543.814714:0:33813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+2:2341:x1876445617252096:12345-192.168.206.51@tcp:9:umount.0 Request processed in 332us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518543.814721:0:33813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00010000:00010000:1.0:1789518543.814738:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518543.816521:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e1e00/0x631fd8698c784b39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5ec expref: 11 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.816540:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518543.816600:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff55f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:2342:x1876445617252224:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2346us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518543.817040:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518543.818459:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518543.818560:0:32308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617252480 00000100:00100000:3.0:1789518543.818568:0:32308:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617252480 00000100:00100000:3.0:1789518543.818791:0:32308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:3.0:1789518543.818805:0:32308:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+6:2341:x1876445617252480:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:3.0:1789518543.818832:0:32308:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784941 00000020:00010000:3.0:1789518543.818846:0:32308:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fec3ade800: total 0 00000100:00080000:3.0:1789518543.818850:0:32308:0:(import.c:65:import_set_state_nolock()) ffff99fec3ad9800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1789518543.818885:0:31613:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fec3ade800: total 0 00000001:00000004:3.0:1789518543.818888:0:32308:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803784 00010000:00010000:1.0:1789518543.818926:0:31613:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fec3ade800, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1789518543.818963:0:31613:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa4:0x0] updating lvb size from disk: 0 -> 11 00002000:00010000:1.0:1789518543.818967:0:31613:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa4:0x0] updating lvb mtime from disk: 0 -> 1789518537 00002000:00010000:1.0:1789518543.818970:0:31613:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa4:0x0] updating lvb ctime from disk: 0 -> 1789518537 00002000:00010000:1.0:1789518543.818973:0:31613:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789518543.819008:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78509c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd782 expref: 5 pid: 33813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518543.819034:0:31613:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fec3ade800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789518543.819050:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518543.819052:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518543.819054:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518543.819186:0:32308:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+2:2341:x1876445617252480:12345-192.168.206.51@tcp:9:umount.0 Request processed in 385us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518543.819896:0:32308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:1.0:1789518543.824702:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518543.824808:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617253504 00000100:00100000:3.0:1789518543.824823:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617253504 00000100:00100000:1.0:1789518543.824952:0:32331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:1.0:1789518543.824970:0:32331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+20:2341:x1876445617253504:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:1.0:1789518543.825013:0:32331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78493a 00000020:00010000:1.0:1789518543.825030:0:32331:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fec2168800: total 0 00000100:00080000:1.0:1789518543.825035:0:32331:0:(import.c:65:import_set_state_nolock()) ffff99ffc84de000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518543.825060:0:32331:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803887 00000020:00010000:3.0:1789518543.825081:0:31612:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fec2168800: total 0 00010000:00010000:3.0:1789518543.825089:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518543.825158:0:31612:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fec2168800, canceled 0 locks, left on hash table 11. 00010000:00010000:3.0:1789518543.825204:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:3.0:1789518543.825208:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518543.825220:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c785128 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7ac expref: 19 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825246:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:3.0:1789518543.825249:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518543.825254:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c784e9d lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6fd expref: 18 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825274:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16b00) 00010000:00010000:3.0:1789518543.825276:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518543.825281:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980c00/0x631fd8698c784db6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd6b0 expref: 17 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825307:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:3.0:1789518543.825311:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518543.825315:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c784ccf lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd66a expref: 16 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825331:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffe6f98b00) 00010000:00010000:3.0:1789518543.825334:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518543.825338:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980a00/0x631fd8698c7849cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd57c expref: 15 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825366:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:3.0:1789518543.825369:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518543.825382:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7850aa lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd789 expref: 15 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825405:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:3.0:1789518543.825408:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789518543.825412:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7850d4 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd797 expref: 14 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825433:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:3.0:1789518543.825436:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789518543.825440:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bcc00/0x631fd8698c784f37 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd727 expref: 13 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825462:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:3.0:1789518543.825465:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789518543.825470:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c784a0c lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd58a expref: 13 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825508:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffd8a16700) 00010000:00010000:3.0:1789518543.825511:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518543.825516:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c7849b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd575 expref: 10 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518543.825721:0:32331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6936f0a4-eb5d-4d72-b5d0-1923c9b1191c+9:2341:x1876445617253504:12345-192.168.206.51@tcp:39:umount.0 Request processed in 755us (1025us total) trans 25769803888 rc 0/0 00000100:00100000:1.0:1789518543.825731:0:32331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00010000:00010000:3.0:1789518543.825766:0:31612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff99ffd8a16800) 00010000:00010000:3.0:1789518543.825771:0:31612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518543.825780:0:31612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c78513d lrc: 0/0,0 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7b3 expref: 8 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518543.825803:0:31612:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fec2168800, canceled 11 locks, left on hash table 0. 00010000:00010000:1.0:1789518543.826241:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518543.826245:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518543.826247:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518544.050958:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518544.499047:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627619072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518544.499145:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518544.499283:0:32310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627619072 00000100:00100000:2.0:1789518544.499293:0:32310:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627619072 00000100:00100000:2.0:1789518544.499376:0:32310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518544.499387:0:32310:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627619072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518544.499428:0:32310:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789518544.499482:0:32310:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627619072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518544.499489:0:32310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518544.499538:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627619072:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789518544.499894:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518544.499921:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627619200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518544.499961:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518544.500009:0:32311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627619200 00000100:00100000:0.0:1789518544.500015:0:32311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627619200 00000100:00100000:0.0:1789518544.500054:0:32311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518544.500061:0:32311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627619200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518544.500083:0:32311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518544.500119:0:32311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627619200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518544.500124:0:32311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518544.500407:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627619328:0@lo:400:kworker.0 00000100:00080000:3.0:1789518544.500438:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518544.500446:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518544.500473:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627619200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518544.500529:0:31616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627619328 00000100:00100000:1.0:1789518544.500534:0:31616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627619328 00000100:00100000:1.0:1789518544.500576:0:31616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789518544.500584:0:31616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+19:3282:x1876445627619328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518544.500738:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627619456:0@lo:400:kworker.0 00000100:00100000:3.0:1789518544.500773:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518544.500805:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627619456 00000100:00100000:3.0:1789518544.500809:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627619456 00000100:00100000:3.0:1789518544.500841:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518544.500848:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627619456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518544.500885:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627619456:12345-0@lo:400:kworker.0 Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518544.500892:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518544.500922:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627619456:0@lo:400:kworker.0 00000100:00100000:1.0:1789518544.501034:0:31616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f013254-1301-45d1-9493-6d558799b39e+19:3282:x1876445627619328:12345-0@lo:400:kworker.0 Request processed in 451us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518544.501042:0:31616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789518544.501101:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627619328:0@lo:400:kworker.0 00000100:00100000:1.0:1789518544.501244:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627619584:0@lo:400:kworker.0 00000100:00100000:1.0:1789518544.501271:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518544.501483:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627619712:0@lo:400:kworker.0 00000100:00100000:3.0:1789518544.501510:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518544.501763:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627619584 00000100:00100000:0.0:1789518544.501768:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627619584 00000100:00100000:0.0:1789518544.501843:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627619712 00000100:00100000:0.0:1789518544.501847:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627619712 00000100:00100000:2.0:1789518544.501912:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518544.501922:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627619584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518544.501969:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627619584:12345-0@lo:400:kworker.0 Request processed in 49us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518544.501976:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518544.502023:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627619584:0@lo:400:kworker.0 00000100:00080000:3.0:1789518544.502120:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518544.503511:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518544.503522:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627619712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518544.503639:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627619712:12345-0@lo:400:kworker.0 Request processed in 119us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518544.503646:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518544.503801:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627619712:0@lo:400:kworker.0 00000100:00100000:0.0:1789518544.518132:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518544.518236:0:31627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617253760 00000100:00100000:3.0:1789518544.518250:0:31627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617253760 00000100:00100000:3.0:1789518544.518348:0:31627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1789518544.518361:0:31627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:29627:x1876445617253760:12345-192.168.206.51@tcp:35:umount.0 00000100:00100000:3.0:1789518544.519164:0:31627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:29627:x1876445617253760:12345-192.168.206.51@tcp:35:umount.0 Request processed in 803us (1043us total) trans 25769803889 rc 0/0 00000100:00100000:3.0:1789518544.519173:0:31627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00080000:1.0:1789518544.519246:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518544.523750:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518544.523800:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518544.523895:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617253888 00000100:00100000:1.0:1789518544.523908:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617253888 00000100:00100000:1.0:1789518544.523995:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617254016 00000100:00100000:1.0:1789518544.523999:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617254016 00000100:00100000:1.0:1789518544.524035:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518544.524048:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+11:2345:x1876445617253888:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518544.524066:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518544.524104:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fec4981a00/0x631fd8698c78495d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd513 expref: 11 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518544.524126:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518544.524195:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+10:2345:x1876445617253888:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 150us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518544.524203:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1789518544.524222:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518544.524229:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+9:2344:x1876445617254016:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518544.524238:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518544.524246:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e1600/0x631fd8698c784964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd53d expref: 9 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518544.524262:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518544.524280:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:2344:x1876445617254016:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 51us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518544.524286:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1789518544.525035:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518544.525220:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617254144 00000100:00100000:1.0:1789518544.525227:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617254144 00000100:00100000:1.0:1789518544.525269:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518544.525278:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+8:2344:x1876445617254144:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518544.525288:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518544.525300:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fec4980800/0x631fd8698c784b32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5e5 expref: 8 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518544.525314:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518544.525417:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+7:2344:x1876445617254144:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 139us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518544.525436:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518544.528511:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518544.529053:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617254400 00000100:00100000:0.0:1789518544.529066:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617254400 00000100:00100000:0.0:1789518544.529161:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1789518544.529173:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+6:2341:x1876445617254400:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:0.0:1789518544.529223:0:32309:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784980 00000020:00010000:0.0:1789518544.529232:0:32309:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ffffbf6800: total 0 00000100:00080000:0.0:1789518544.529238:0:32309:0:(import.c:65:import_set_state_nolock()) ffff99fec4893000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518544.529300:0:32309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803793 00000100:00100000:0.0:1789518544.529529:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e799ac01-e98f-4a49-8744-b8fd7980bcc5+4:2341:x1876445617254400:12345-192.168.206.51@tcp:9:umount.0 Request processed in 357us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518544.529555:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000020:00010000:2.0:1789518544.529701:0:31613:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ffffbf6800: total 0 00010000:00010000:2.0:1789518544.529737:0:31613:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ffffbf6800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1789518544.529773:0:31613:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb size from disk: 0 -> 14 00010000:00010000:2.0:1789518544.529802:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c784d23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd686 expref: 3 pid: 32579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518544.529839:0:31613:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ffffbf6800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789518544.529850:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518544.529852:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518544.529854:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518544.530382:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518544.538202:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518544.538653:0:32579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617254528 00000100:00100000:1.0:1789518544.538678:0:32579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617254528 00000100:00100000:1.0:1789518544.538772:0:32579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518544.538786:0:32579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+5:2341:x1876445617254528:12345-192.168.206.51@tcp:9:umount.0 00000020:00000080:1.0:1789518544.538834:0:32579:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784979 00000100:00080000:1.0:1789518544.538847:0:32579:0:(import.c:65:import_set_state_nolock()) ffff99fec4896000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789518544.538899:0:32579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803784 00000100:00080000:2.0:1789518544.539202:0:31620:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518544.539363:0:32579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e799ac01-e98f-4a49-8744-b8fd7980bcc5+2:2341:x1876445617254528:12345-192.168.206.51@tcp:9:umount.0 Request processed in 580us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518544.539372:0:32579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00010000:00010000:0.0:1789518544.539903:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518544.544717:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518544.544963:0:31625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617255168 00000100:00100000:3.0:1789518544.545007:0:31625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617255168 00000100:00100000:3.0:1789518544.545084:0:31625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:3.0:1789518544.545096:0:31625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+11:2341:x1876445617255168:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:3.0:1789518544.545145:0:31625:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784972 00000020:00010000:3.0:1789518544.545156:0:31625:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99ffff6c9000: total 0 00000100:00080000:3.0:1789518544.545162:0:31625:0:(import.c:65:import_set_state_nolock()) ffff99ffff6ca800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518544.545187:0:31625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803889 00000100:00100000:3.0:1789518544.545455:0:31625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e799ac01-e98f-4a49-8744-b8fd7980bcc5+10:2341:x1876445617255168:12345-192.168.206.51@tcp:39:umount.0 Request processed in 361us (751us total) trans 25769803890 rc 0/0 00000100:00100000:3.0:1789518544.545464:0:31625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000020:00010000:0.0:1789518544.546013:0:32583:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99ffff6c9000: total 0 00010000:00010000:0.0:1789518544.546128:0:32583:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99ffff6c9000, canceled 0 locks, left on hash table 5. 00010000:00010000:0.0:1789518544.546168:0:32583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:0.0:1789518544.546172:0:32583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518544.546182:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1800/0x631fd8698c784d0e lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd67f expref: 9 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518544.546203:0:32583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff99ffe6f98800) 00010000:00010000:0.0:1789518544.546216:0:32583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518544.546221:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c784ba9 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd60f expref: 8 pid: 31626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518544.546246:0:32583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff99ffd8a16e00) 00010000:00010000:0.0:1789518544.546249:0:32583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789518544.546253:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c784b6a lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd5fa expref: 7 pid: 31625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518544.546271:0:32583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518544.546274:0:32583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789518544.546278:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0200/0x631fd8698c784d7e lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd69b expref: 6 pid: 32331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518544.546296:0:32583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffd8a16b00) 00010000:00010000:0.0:1789518544.546299:0:32583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518544.546303:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c784d62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd694 expref: 5 pid: 31624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518544.546319:0:32583:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99ffff6c9000, canceled 5 locks, left on hash table 0. 00010000:00010000:0.0:1789518544.546332:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518544.546334:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518544.546336:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518544.560874:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518544.561358:0:31619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617255424 00000100:00100000:3.0:1789518544.561490:0:31619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617255424 00000100:00100000:3.0:1789518544.561566:0:31619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1789518544.561578:0:31619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+7:2341:x1876445617255424:12345-192.168.206.51@tcp:251:umount.0 00000020:00000080:2.0:1789518544.566695:0:31619:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784917 00000020:00010000:2.0:1789518544.566716:0:31619:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fec3ad8000: total 0 00000100:00080000:2.0:1789518544.566724:0:31619:0:(import.c:65:import_set_state_nolock()) ffff99fec3adc800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789518544.566922:0:31619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1082450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6+3:2341:x1876445617255424:12345-192.168.206.51@tcp:251:umount.0 Request processed in 5338us (6054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518544.566936:0:31619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000020:00010000:1.0:1789518544.567455:0:31613:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fec3ad8000: total 0 00010000:00010000:1.0:1789518544.567461:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518544.567519:0:31613:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fec3ad8000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789518544.567561:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0c00/0x631fd8698c78491e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd4aa expref: 2 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518544.567577:0:31613:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fec3ad8000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789518544.568208:0:31613:0:(genops.c:885:class_export_put()) final put ffff99fec3ad8000/4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6 00010000:00010000:1.0:1789518544.568272:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518544.568274:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518544.568276:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789518544.575413:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec3ad8000/4b62eb81-8164-4e4c-aaa1-55d6fbf5a9e6 for MGS 00000020:00000080:2.0:1789518544.575782:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec3adc800 for MGS 00010000:00010000:1.0:1789518545.075379:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789518545.709192:0:34439:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789518545.720532:0:34439:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789518545.720594:0:34439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518545.720640:0:34439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518545.720650:0:34439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518545.720778:0:34439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518545.720843:0:34439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789518545.720866:0:34439:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789518545.720892:0:34439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789518545.720897:0:34439:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789518545.720904:0:34439:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789518545.720934:0:34439:0:(import.c:65:import_set_state_nolock()) ffff99ffed7ae000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789518545.721967:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518545.721992:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.722002:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518545.722006:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.722041:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518545.722050:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518545.722057:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518545.722059:0:32583:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789518545.722063:0:32583:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789518545.722107:0:32583:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.722114:0:32583:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518545.722142:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.722149:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffd0697a00/0x631fd8698c78460e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c784615 expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.722161:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518545.722163:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518545.722165:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518545.722572:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518545.722593:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627619968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518545.722595:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627619840:0@lo:39:umount.0 00000100:00100000:3.0:1789518545.722702:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518545.722747:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627619968 00000100:00100000:0.0:1789518545.722758:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627619968 00000100:00100000:0.0:1789518545.722830:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518545.722842:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f013254-1301-45d1-9493-6d558799b39e+19:3283:x1876445627619968:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518545.722853:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789518545.722859:0:31609:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518545.722880:0:31609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17400/0x631fd8698c784615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c78460e expref: 19 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518545.722910:0:31626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627619840 00010000:00010000:0.0:1789518545.722912:0:31609:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518545.722916:0:31626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627619840 00000100:00100000:1.0:1789518545.722956:0:31626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789518545.722967:0:31626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876445627619840:12345-0@lo:39:umount.0 00000100:00100000:0.0:1789518545.722967:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f013254-1301-45d1-9493-6d558799b39e+18:3283:x1876445627619968:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518545.722992:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:00000080:1.0:1789518545.723013:0:31626:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784646 00000100:00080000:1.0:1789518545.723025:0:31626:0:(import.c:65:import_set_state_nolock()) ffff99ffc6bde000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789518545.723087:0:31626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3279:x1876445627619840:12345-0@lo:39:umount.0 Request processed in 124us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518545.723094:0:31626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000020:00000080:1.0:1789518545.723102:0:31626:0:(genops.c:885:class_export_put()) final put ffff99ffc6bdf000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1789518545.723127:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789518545.723142:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6bdf000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1789518545.723142:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627619968:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789518545.723200:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc6bde000 for lustre-MDT0000 00000100:00080000:1.0:1789518545.723229:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffed7ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789518545.723252:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627619840:0@lo:39:umount.0 00000100:00080000:2.0:1789518545.723361:0:34439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518545.723366:0:34439:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789518545.723371:0:34439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789518545.729742:0:34439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729773:0:34439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729780:0:34439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729786:0:34439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729800:0:34439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518545.729805:0:34439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729810:0:34439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729816:0:34439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729821:0:34439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729837:0:34439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789518545.729843:0:34439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729849:0:34439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729864:0:34439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729871:0:34439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729957:0:34439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789518545.729963:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789518545.729965:0:34439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.729988:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.729990:0:34439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730016:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1b17c20) 00010000:00010000:2.0:1789518545.730018:0:34439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518545.730023:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.730037:0:34439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730045:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518545.730050:0:34439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1789518545.730062:0:34439:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:0.0:1789518545.730063:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518545.730075:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518545.730078:0:32583:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1789518545.730082:0:32583:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000004:2.0:1789518545.730106:0:34439:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789518545.730111:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789518545.730116:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518545.730122:0:34439:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1789518545.730129:0:34439:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99fec3ade000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518545.730134:0:34439:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99fff4013000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518545.730140:0:34439:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99ffff6c9000 e799ac01-e98f-4a49-8744-b8fd7980bcc5 192.168.206.51@tcp 3 (0 3 0) 1 0 0 0: 0000000000000000 25769803829 stale:0 00000020:00080000:2.0:1789518545.730152:0:34439:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99fec2168800 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 192.168.206.51@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 25769803883 stale:0 00000020:00080000:2.0:1789518545.730162:0:34439:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff99fffee28000) has exports, disconnecting them 00000020:00080000:2.0:1789518545.730167:0:34439:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99fec3ade000), last request at 1789518544 00000020:00000080:2.0:1789518545.730174:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784814 00000100:00080000:2.0:1789518545.730193:0:34439:0:(import.c:65:import_set_state_nolock()) ffff99fec3adf800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789518545.730199:0:32583:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730208:0:32583:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518545.730243:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789518545.730248:0:34439:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fec3ade000): rc 0 00000020:00000080:2.0:1789518545.730255:0:34439:0:(genops.c:885:class_export_put()) final put ffff99fec3ade000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1789518545.730275:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffd0697200/0x631fd8698c784574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78457b expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730290:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789518545.730304:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730310:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981e00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518545.730314:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730321:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518545.730328:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518545.730334:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789518545.730339:0:32583:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00080000:2.0:1789518545.730340:0:34439:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99fff4013000), last request at 1789518544 10000000:01000000:0.0:1789518545.730342:0:32583:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:2.0:1789518545.730352:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7846c4 00000100:00080000:2.0:1789518545.730361:0:34439:0:(import.c:65:import_set_state_nolock()) ffff99fff4011000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789518545.730365:0:32583:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789518545.730372:0:34439:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fff4013000): rc 0 00010000:00010000:0.0:1789518545.730374:0:32583:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:2.0:1789518545.730379:0:34439:0:(genops.c:885:class_export_put()) final put ffff99fff4013000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789518545.730390:0:34439:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa50841827ae0 00010000:00010000:0.0:1789518545.730399:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730408:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c784822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c784829 expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518545.730409:0:34439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789518545.730418:0:34439:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803783 gen 3 00000004:00080000:2.0:1789518545.730435:0:34439:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1789518545.730443:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518545.730448:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730456:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518545.730459:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730466:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518545.730474:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518545.730479:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789518545.730482:0:32583:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789518545.730484:0:32583:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789518545.730498:0:32583:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730503:0:32583:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518545.730511:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518545.730515:0:34439:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:0.0:1789518545.730520:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16800/0x631fd8698c784b24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c784b2b expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730530:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518545.730533:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518545.730540:0:34439:0:(import.c:65:import_set_state_nolock()) ffff99ffc2c1b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789518545.730547:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697e00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518545.730554:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730564:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518545.730571:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518545.730575:0:34439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 10000000:01000000:0.0:1789518545.730577:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00100000:2.0:1789518545.730582:0:34439:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803792 gen 3 10000000:01000000:0.0:1789518545.730582:0:32583:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789518545.730586:0:32583:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1789518545.730599:0:34439:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99fec28ad880 x1876445627618944/t25769803793(25769803793) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518557 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789518545.730602:0:32583:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730641:0:32583:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518545.730651:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518545.730654:0:34439:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec28ad880, transno 25769803793 00010000:00010000:0.0:1789518545.730661:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffd0697e00/0x631fd8698c784566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c78456d expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.730678:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518545.730681:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518545.730686:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789518545.730687:0:34439:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789518545.730710:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627620608:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789518545.730755:0:34439:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789518545.730769:0:34439:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f46800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789518545.730790:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789518545.730815:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99fffee28000) has no exports 00000100:00100000:0.0:1789518545.730862:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518545.730880:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627620096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518545.730905:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789518545.730959:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec3ade000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789518545.731024:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4013000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789518545.731044:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec3adf800 for lustre-MDT0000 00000020:00000080:0.0:1789518545.731048:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fff4011000 for lustre-MDT0000 00000100:00100000:0.0:1789518545.731065:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627620480:0@lo:9:umount.0 00000100:00100000:0.0:1789518545.731092:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518545.731124:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627620736:0@lo:9:umount.0 00000100:00100000:0.0:1789518545.731145:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518545.731173:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627620480 00000100:00100000:0.0:1789518545.731181:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627620480 00000100:00100000:0.0:1789518545.731228:0:32309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627620736 00010000:00010000:1.0:1789518545.731229:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518545.731232:0:32309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627620736 00000100:00100000:1.0:1789518545.731255:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627620608 00000100:00100000:0.0:1789518545.731261:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789518545.731264:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627620608 00000100:00100000:0.0:1789518545.731272:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1876445627620480:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789518545.731299:0:32309:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7846e0 00000100:00080000:0.0:1789518545.731309:0:32309:0:(import.c:65:import_set_state_nolock()) ffff99ffff386000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789518545.731322:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627620096 00000100:00100000:1.0:1789518545.731329:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627620096 00010000:00010000:3.0:1789518545.731331:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518545.731354:0:31611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000001:00000004:0.0:1789518545.731357:0:32309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803784 00000100:00100000:3.0:1789518545.731369:0:31611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f013254-1301-45d1-9493-6d558799b39e+19:3282:x1876445627620608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518545.731384:0:31611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518545.731403:0:31611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b44a00/0x631fd8698c78456d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c784566 expref: 19 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518545.731482:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627620352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518545.731554:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3279:x1876445627620480:12345-0@lo:9:umount.0 Request processed in 282us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518545.731562:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789518545.731576:0:32309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789518545.731582:0:32309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627620736:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789518545.731593:0:32309:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784830 00000100:00080000:0.0:1789518545.731599:0:32309:0:(import.c:65:import_set_state_nolock()) ffff99fec4894000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789518545.731631:0:32309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803793 00000100:00100000:2.0:1789518545.731676:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518545.731717:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627620352 00000100:00100000:1.0:1789518545.731722:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627620352 00000100:00100000:2.0:1789518545.731740:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518545.731754:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627620224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518545.731773:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518545.731783:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f013254-1301-45d1-9493-6d558799b39e+19:3282:x1876445627620096:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518545.731792:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518545.731796:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518545.731816:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b16c00/0x631fd8698c78457b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c784574 expref: 19 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518545.731823:0:32309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+3:3279:x1876445627620736:12345-0@lo:9:umount.0 Request processed in 235us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518545.731841:0:32309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1789518545.731846:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518545.731884:0:31610:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789518545.731892:0:31610:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00080000:0.0:1789518545.731892:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc2c1b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789518545.731904:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f013254-1301-45d1-9493-6d558799b39e+18:3282:x1876445627620096:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (997us total) trans 0 rc 0/0 00000004:00080000:0.0:1789518545.731913:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:1.0:1789518545.731915:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1789518545.731918:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789518545.731926:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627620480:0@lo:9:umount.0 00000100:00100000:1.0:1789518545.731943:0:33738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627620224 00000100:00080000:0.0:1789518545.731950:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc4f46800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789518545.731951:0:33738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627620224 00000100:00100000:2.0:1789518545.731965:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627620096:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1789518545.731966:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789518545.731985:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789518545.731993:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627620736:0@lo:9:umount.0 00000100:00100000:1.0:1789518545.732001:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518545.732010:0:31609:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789518545.732014:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff55f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f013254-1301-45d1-9493-6d558799b39e+18:3281:x1876445627620352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518545.732026:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518545.732042:0:31611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518545.732042:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fec4981800/0x631fd8698c784b2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c784b24 expref: 18 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518545.732058:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518545.732060:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518545.732107:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff55f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f013254-1301-45d1-9493-6d558799b39e+17:3281:x1876445627620352:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518545.732114:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789518545.732129:0:31611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f013254-1301-45d1-9493-6d558799b39e+16:3282:x1876445627620608:12345-0@lo:103:ldlm_bl.0 Request processed in 764us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518545.732140:0:33738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789518545.732151:0:33738:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f013254-1301-45d1-9493-6d558799b39e+16:3281:x1876445627620224:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518545.732157:0:31611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789518545.732164:0:33738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518545.732184:0:33738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc6b17000/0x631fd8698c784829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c784822 expref: 15 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518545.732197:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f013254-1301-45d1-9493-6d558799b39e:3282:1876445627620608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518545.732203:0:33738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518545.732233:0:33738:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f013254-1301-45d1-9493-6d558799b39e+14:3281:x1876445627620224:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518545.732240:0:33738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789518545.732266:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518545.732275:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627620224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518545.732285:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f013254-1301-45d1-9493-6d558799b39e:3281:1876445627620352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518546.106519:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789518546.586345:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789518546.586375:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e799ac01-e98f-4a49-8744-b8fd7980bcc5 00000020:00000080:0.0:1789518546.586379:0:7607:0:(genops.c:885:class_export_put()) final put ffff99ffffbf6800/e799ac01-e98f-4a49-8744-b8fd7980bcc5 00000001:00080000:0.0:1789518546.586406:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803793 is committed 00000020:00000080:0.0:1789518546.586410:0:7607:0:(genops.c:885:class_export_put()) final put ffff99fec4893800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789518546.586422:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 00000020:00000080:0.0:1789518546.586424:0:7607:0:(genops.c:885:class_export_put()) final put ffff99fec216d000/6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 00000020:00000080:0.0:1789518546.586442:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf6800/e799ac01-e98f-4a49-8744-b8fd7980bcc5 for lustre-OST0001 00000020:00000080:0.0:1789518546.586500:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec4893800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789518546.586519:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec216d000/6936f0a4-eb5d-4d72-b5d0-1923c9b1191c for lustre-OST0001 00000020:00000080:0.0:1789518546.586546:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec4893000 for lustre-OST0001 00000020:00000080:0.0:1789518546.586552:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec4894000 for lustre-OST0001 00000020:00000080:0.0:1789518546.586555:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec216f000 for lustre-OST0001 00000001:00100000:0.0:1789518546.594470:0:34206:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 00000001:00080000:0.0:1789518546.594493:0:34206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803888 is committed 00000020:00080000:0.0:1789518546.594581:0:34206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836520 batchid updated 00000020:00080000:2.0:1789518546.594665:0:31663:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff78010c0 refcount 1 committed 1 result 0 batchid 21474836519 00000020:00080000:2.0:1789518546.594674:0:31663:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7801480 00000020:00080000:2.0:1789518546.594679:0:31663:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffee04c400 00000020:00080000:2.0:1789518546.594687:0:31663:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff7801540 refcount 1 committed 1 result 0 batchid 21474836520 00000020:00080000:2.0:1789518546.594691:0:31663:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7801d80 00000020:00080000:2.0:1789518546.594694:0:31663:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec18d2400 00000001:00100000:0.0:1789518546.594735:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789518546.594740:0:6674:0:(genops.c:885:class_export_put()) final put ffff99ffff385800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789518546.594774:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e799ac01-e98f-4a49-8744-b8fd7980bcc5 00000020:00000080:0.0:1789518546.594777:0:6674:0:(genops.c:885:class_export_put()) final put ffff99fec4897800/e799ac01-e98f-4a49-8744-b8fd7980bcc5 00000001:00100000:0.0:1789518546.594788:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 00000020:00000080:0.0:1789518546.594790:0:6674:0:(genops.c:885:class_export_put()) final put ffff99fec3ade800/6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 00000020:00000080:0.0:1789518546.594892:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff385800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789518546.594933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec4897800/e799ac01-e98f-4a49-8744-b8fd7980bcc5 for lustre-OST0000 00000020:00000080:0.0:1789518546.594949:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec3ade800/6936f0a4-eb5d-4d72-b5d0-1923c9b1191c for lustre-OST0000 00000020:00000080:0.0:1789518546.594965:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffff386000 for lustre-OST0000 00000020:00000080:0.0:1789518546.594982:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec4896000 for lustre-OST0000 00000020:00000080:0.0:1789518546.594986:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec3ad9800 for lustre-OST0000 00000020:00000080:0.0:1789518546.598718:0:5833:0:(genops.c:885:class_export_put()) final put ffff99fec2168800/6936f0a4-eb5d-4d72-b5d0-1923c9b1191c 00000001:00100000:0.0:1789518546.598788:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e799ac01-e98f-4a49-8744-b8fd7980bcc5 00000001:00080000:0.0:1789518546.598801:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803890 is committed 00000020:00000080:0.0:1789518546.598809:0:5833:0:(genops.c:885:class_export_put()) final put ffff99ffff6c9000/e799ac01-e98f-4a49-8744-b8fd7980bcc5 00000020:00000080:2.0:1789518546.600979:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec2168800/6936f0a4-eb5d-4d72-b5d0-1923c9b1191c for lustre-MDT0000 00000020:00000080:2.0:1789518546.601130:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc84de000 for lustre-MDT0000 00000020:00000080:2.0:1789518546.602108:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff6c9000/e799ac01-e98f-4a49-8744-b8fd7980bcc5 for lustre-MDT0000 00000020:00000080:2.0:1789518546.602158:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffff6ca800 for lustre-MDT0000 00000020:00080000:1.0:1789518546.611038:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99fffee28000) has no exports 00000020:00000080:1.0:1789518546.658843:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7845c1 00000020:00000080:1.0:1789518546.658858:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc76f0000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789518546.658938:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789518546.658997:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518546.659008:0:34439:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789518546.659013:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff99ffee064d40) has no exports 00000020:00000080:0.0:1789518546.659013:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc76f0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789518546.659275:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7845ba 00000020:00000080:2.0:1789518546.659280:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc5e37800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789518546.659339:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518546.659346:0:34439:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789518546.659350:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc5e36800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789518546.659352:0:34439:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5e36800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789518546.659359:0:34439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789518546.659494:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5e37800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789518546.659546:0:34439:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffed5ce780 - data ffff99ffd7b38ca8/ffff99fec2870800 00000020:01000000:3.0:1789518546.661391:0:34439:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99fec2186de0 - data ffff99fff7ff15e8/ffff99ffc6e56400 00000001:00000004:3.0:1789518546.679021:0:34439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803890 00000100:00080000:3.0:1789518546.741490:0:34439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789518546.741497:0:34439:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803783 gen 4 00000004:00080000:3.0:1789518546.741518:0:34439:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518546.741521:0:34439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789518546.741827:0:31646:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789518546.741832:0:31646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x22:0x0] index 3 count 1 00000040:00080000:0.0:1789518546.741846:0:31646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 6 count 2 00000100:00080000:3.0:1789518546.744419:0:34439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789518546.744425:0:34439:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803792 gen 4 00000004:00080000:3.0:1789518546.747899:0:34439:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789518546.747907:0:34439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789518546.748689:0:31648:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789518546.748694:0:31648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 4 count 2 00000040:00080000:0.0:1789518546.748703:0:31648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 6 count 2 00000020:00000080:3.0:1789518546.793391:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784589 00000020:00000080:3.0:1789518546.793401:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc6491000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789518546.793679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6491000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518546.794949:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78459e 00000020:00000080:0.0:1789518546.794957:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc6496800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789518546.794992:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789518546.794998:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518546.795005:0:34439:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518546.795010:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff99fffee2cd40) has no exports 00000020:00000080:1.0:1789518546.795013:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6496800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1789518546.795250:0:34439:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789518546.795258:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7845eb 00000020:00000080:0.0:1789518546.795262:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc81aa800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789518546.795267:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789518546.795270:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518546.795274:0:34439:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789518546.795277:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff99fffee299c0) has no exports 00000020:00000080:0.0:1789518546.795282:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7845e4 00000020:00000080:0.0:1789518546.795285:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc76f5800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789518546.795689:0:34439:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789518546.795694:0:34439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789518546.795698:0:34439:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803792 gen 5 00000004:00080000:0.0:1789518546.795704:0:34439:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789518546.795706:0:34439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518546.795748:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518546.795752:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc81aa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789518546.795755:0:34439:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518546.795763:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7845d6 00000020:00000080:1.0:1789518546.795767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc76f5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518546.795768:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc6490800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789518546.795784:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789518546.795787:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc4f46800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789518546.795789:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518546.795794:0:34439:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1789518546.795795:0:8:0:(genops.c:885:class_export_put()) final put ffff99ffc6496000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1789518546.795797:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff99ffee063380) has no exports 00000020:00000080:1.0:1789518546.795800:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6496000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789518546.795804:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7845cf 00000020:01000000:1.0:1789518546.795808:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518546.795810:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc76f4000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789518546.795882:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6490800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789518546.795891:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc76f4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789518546.796295:0:34439:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789518546.796298:0:34439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789518546.796300:0:34439:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803783 gen 5 00000004:00080000:0.0:1789518546.796304:0:34439:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789518546.796312:0:34439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789518546.796344:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518546.796348:0:34439:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518546.796367:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518546.796369:0:34439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518546.796373:0:34439:0:(genops.c:885:class_export_put()) final put ffff99fec2afa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789518546.796375:0:34439:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec2afa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789518546.796380:0:34439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789518546.796513:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7845a5 00000020:00000080:0.0:1789518546.796518:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc6492800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789518546.796588:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789518546.796591:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518546.796595:0:34439:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789518546.796597:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff99fffee2b380) has no exports 00000020:00000080:0.0:1789518546.796630:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518546.796634:0:34439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789518546.796637:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7845ac 00000020:00000080:0.0:1789518546.796641:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc6497000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789518546.796648:0:34439:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffe6225800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789518546.796651:0:34439:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffe6225800 3 00000020:01000004:0.0:1789518546.796654:0:34439:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffe6225800 from lustre-MDT0000 00000020:00000080:0.0:1789518546.796670:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518546.796673:0:34439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789518546.796675:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc6490000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789518546.796677:0:34439:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6490000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789518546.796684:0:34439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789518546.796712:0:34439:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789518546.796716:0:34439:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789518546.796720:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789518546.796723:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518546.796726:0:34439:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789518546.796733:0:34439:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff99fec2af9000 6f013254-1301-45d1-9493-6d558799b39e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789518546.796738:0:34439:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff99ffc6513380) has exports, disconnecting them 00000020:00000080:1.0:1789518546.796748:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc2c1b800 for lustre-OST0000-osc-MDT0000 00000020:00080000:0.0:1789518546.796749:0:34439:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99fec2af9000), last request at 1789518498 00000020:00000080:1.0:1789518546.796758:0:8:0:(genops.c:885:class_export_put()) final put ffff99ffc4f47800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789518546.796762:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc4f47800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789518546.796767:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78454a 00000020:01000000:1.0:1789518546.796770:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00010000:0.0:1789518546.796774:0:34439:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99fec2af9000: total 2 00000100:00080000:0.0:1789518546.796781:0:34439:0:(import.c:65:import_set_state_nolock()) ffff99fec2afa800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789518546.796796:0:34439:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fec2af9000): rc 0 00000020:00080000:0.0:1789518546.796801:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff99ffc6513380) has no exports 00000020:00010000:3.0:1789518546.796803:0:32583:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99fec2af9000: total 2 00000020:00000080:1.0:1789518546.796854:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6492800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789518546.796859:0:8:0:(genops.c:885:class_export_put()) final put ffff99ffc6493800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789518546.796861:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6493800/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:0.0:1789518546.796862:0:31618:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff99fff46b9c00:31618] 1 exiting: rc = 0 00000020:01000000:1.0:1789518546.796866:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:3.0:1789518546.796905:0:32583:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99fec2af9000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789518546.796938:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0696e00/0x631fd8698c784b0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c784b08 expref: 9 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518546.797187:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b44800/0x631fd8698c784685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c78467e expref: 8 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518546.797197:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fec4981600/0x631fd8698c7847d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c7847ce expref: 7 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518546.797204:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffd0697800/0x631fd8698c784677 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c784670 expref: 6 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518546.797214:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bca00/0x631fd8698c7846af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c7846a8 expref: 5 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518546.797224:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0a00/0x631fd8698c784b1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c784b16 expref: 4 pid: 31616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518546.797234:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fec4981000/0x631fd8698c7847ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c7847f8 expref: 3 pid: 31619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518546.797243:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fff5b45e00/0x631fd8698c78455f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x631fd8698c784558 expref: 2 pid: 31618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518546.797254:0:32583:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99fec2af9000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789518546.797268:0:32583:0:(genops.c:885:class_export_put()) final put ffff99fec2af9000/6f013254-1301-45d1-9493-6d558799b39e 00010000:00010000:3.0:1789518546.797295:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518546.797298:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518546.797300:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518546.797390:0:31619:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff99fff402de00:31619] 2 exiting: rc = 0 00000020:00000080:1.0:1789518546.797390:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6497000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789518546.797400:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec2af9000/6f013254-1301-45d1-9493-6d558799b39e for MGS 00000020:00000080:1.0:1789518546.797430:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec2afa800 for MGS 00000100:00100000:1.0:1789518546.797460:0:31616:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff99ffc6096600:31616] 0 exiting: rc = 1 00000100:00100000:0.0:1789518546.797517:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797539:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797548:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797559:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797568:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797578:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797585:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797596:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797602:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797609:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797637:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797644:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797650:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797656:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797661:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797666:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797672:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797677:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797682:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797687:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797693:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797699:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797705:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797710:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797716:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797722:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797727:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797740:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797746:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797751:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797757:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797762:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797768:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797773:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797779:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797790:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797800:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797809:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797817:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797823:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797828:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797833:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797839:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797844:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797850:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797855:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797860:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797866:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797871:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797876:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797883:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797890:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797898:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797905:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797913:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797921:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797929:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797937:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797943:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797949:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797956:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797964:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.797993:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.798002:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789518546.798491:0:34439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789518546.798495:0:34439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789518546.799141:0:34439:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc6b11f00 - data ffff99fff7ec4288/ffff99fec21a3800 00000020:01000000:0.0:1789518546.799552:0:34439:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc76c6c60 - data ffff99ffd97236c0/ffff99fec34eb800 00000020:00000080:0.0:1789518546.800152:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784535 00000020:00000080:0.0:1789518546.800159:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffe6222000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789518546.800857:0:34439:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffe6225800 from MGS, refs=2 00000020:01000004:0.0:1789518546.800862:0:34439:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffe6225800 2 00000020:01000004:0.0:1789518546.800865:0:34439:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffe6225800 from MGS 00000020:00000080:0.0:1789518546.800889:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518546.800891:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffe6222000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789518546.800896:0:34439:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789518546.800901:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffe6220000/MGS 00000020:00000080:0.0:1789518546.800904:0:34439:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffe6220000/MGS for MGS 00000020:01000000:0.0:1789518546.800911:0:34439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789518546.800986:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789518546.800990:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518546.800995:0:34439:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789518546.801002:0:34439:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ffed7af800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789518546.801008:0:34439:0:(genops.c:1552:class_disconnect_exports()) OBD device 10 (ffff99ffd10fcd40) has exports, disconnecting them 00000020:00080000:0.0:1789518546.801013:0:34439:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ffed7af800), last request at 1789518498 00000020:00000080:0.0:1789518546.801018:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784623 00000020:00080000:0.0:1789518546.801030:0:34439:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffed7af800): rc 0 00000020:00000080:0.0:1789518546.801034:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffed7af800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789518546.801068:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffed7af800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789518546.802713:0:34439:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789518546.802720:0:34439:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789518546.802724:0:34439:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789518546.802729:0:34439:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789518546.802870:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffed7ae000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789518546.802900:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518546.802910:0:34439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789518546.802915:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffc6494800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789518546.802919:0:34439:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc6494800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789518546.802924:0:34439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789518546.802983:0:34439:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffe6225800 1 00000020:00000080:1.0:1789518546.802988:0:34439:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784527 00000020:00000080:1.0:1789518546.802993:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffe6223000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789518546.802999:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789518546.803003:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518546.803006:0:34439:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789518546.803010:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff99ffc6514d40) has no exports 00000020:00000080:3.0:1789518546.803017:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffe6223000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789518546.817093:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789518546.817107:0:34439:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789518546.817113:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffe6224800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789518546.817118:0:34439:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffe6224800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789518546.817129:0:34439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789518546.817298:0:34439:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffe6226000 00000020:01000000:3.0:1789518546.817321:0:34439:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789518546.817325:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518546.817330:0:34439:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789518546.817334:0:34439:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff99ffc65119c0) has no exports 00000100:00100000:3.0:1789518546.817411:0:31625:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff99fffc389000:31625] 1 exiting: rc = 0 00000100:00100000:0.0:1789518546.818711:0:31626:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff99ffd844d800:31626] 2 exiting: rc = 0 00000100:00100000:0.0:1789518546.818800:0:32331:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff99fec2b59000:32331] 3 exiting: rc = 0 00000100:00100000:0.0:1789518546.821743:0:31624:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff99ffd0708e00:31624] 0 exiting: rc = 1 00000100:00100000:3.0:1789518546.821874:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821882:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821888:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821894:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821899:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821904:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821909:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821914:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821919:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821926:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821931:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821936:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821941:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821946:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821951:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821958:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821964:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821991:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.821997:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822002:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822007:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822012:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822020:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822025:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822041:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822047:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822053:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822058:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822063:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822068:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822072:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822081:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822086:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822091:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822102:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822108:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822113:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822118:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822123:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822130:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822135:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822141:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822146:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822151:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822163:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822169:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822174:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822180:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822186:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822191:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822197:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822202:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822218:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822224:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822230:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822236:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822244:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822250:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822255:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822262:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822267:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822274:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822280:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.822285:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.824741:0:31627:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99ffc652ba00:31627] 0 exiting: rc = 1 00000100:00100000:1.0:1789518546.824891:0:31628:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99ffd8126c00:31628] 1 exiting: rc = 0 00000100:00100000:3.0:1789518546.825279:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825288:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825294:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825301:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825307:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825313:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825320:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825326:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825331:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825336:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825341:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825346:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825351:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825357:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825363:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825368:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825375:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825380:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825384:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825389:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825395:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825400:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825405:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825420:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825425:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825431:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825436:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825440:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825446:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825451:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825456:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825461:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825466:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825471:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825475:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825480:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825484:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825489:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825494:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825499:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825504:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825509:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825513:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825519:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825524:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825529:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825533:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825538:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825543:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825548:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825552:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825557:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825562:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825567:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825571:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825576:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825580:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825584:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825597:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825602:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.825606:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.827697:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.827714:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.827720:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.828539:0:31630:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff99ffd8483e00:31630] 1 exiting: rc = 0 00000100:00100000:3.0:1789518546.828726:0:31629:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff99ffd844c200:31629] 0 exiting: rc = 1 00000100:00100000:3.0:1789518546.828779:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828786:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828800:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828809:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828815:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828821:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828827:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828833:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828839:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828845:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828851:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828868:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828876:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828883:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828889:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828897:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828902:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828908:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828913:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828919:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828925:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828930:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828936:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828958:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828965:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828983:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828988:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.828996:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829011:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829018:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829023:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829028:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829034:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829039:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829044:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829065:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829072:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829077:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829082:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829089:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829094:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829100:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829106:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829112:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829118:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829124:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829129:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829149:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829156:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829161:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829168:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829174:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829180:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829186:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829192:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829197:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829203:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829209:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829215:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829236:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829243:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829248:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829254:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.829267:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.836172:0:31631:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99fec2a9aa00:31631] 0 exiting: rc = 1 00000100:00100000:1.0:1789518546.836285:0:31632:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99fec2a9bc00:31632] 1 exiting: rc = 0 00000100:00100000:3.0:1789518546.836419:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836426:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836432:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836437:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836442:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836447:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836452:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836457:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836461:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836466:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836470:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836475:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836479:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836484:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836488:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836493:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836497:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836501:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836505:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836509:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836514:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836518:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836522:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836527:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836531:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836535:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836540:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836544:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836548:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836552:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836556:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836560:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836565:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836569:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836580:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836585:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836589:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836594:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836599:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836604:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836609:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836717:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836722:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836727:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836731:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836735:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836739:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836744:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836749:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836753:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836757:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836761:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836765:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836770:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836775:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836779:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836783:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836787:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836792:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836796:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836800:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836804:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836808:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.836813:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518546.837252:0:31634:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99fec2a9a000:31634] 1 exiting: rc = 0 00000100:00100000:1.0:1789518546.837368:0:31633:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99fec2a9b000:31633] 0 exiting: rc = 1 00000100:00100000:0.0:1789518546.837468:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837473:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837478:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837482:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837487:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837492:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837496:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837501:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837505:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837510:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837515:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837520:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837525:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837530:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837535:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837540:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837545:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837549:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837555:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837559:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837564:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837569:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837574:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837579:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837584:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837589:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837594:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837599:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837605:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837610:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837747:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837752:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837756:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837761:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837766:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837778:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837783:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837787:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837792:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837796:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837801:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837805:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837809:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837813:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837817:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837822:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837826:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837831:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837835:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837840:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837845:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837850:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837854:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837858:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837862:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837868:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837873:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837878:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837883:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837888:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837892:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837896:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837901:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.837906:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518546.838262:0:31635:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff99fec2a9ae00:31635] 0 exiting: rc = 1 00000100:00100000:3.0:1789518546.838343:0:31636:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff99fec2a9a800:31636] 1 exiting: rc = 0 00000100:00100000:0.0:1789518546.838447:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838453:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838458:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838463:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838468:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838472:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838487:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838492:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838496:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838501:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838506:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838511:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838515:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838520:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838525:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838530:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838535:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838540:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838545:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838550:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838555:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838559:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838564:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838568:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838573:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838577:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838581:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838585:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838590:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838594:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838599:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838604:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838609:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838698:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838704:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838709:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838715:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838720:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838724:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838729:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838734:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838746:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838751:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838756:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838761:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838765:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838769:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838774:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838779:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838783:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838787:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838793:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838797:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838802:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838807:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838811:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838816:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838821:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838825:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838833:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838840:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838845:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838851:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.838858:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518546.839457:0:31637:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff99fec26dc400:31637] 0 exiting: rc = 1 00000100:00100000:1.0:1789518546.839642:0:31639:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff99fec26dce00:31639] 2 exiting: rc = 0 00000100:00100000:3.0:1789518546.839851:0:31638:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff99fec26dd600:31638] 1 exiting: rc = 0 00000100:00100000:0.0:1789518546.840003:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840009:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840014:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840019:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840024:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840028:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840033:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840039:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840044:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840050:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840055:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840060:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840074:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840079:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840084:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840089:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840106:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840113:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840118:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840123:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840128:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840134:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840140:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840146:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840151:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840156:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840161:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840167:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840173:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840179:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840185:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840190:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840195:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840199:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840204:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840210:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840223:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840229:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840235:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840241:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840246:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840251:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840256:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840262:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840268:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840274:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840280:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840295:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840300:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840305:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840310:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840317:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840322:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840328:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840334:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840339:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840344:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840350:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840355:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840361:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840366:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840372:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840377:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518546.840383:0:34439:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789518546.844481:0:34439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518546.844494:0:34439:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789518546.844499:0:34439:0:(genops.c:885:class_export_put()) final put ffff99ffff382800/MDS_uuid 00000020:00000080:0.0:1789518546.844503:0:34439:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff382800/MDS_uuid for MDS 00000020:01000000:0.0:1789518546.844508:0:34439:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789518546.844782:0:34439:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789518547.123357:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518548.153876:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518548.630182:0:34592:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789518548.636828:0:34592:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789518548.637130:0:34592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518548.637145:0:34592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518548.637153:0:34592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518548.637178:0:34592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518548.637272:0:34592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789518548.637279:0:34592:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789518548.637302:0:34592:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518548.637306:0:34592:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789518548.637311:0:34592:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789518548.637335:0:34592:0:(import.c:65:import_set_state_nolock()) ffff99ffc76d6000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789518548.637397:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627620864:0@lo:39:umount.0 00000400:00000100:3.0:1789518548.637455:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627620864 offset 0 length 224: 4 00010000:00010000:2.0:1789518548.637803:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518548.637810:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518548.637818:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff5b45a00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518548.637822:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518548.637831:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518548.637837:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518548.637843:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518548.637845:0:32583:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789518548.637848:0:32583:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789518548.637872:0:32583:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518548.637878:0:32583:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518548.637895:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518548.637914:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fff5b45a00/0x631fd8698c7846a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x631fd8698c7846af expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518548.637924:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518548.637926:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518548.637928:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518548.637939:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627620992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518548.637987:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518548.638029:0:31609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627620992 00000100:00100000:2.0:1789518548.638036:0:31609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627620992 00000100:00100000:2.0:1789518548.638082:0:31609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518548.638089:0:31609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1876445627620992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789518548.638095:0:31609:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789518548 with bad export cookie 7142665481872753994 00000100:00100000:2.0:1789518548.644784:0:31609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1876445627620992:12345-0@lo:103:ldlm_bl.0 Request processed in 6687us (6789us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789518548.644797:0:31609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789518548.645208:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789518548.645213:0:3283:0:(import.c:65:import_set_state_nolock()) ffff99ffff380000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789518548.645217:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789518548.654033:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789518548.654037:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789518548.654046:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffc6388000 x1876445627620992/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789518564 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789518548.654058:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789518548.654060:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789518548.654061:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789518548.654063:0:3283:0:(import.c:65:import_set_state_nolock()) ffff99ffff380000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789518548.654067:0:3283:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 551 00000100:00080000:0.0:1789518548.654079:0:3283:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99ffff380000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518548.654105:0:3283:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff78a9500 x1876445627621120/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518548.654137:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f013254-1301-45d1-9493-6d558799b39e:3283:1876445627620992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518548.654207:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f013254-1301-45d1-9493-6d558799b39e:3279:1876445627621120:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1789518548.654250:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627621120 offset 0 length 520: 4 00010000:00010000:0.0:1789518549.170900:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518549.618795:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789518549.618804:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789518549.619011:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518549.619030:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627621248:0@lo:400:kworker.0 00000400:00000100:3.0:1789518549.619078:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627621248 offset 0 length 224: 4 00010000:00010000:1.0:1789518550.194832:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518551.222574:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518552.242989:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518553.266879:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518553.650733:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789518553.650742:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789518553.651055:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627621376:0@lo:400:kworker.0 00000400:00000100:3.0:1789518553.651104:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627621376 offset 0 length 224: 4 00010000:00010000:2.0:1789518554.290895:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518555.316246:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518556.338934:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518557.365153:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518558.390130:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518558.834722:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789518558.834732:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789518558.834750:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518548/real 1789518548] req@ffff99fff78a9500 x1876445627621120/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518558 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518558.834778:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fff78a9500 x1876445627621120/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789518558 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518558.834788:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518548/real 1789518548] req@ffff99fff78a8e00 x1876445627620864/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518558 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518558.834798:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fff78a8e00 x1876445627620864/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518558 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789518558.834813:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffff380000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789518558.834824:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789518558.834828:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f013254-1301-45d1-9493-6d558799b39e:3279:1876445627621120:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1789518558.834834:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffc76d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789518558.834836:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789518558.834839:0:19561:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00100000:3.0:1789518558.834842:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627620864:0@lo:39:umount.0 00000100:00080000:1.0:1789518558.834842:0:19561:0:(import.c:65:import_set_state_nolock()) ffff99ffff380000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518558.834846:0:19561:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 602 00000100:00080000:1.0:1789518558.834851:0:19561:0:(import.c:630:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789518558.834860:0:19561:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99ffff380000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518558.834928:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627621504:0@lo:400:kworker.0 00000100:00080000:0.0:1789518558.834949:0:34592:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518558.834954:0:34592:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789518558.834959:0:34592:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000400:00000100:2.0:1789518558.835077:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627621504 offset 0 length 224: 4 00000100:00100000:1.0:1789518558.835281:0:19561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff7a7b480 x1876445627621632/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789518558.835330:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f013254-1301-45d1-9493-6d558799b39e:3279:1876445627621632:0@lo:250:kworker.0 00000400:00000100:3.0:1789518558.835360:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876445627621632 offset 0 length 520: 4 00010000:00010000:0.0:1789518558.837852:0:34592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518558.837870:0:34592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518558.837878:0:34592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518558.837884:0:34592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518558.837971:0:34592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518558.837988:0:34592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518558.837996:0:34592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518558.838002:0:34592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518558.838008:0:34592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518558.838133:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518558.838141:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518558.838149:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518558.838152:0:31613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518558.838160:0:31613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518558.838167:0:31613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518558.838173:0:31613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789518558.838175:0:31613:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1789518558.838185:0:31613:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffff380000 00010000:00010000:1.0:1789518558.838196:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518558.838203:0:31613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16200/0x631fd8698c78467e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784685 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518558.838217:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518558.838220:0:31613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518558.838226:0:31613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4980200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518558.838229:0:31613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518558.838235:0:31613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518558.838242:0:31613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518558.838247:0:31613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789518558.838249:0:31613:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789518558.838253:0:31613:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffff380000 00010000:00010000:1.0:1789518558.838256:0:31613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518558.838263:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518558.838264:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518558.838266:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518558.838313:0:34592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789518558.838319:0:34592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c784b16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784b1d expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518558.838329:0:34592:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789518558.838333:0:34592:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1789518558.838336:0:34592:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789518558.838354:0:34592:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789518558.838359:0:34592:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789518558.838363:0:34592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518558.838368:0:34592:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789518558.838372:0:34592:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99fff4204d40) has no exports 00000020:00080000:0.0:1789518558.838393:0:34592:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99fff4204d40) has no exports 00010000:00010000:2.0:1789518558.838821:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789518558.844179:0:34592:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffc6b11480 - data ffff9a0000956000/ffff99fec21a2400 00000020:01000000:1.0:1789518558.844331:0:34592:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffe6e64840 - data ffff99ffd782d948/ffff99fec1b92000 00100000:10000000:1.0:1789518558.856361:0:34592:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789518558.876733:0:34592:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784693 00000020:00000080:0.0:1789518558.876741:0:34592:0:(genops.c:885:class_export_put()) final put ffff99fff4010000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789518558.876754:0:34592:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffd1031000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789518558.876757:0:34592:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffd1031000 2 00000020:01000004:0.0:1789518558.876760:0:34592:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffd1031000 from lustre-OST0000 00000020:00000080:0.0:1789518558.876779:0:34592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789518558.876786:0:34592:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789518558.876789:0:34592:0:(genops.c:885:class_export_put()) final put ffff99ffc5114800/lustre-OST0000_UUID 00000020:00000080:0.0:1789518558.876791:0:34592:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc5114800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789518558.876796:0:34592:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789518558.876827:0:34592:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789518558.876831:0:34592:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789518558.876833:0:34592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789518558.876837:0:34592:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789518558.876843:0:34592:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99ffff796800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789518558.876847:0:34592:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff99fff78399c0) has exports, disconnecting them 00000020:00080000:0.0:1789518558.876851:0:34592:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99ffff796800), last request at 1789518505 00000020:00000080:0.0:1789518558.876864:0:34592:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7846bd 00000020:00080000:0.0:1789518558.876871:0:34592:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffff796800): rc 0 00000020:00000080:0.0:1789518558.876874:0:34592:0:(genops.c:885:class_export_put()) final put ffff99ffff796800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789518558.877069:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff4010000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789518558.877081:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff796800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789518558.880775:0:34592:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789518558.880783:0:34592:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789518558.880797:0:34592:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789518558.880817:0:34592:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789518558.881055:0:34592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518558.881064:0:34592:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789518558.881070:0:34592:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffd1031000 1 00000020:00000080:2.0:1789518558.881077:0:34592:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784662 00000020:00000080:2.0:1789518558.881084:0:34592:0:(genops.c:885:class_export_put()) final put ffff99fff7b5e800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789518558.882181:0:19561:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffc76d6000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789518558.882191:0:19561:0:(genops.c:885:class_export_put()) final put ffff99ffff793000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789518558.882194:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff793000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789518558.882205:0:19561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789518558.882349:0:34592:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789518558.882371:0:34592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518558.882379:0:34592:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789518558.882383:0:34592:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99ffee0619c0) has no exports 00000020:00000080:3.0:1789518558.882457:0:19561:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff7b5e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789518558.904895:0:34592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518558.904917:0:34592:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789518558.904922:0:34592:0:(genops.c:885:class_export_put()) final put ffff99ffd1034800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789518558.904926:0:34592:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd1034800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789518558.904936:0:34592:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789518558.905058:0:34592:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffd1036000 00000020:02000400:2.0:1789518558.905199:0:34592:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789518559.411839:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518560.434992:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518560.618426:0:34745:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789518560.628826:0:34745:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789518560.628934:0:34745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518560.628958:0:34745:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518560.628969:0:34745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518560.628975:0:34745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518560.629058:0:34745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789518560.629063:0:34745:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789518560.629092:0:34745:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1789518560.629204:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518560.629212:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518560.629223:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981200 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518560.629229:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518560.629241:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518560.629252:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518560.629281:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518560.629283:0:32583:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789518560.629285:0:32583:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789518560.629303:0:32583:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffff380000 00010000:00010000:2.0:1789518560.629310:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518560.629316:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c7847f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7847ff expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518560.629330:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518560.629331:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518560.629336:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518560.629393:0:34745:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff7a78700 x1876445627621248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518560.631684:0:34745:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff7a7b100 x1876445627621376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518569 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518560.631693:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627621248:0@lo:400:kworker.0 00000100:00100000:0.0:1789518560.631703:0:34745:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff7a79c00 x1876445627621504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518574 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518560.631718:0:34745:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1789518560.631755:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627621376:0@lo:400:kworker.0 00000100:00080000:3.0:1789518560.631776:0:34745:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789518560.631802:0:34745:0:(import.c:65:import_set_state_nolock()) ffff99fec3ad8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789518560.631893:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627621760:0@lo:39:umount.0 00000400:00000100:0.0:1789518560.631951:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876445627621760 offset 0 length 224: 4 00000100:00100000:2.0:1789518560.632317:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627621504:0@lo:400:kworker.0 00010000:00010000:1.0:1789518561.458988:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518562.482906:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518563.506813:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789518563.955638:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789518563.955647:0:19561:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789518564.533279:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518565.555037:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518566.579856:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518567.602922:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518568.627634:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789518569.074789:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789518569.074798:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6f013254-1301-45d1-9493-6d558799b39e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789518569.651017:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518570.675123:0:31612:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518570.802812:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518560/real 1789518560] req@ffff99ffed745180 x1876445627621760/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518570 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518570.802866:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffed745180 x1876445627621760/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789518570 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789518570.802890:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec3ad8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789518570.802915:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627621760:0@lo:39:umount.0 00000100:00080000:3.0:1789518570.803675:0:34745:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789518570.803682:0:34745:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789518570.803688:0:34745:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789518570.805777:0:34745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518570.805798:0:34745:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518570.805805:0:34745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518570.805812:0:34745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518570.805874:0:34745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518570.805882:0:34745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518570.805890:0:34745:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518570.805896:0:34745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518570.805902:0:34745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518570.805919:0:34745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789518570.805925:0:34745:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789518570.805949:0:34745:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789518570.805955:0:34745:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789518570.805962:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789518570.805969:0:34745:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789518570.805975:0:34745:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff99fff783cd40) has no exports 00010000:00010000:2.0:1789518570.805990:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518570.806004:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789518570.806008:0:34745:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff99fff783cd40) has no exports 00010000:00010000:2.0:1789518570.806020:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518570.806024:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518570.806031:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518570.806036:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518570.806057:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518570.806059:0:32583:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789518570.806061:0:32583:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789518570.806077:0:32583:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffff380000 00010000:00010000:2.0:1789518570.806079:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518570.806083:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17800/0x631fd8698c7847ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c7847d5 expref: -99 pid: 33025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518570.806095:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518570.806097:0:32583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518570.806100:0:32583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518570.806102:0:32583:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518570.806107:0:32583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518570.806110:0:32583:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518570.806113:0:32583:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789518570.806114:0:32583:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789518570.806115:0:32583:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789518570.806118:0:32583:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffff380000 00010000:00010000:2.0:1789518570.806120:0:32583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518570.806127:0:32583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b16000/0x631fd8698c784b08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784b0f expref: -99 pid: 31621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518570.806138:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518570.806139:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518570.806140:0:32583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518570.806712:0:31613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789518570.808157:0:34745:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99ffd07fca80 - data ffff99fff7d52798/ffff99fec38aa000 00000020:01000000:3.0:1789518570.808355:0:34745:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99fec2186c00 - data ffff99fff7f02000/ffff99fec494fc00 00100000:10000000:3.0:1789518570.822139:0:34745:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789518570.839472:0:34745:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7847e3 00000020:00000080:2.0:1789518570.839493:0:34745:0:(genops.c:885:class_export_put()) final put ffff99fec4895800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789518570.839513:0:34745:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc5112000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789518570.839517:0:34745:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc5112000 2 00000020:01000004:2.0:1789518570.839521:0:34745:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffc5112000 from lustre-OST0001 00000020:00000080:2.0:1789518570.839550:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518570.839565:0:34745:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789518570.839569:0:34745:0:(genops.c:885:class_export_put()) final put ffff99ffd9258800/lustre-OST0001_UUID 00000020:00000080:2.0:1789518570.839572:0:34745:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffd9258800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789518570.839580:0:34745:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789518570.839734:0:34745:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6f013254-1301-45d1-9493-6d558799b39e->MGS 00010000:00010000:2.0:1789518570.839754:0:34745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c784677 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518570.839768:0:34745:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c784677 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518570.839775:0:34745:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789518570.839778:0:34745:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789518570.839782:0:34745:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789518570.839799:0:34745:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffff380000 00010000:00010000:2.0:1789518570.839803:0:34745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc6b17600/0x631fd8698c784670 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c784677 expref: -99 pid: 32305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518570.839838:0:34745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518570.839845:0:34745:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518570.839862:0:34745:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789518570.839864:0:34745:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789518570.839866:0:34745:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789518570.839877:0:34745:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffff380000 00010000:00010000:2.0:1789518570.839880:0:34745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c784558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x631fd8698c78455f expref: -99 pid: 31606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518570.839902:0:34745:0:(import.c:65:import_set_state_nolock()) ffff99ffff380000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789518570.839906:0:34745:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789518570.839909:0:34745:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789518570.839911:0:34745:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789518570.839916:0:34745:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789518570.839930:0:34745:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fff7a7b480 x1876445627621632/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789518573 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789518570.839964:0:34745:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789518570.839967:0:34745:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000020:00000080:0.0:1789518570.840038:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec4895800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1789518570.840135:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f013254-1301-45d1-9493-6d558799b39e:3279:1876445627621632:0@lo:250:kworker.0 10000000:01000000:2.0:1789518570.840209:0:34745:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789518570.840217:0:34745:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c784543 00000020:00000080:2.0:1789518570.840222:0:34745:0:(genops.c:885:class_export_put()) final put ffff99ffff386800/6f013254-1301-45d1-9493-6d558799b39e 00000020:01000000:2.0:1789518570.840237:0:34745:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.151@tcp (flags='') 00000020:00000080:2.0:1789518570.840242:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518570.840248:0:34745:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789518570.840252:0:34745:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff99ffc6510000) has no exports 00000020:00000080:0.0:1789518570.840302:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff386800/6f013254-1301-45d1-9493-6d558799b39e for MGC192.168.206.151@tcp 10000000:01000000:1.0:1789518570.840350:0:31621:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789518570.840427:0:34745:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.151@tcp: client import never connected 00000100:00080000:2.0:1789518570.840435:0:34745:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789518570.840438:0:34745:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789518570.840439:0:34745:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789518570.840442:0:34745:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789518570.840483:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518570.840488:0:34745:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.151@tcp (uuid 6f013254-1301-45d1-9493-6d558799b39e) 00000020:01000000:2.0:1789518570.840494:0:34745:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789518570.840497:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518570.840501:0:34745:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789518570.840506:0:34745:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99fec3adb000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789518570.840511:0:34745:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff99fff4203380) has exports, disconnecting them 00000020:00080000:2.0:1789518570.840515:0:34745:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99fec3adb000), last request at 1789518513 00000020:00000080:2.0:1789518570.840519:0:34745:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c78480d 00000020:00080000:2.0:1789518570.840530:0:34745:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fec3adb000): rc 0 00000020:00000080:2.0:1789518570.840534:0:34745:0:(genops.c:885:class_export_put()) final put ffff99fec3adb000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789518570.841328:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffff380000 for MGC192.168.206.151@tcp 00000020:00000080:0.0:1789518570.841338:0:8:0:(genops.c:885:class_export_put()) final put ffff99ffff384800/6f013254-1301-45d1-9493-6d558799b39e 00000020:00000080:0.0:1789518570.841341:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffff384800/6f013254-1301-45d1-9493-6d558799b39e for MGC192.168.206.151@tcp 00000020:01000000:0.0:1789518570.841346:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.151@tcp (6f013254-1301-45d1-9493-6d558799b39e) 00000020:00000080:0.0:1789518570.841593:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec3adb000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789518570.843749:0:34745:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789518570.843759:0:34745:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789518570.843764:0:34745:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789518570.843773:0:34745:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789518570.843893:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec3ad8800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789518570.844000:0:31612:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789518570.844200:0:32583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789518570.844329:0:31613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789518570.844467:0:31608:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99fec1cdce00:31608] 1 exiting: rc = 0 00000100:00100000:1.0:1789518570.844545:0:31607:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99fec1cdcc00:31607] 0 exiting: rc = 1 00000100:00100000:0.0:1789518570.844694:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.845192:0:34440:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff99fec483e400:34440] 4 exiting: rc = 0 00000100:00100000:3.0:1789518570.845332:0:31611:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99fec2420800:31611] 2 exiting: rc = 0 00000100:00100000:3.0:1789518570.845397:0:33738:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99ffff24ee00:33738] 3 exiting: rc = 0 00000100:00100000:0.0:1789518570.847754:0:31610:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99fec2420e00:31610] 1 exiting: rc = 0 00000100:00100000:0.0:1789518570.847891:0:31609:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99fec1cdc000:31609] 0 exiting: rc = 1 00000100:00100000:1.0:1789518570.848002:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848012:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848019:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848027:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848034:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848041:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848048:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848055:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848064:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848070:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848076:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848083:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848102:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848107:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848113:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848118:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848124:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848129:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848135:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848141:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848146:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848152:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848157:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848163:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848169:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848175:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848180:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848186:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848192:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848197:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848202:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848208:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848213:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848219:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848226:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848232:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848238:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848244:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848249:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848255:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848261:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848267:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848273:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848279:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848284:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848290:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848295:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848307:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848313:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848318:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848324:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848330:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848336:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848341:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848347:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848352:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848357:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848363:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848368:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848374:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848380:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848386:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848392:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.848398:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789518570.849123:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789518570.849139:0:34745:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789518570.849145:0:34745:0:(genops.c:885:class_export_put()) final put ffff99ffffbf2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789518570.849150:0:34745:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffffbf2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789518570.849156:0:34745:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789518570.849203:0:34745:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc5112000 1 00000020:00000080:1.0:1789518570.849210:0:34745:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7847c7 00000020:00000080:1.0:1789518570.849218:0:34745:0:(genops.c:885:class_export_put()) final put ffff99ffc84df000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789518570.849234:0:34745:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789518570.849240:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789518570.849246:0:34745:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789518570.849250:0:34745:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99ffd10fb380) has no exports 00000020:00000080:0.0:1789518570.849253:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc84df000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789518570.862475:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518570.863318:0:34745:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789518570.863326:0:34745:0:(genops.c:885:class_export_put()) final put ffff99ffc84d8000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789518570.863332:0:34745:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffc84d8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789518570.863343:0:34745:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789518570.863545:0:34745:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffc84dc000 00000020:01000000:2.0:1789518570.863572:0:34745:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789518570.863578:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789518570.863583:0:34745:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789518570.863588:0:34745:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff99fff4200000) has no exports 00000020:00000080:2.0:1789518570.863631:0:34745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789518570.863639:0:34745:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789518570.863642:0:34745:0:(genops.c:885:class_export_put()) final put ffff99fff7b5f000/OSS_uuid 00000020:00000080:2.0:1789518570.863645:0:34745:0:(genops.c:844:class_export_destroy()) destroying export ffff99fff7b5f000/OSS_uuid for OSS 00000020:01000000:2.0:1789518570.863649:0:34745:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789518570.863693:0:31620:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789518570.863740:0:32308:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff99fec3ab2800:32308] 1 exiting: rc = 0 00000100:00100000:0.0:1789518570.864023:0:33813:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff99ffc5628800:33813] 4 exiting: rc = 0 00000100:00100000:1.0:1789518570.864487:0:32579:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff99fec2b59600:32579] 3 exiting: rc = 0 00000100:00100000:2.0:1789518570.864555:0:32306:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff99fff7823800:32306] 0 exiting: rc = 1 00000100:00100000:2.0:1789518570.864669:0:32309:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff99fff7823200:32309] 2 exiting: rc = 0 00000100:00100000:1.0:1789518570.864730:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864742:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864757:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864772:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864780:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864787:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864795:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864805:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864813:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864821:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864829:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864836:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864843:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864862:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864871:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864881:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864889:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864898:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864906:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864913:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864921:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864928:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864936:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864945:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864954:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864963:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864970:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864978:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864987:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.864995:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865003:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865012:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865021:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865031:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865042:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865057:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865064:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865075:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865083:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865093:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865101:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865111:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865119:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865128:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865138:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865146:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865154:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865162:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865172:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865183:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865194:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865205:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865214:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865223:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865245:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865257:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865271:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865284:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865291:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865301:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865312:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865321:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865328:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.865346:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.866767:0:33754:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99ffc739fc00:33754] 2 exiting: rc = 0 00000100:00100000:2.0:1789518570.867725:0:32310:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99fec3ab3600:32310] 0 exiting: rc = 1 00000100:00100000:2.0:1789518570.867801:0:32311:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99ffff785800:32311] 1 exiting: rc = 0 00000100:00100000:3.0:1789518570.867895:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867905:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867929:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867935:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867941:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867947:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867953:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867959:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867965:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867971:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867976:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867982:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867988:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.867996:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868002:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868009:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868014:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868020:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868026:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868032:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868038:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868044:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868050:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868056:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868061:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868067:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868073:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868078:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868084:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868091:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868096:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868102:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868107:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868113:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868119:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868125:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868131:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868145:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868150:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868156:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868162:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868168:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868175:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868184:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868191:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868196:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868202:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868207:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868212:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868218:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868224:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868230:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868235:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868241:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868247:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868252:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868258:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868264:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868271:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868281:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868287:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868293:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868298:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.868305:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.869678:0:32313:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99ffff784400:32313] 1 exiting: rc = 0 00000100:00100000:2.0:1789518570.869703:0:32314:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99ffff784a00:32314] 2 exiting: rc = 0 00000100:00100000:0.0:1789518570.869715:0:32312:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99ffff785c00:32312] 0 exiting: rc = 1 00000100:00100000:3.0:1789518570.869766:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869781:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869794:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869801:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869816:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869825:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869831:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869842:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869875:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869881:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869887:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869893:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869899:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869906:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869912:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869917:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869924:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869930:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869936:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869941:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869948:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869965:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869971:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869977:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869983:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869989:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.869995:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870001:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870007:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870012:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870018:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870024:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870030:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870035:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870041:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870047:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870053:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870058:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870063:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870069:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870074:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870080:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870086:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870097:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870103:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870119:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870126:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870131:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870137:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870144:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870150:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870155:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870161:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870167:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870178:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870184:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870190:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870196:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870201:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870207:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870214:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870219:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870225:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.870231:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789518570.875081:0:32316:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99ffff785400:32316] 1 exiting: rc = 0 00000100:00100000:1.0:1789518570.875081:0:32315:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99ffff785000:32315] 0 exiting: rc = 1 00000100:00100000:2.0:1789518570.875160:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875170:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875176:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875185:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875194:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875203:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875214:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875226:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875242:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875250:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875259:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875268:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875273:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875279:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875285:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875291:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875296:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875313:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875320:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875325:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875331:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875336:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875341:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875347:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875354:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875359:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875364:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875369:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875389:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875409:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875414:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875419:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875425:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875441:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875448:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875454:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875460:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875466:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875471:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875476:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875482:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875489:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875494:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875500:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875506:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875512:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875517:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875522:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875529:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875535:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875541:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875547:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875553:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875560:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875566:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875572:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875577:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875582:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875587:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875593:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875597:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875601:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875606:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789518570.875696:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789518570.876982:0:32317:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99ffc6ad3c00:32317] 0 exiting: rc = 1 00000100:00100000:2.0:1789518570.877020:0:32318:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99ffc6ad2200:32318] 1 exiting: rc = 0 00000100:00100000:0.0:1789518570.877131:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877140:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877148:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877166:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877174:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877180:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877187:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877194:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877201:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877208:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877213:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877219:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877225:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877231:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877236:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877260:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877268:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877274:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877281:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877288:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877294:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877299:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877305:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877311:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877317:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877322:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877328:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877350:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877357:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877364:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877370:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877376:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877392:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877398:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877404:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877410:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877416:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877423:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877429:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877450:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877458:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877465:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877471:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877477:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877484:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877490:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877497:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877503:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877509:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877515:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877522:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877543:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877551:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877557:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877566:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877573:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877581:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877589:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877595:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877602:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877673:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877681:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877689:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789518570.877698:0:34745:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789518570.884799:0:34745:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789518579.915310:0:35365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789518584.615583:0:35827:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789518584.615588:0:35827:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789518584.615866:0:35827:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99fff4010800 00000020:01000004:0.0:1789518584.615889:0:35827:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789518584.615897:0:35827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789518584.615911:0:35827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99ffd10f99c0) 00000020:00000080:0.0:1789518584.615923:0:35827:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789518584.628044:0:35827:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789518584.629712:0:35827:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3a:0x0] (8/32) 00100000:10000000:0.0:1789518584.630096:0:35827:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789518584.630138:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:0.0:1789518584.630260:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:0.0:1789518584.630354:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1789518584.630451:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:0.0:1789518584.630547:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:0.0:1789518584.630788:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1789518584.631044:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:0.0:1789518584.632038:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 390: rc = 0 00100000:10000000:0.0:1789518584.632140:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 390: rc = 0 00100000:10000000:0.0:1789518584.632639:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 398: rc = 0 00100000:10000000:0.0:1789518584.632893:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 398: rc = 0 00100000:10000000:0.0:1789518584.633136:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 398: rc = 0 00100000:10000000:0.0:1789518584.633373:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 398: rc = 0 00100000:10000000:0.0:1789518584.633724:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 398: rc = 0 00100000:10000000:0.0:1789518584.633982:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 398: rc = 0 00100000:10000000:0.0:1789518584.634224:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 398: rc = 0 00100000:10000000:0.0:1789518584.634461:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 398: rc = 0 00100000:10000000:0.0:1789518584.634959:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 398: rc = 0 00100000:10000000:0.0:1789518584.635201:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 398: rc = 0 00100000:10000000:0.0:1789518584.635459:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 398: rc = 0 00100000:10000000:0.0:1789518584.635771:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 398: rc = 0 00100000:10000000:0.0:1789518584.636175:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 166: rc = 0 00100000:10000000:0.0:1789518584.636431:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 166: rc = 0 00100000:10000000:0.0:1789518584.636697:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 166: rc = 0 00100000:10000000:0.0:1789518584.637023:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 166: rc = 0 00100000:10000000:0.0:1789518584.637255:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 166: rc = 0 00100000:10000000:0.0:1789518584.637747:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 166: rc = 0 00100000:10000000:0.0:1789518584.638006:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 166: rc = 0 00100000:10000000:0.0:1789518584.638245:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 166: rc = 0 00100000:10000000:0.0:1789518584.638481:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 166: rc = 0 00100000:10000000:0.0:1789518584.638867:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 166: rc = 0 00100000:10000000:0.0:1789518584.639114:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 166: rc = 0 00100000:10000000:0.0:1789518584.639351:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 166: rc = 0 00100000:10000000:0.0:1789518584.639595:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 166: rc = 0 00100000:10000000:1.0:1789518584.640081:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 166: rc = 0 00100000:10000000:1.0:1789518584.640315:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 166: rc = 0 00100000:10000000:1.0:1789518584.640881:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 166: rc = 0 00100000:10000000:1.0:1789518584.641131:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 166: rc = 0 00100000:10000000:1.0:1789518584.641374:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 166: rc = 0 00100000:10000000:1.0:1789518584.641602:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 166: rc = 0 00100000:10000000:1.0:1789518584.641984:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 166: rc = 0 00100000:10000000:1.0:1789518584.642233:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 166: rc = 0 00100000:10000000:1.0:1789518584.642471:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 166: rc = 0 00100000:10000000:1.0:1789518584.642853:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 166: rc = 0 00100000:10000000:1.0:1789518584.643096:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 166: rc = 0 00100000:10000000:1.0:1789518584.643340:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 166: rc = 0 00100000:10000000:1.0:1789518584.643571:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 166: rc = 0 00100000:10000000:1.0:1789518584.643961:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 166: rc = 0 00100000:10000000:1.0:1789518584.644188:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 166: rc = 0 00100000:10000000:1.0:1789518584.644431:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 166: rc = 0 00100000:10000000:1.0:1789518584.644862:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 166: rc = 0 00100000:10000000:1.0:1789518584.645098:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 166: rc = 0 00100000:10000000:1.0:1789518584.645334:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 166: rc = 0 00100000:10000000:1.0:1789518584.645826:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 155: rc = 0 00100000:10000000:1.0:1789518584.646308:0:35827:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1789518584.646464:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 391: rc = 0 00100000:10000000:1.0:1789518584.646801:0:35827:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1789518584.646873:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 391: rc = 0 00100000:10000000:1.0:1789518584.647052:0:35827:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1789518584.647115:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 391: rc = 0 00100000:10000000:1.0:1789518584.647438:0:35827:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1789518584.647481:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 395: rc = 0 00100000:10000000:1.0:1789518584.647608:0:35827:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1789518584.647753:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 395: rc = 0 00100000:10000000:1.0:1789518584.647937:0:35827:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1789518584.648002:0:35827:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 395: rc = 0 00000020:00000080:1.0:1789518584.648248:0:35827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789518584.648255:0:35827:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789518584.648265:0:35827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c78516e 00000020:01000004:1.0:1789518584.648271:0:35827:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789518584.648275:0:35827:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789518584.648280:0:35827:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99fff4010800 from MGS 00000020:01000004:1.0:1789518584.648284:0:35827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789518584.648292:0:35827:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99ffee063380) 00000020:00000080:1.0:1789518584.648302:0:35827:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789518584.648346:0:35827:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fff4010800 from MGS, refs=2 00080000:01000000:1.0:1789518584.648350:0:35827:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789518584.648354:0:35827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c78517c 00000100:00100000:1.0:1789518584.648442:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789518584.648569:0:35827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789518584.648575:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789518584.649158:0:35827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789518584.649164:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789518584.649893:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518584.650033:0:35827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789518584.650038:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789518584.650422:0:35827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789518584.650428:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789518584.650596:0:35827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789518584.650601:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789518584.651078:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518584.651081:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518584.651083:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518584.651202:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518584.651204:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518584.651206:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518584.651484:0:35827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789518584.652976:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789518584.659831:0:35827:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789518584.659843:0:35827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789518584.659845:0:35827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789518584.661828:0:35836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789518584.661990:0:35827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789518584.662088:0:35827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789518584.662512:0:35827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789518584.662833:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518584.662993:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789518584.662999:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789518584.665739:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789518584.665752:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789518584.666187:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789518584.666193:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789518584.666932:0:35827:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789518584.666949:0:35827:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.151@tcp' 00000020:01000004:3.0:1789518584.666950:0:35827:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789518584.666977:0:35827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.151@tcp (typ=mgc) 00000020:00000080:3.0:1789518584.666989:0:35827:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.151@tcp (ffff99fff42019c0) 00000020:00000080:3.0:1789518584.667002:0:35827:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789518584.667064:0:35827:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffff2c8800@MGC192.168.206.151@tcp: add connection 192.168.206.151@tcp at head 00000100:00080000:2.0:1789518584.667340:0:35841:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1789518584.667432:0:35827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.151@tcp-0 is initialized 00000040:01000000:3.0:1789518584.667438:0:35827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789518584.669508:0:35842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789518584.669591:0:35827:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.151@tcp (uuid 3d183546-773a-47ec-8f5a-25077d1135e5) 00000020:00000080:1.0:1789518584.669628:0:35827:0:(genops.c:1384:class_connect()) connect: client 3d183546-773a-47ec-8f5a-25077d1135e5, cookie 0x631fd8698c78518a 00000100:00080000:1.0:1789518584.669639:0:35827:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789518584.669650:0:35827:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff99ffff2c8800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518584.669681:0:35827:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff7a7a680 x1876445627621888/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789518584.669710:0:35827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3d183546-773a-47ec-8f5a-25077d1135e5->MGS 00000020:01000004:1.0:1789518584.669732:0:35827:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789518584.669737:0:35827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789518584.669749:0:35827:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99ffee060000) 00000020:00000080:1.0:1789518584.669760:0:35827:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789518584.671672:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d183546-773a-47ec-8f5a-25077d1135e5:3279:1876445627621888:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789518584.671740:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518584.671933:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627621888 00000100:00100000:0.0:1789518584.671940:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627621888 00000100:00100000:0.0:1789518584.671973:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518584.671980:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3279:x1876445627621888:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789518584.672004:0:35839:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 3d183546-773a-47ec-8f5a-25077d1135e5@0@lo t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:0.0:1789518584.672028:0:35839:0:(genops.c:1384:class_connect()) connect: client 3d183546-773a-47ec-8f5a-25077d1135e5, cookie 0x631fd8698c785198 00000100:00080000:0.0:1789518584.672142:0:35839:0:(import.c:65:import_set_state_nolock()) ffff99ffe619e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518584.672191:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+5:3279:x1876445627621888:12345-0@lo:250:mount.lustre.0 Request processed in 209us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518584.672198:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518584.672245:0:3279:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789518584.672254:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1789518584.672260:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789518584.672264:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789518584.672267:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffff2c8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789518584.672270:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789518584.672277:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789518584.672282:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d183546-773a-47ec-8f5a-25077d1135e5:3279:1876445627621888:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789518584.676751:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518584.676990:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789518584.676996:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789518584.677695:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789518584.677702:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789518584.679332:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789518584.679342:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789518584.680061:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518584.680201:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789518584.680206:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789518584.680797:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789518584.680804:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789518584.708286:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518584.708477:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789518584.708485:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789518584.709398:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789518584.709407:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789518584.710016:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518584.710167:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789518584.710172:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789518584.711503:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789518584.711527:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789518584.714518:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518584.714876:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789518584.714883:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789518584.715434:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789518584.715441:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789518584.716598:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518584.716840:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789518584.716846:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789518584.718179:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789518584.718188:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789518584.736509:0:35827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789518584.736738:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789518584.736744:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789518584.738888:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789518584.738899:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789518584.739737:0:35827:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789518584.739861:0:35827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789518584.740493:0:35827:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789518584.740513:0:35827:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789518584.740519:0:35827:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789518584.740737:0:35827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789518584.740769:0:35827:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789518584.740774:0:35827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789518584.740776:0:35827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518584.740791:0:35827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518584.740793:0:35827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518584.740794:0:35827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518584.740795:0:35827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518584.740796:0:35827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518584.740798:0:35827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518584.740800:0:35827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518584.740801:0:35827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518584.740803:0:35827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789518584.740806:0:35827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518584.740807:0:35827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518584.740808:0:35827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518584.740809:0:35827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518584.740810:0:35827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518584.740810:0:35827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518584.740811:0:35827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518584.740812:0:35827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518584.740813:0:35827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518584.740814:0:35827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789518584.740840:0:35827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789518584.740859:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518584.740934:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518584.741027:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.741077:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627622016 00000100:00100000:2.0:1789518584.741084:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627622016 00000100:00100000:2.0:1789518584.741161:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518584.741170:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+5:35827:x1876445627622016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789518584.741215:0:35840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789518584.741218:0:35840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789518584.741221:0:35840:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789518584.741561:0:35861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789518584.742046:0:35840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 20 20000000:01000000:0.0:1789518584.743106:0:35862:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789518584.743113:0:35862:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789518584.743115:0:35862:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789518584.743152:0:35862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789518584.743423:0:35840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789518584.743433:0:35840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789518584.750440:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+5:35827:x1876445627622016:12345-0@lo:253:mount.lustre.0 Request processed in 9265us (9500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.750451:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518584.750535:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789518584.750546:0:35827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789518584.750548:0:35827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789518584.750549:0:35827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789518584.750550:0:35827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518584.750551:0:35827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518584.750552:0:35827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518584.750553:0:35827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518584.750554:0:35827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789518584.750555:0:35827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789518584.750556:0:35827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518584.750556:0:35827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789518584.750571:0:35827:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99fff4010800 from lustre-MDT0000 10000000:01000000:1.0:1789518584.750758:0:35827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789518584.750772:0:35827:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789518584.750777:0:35827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99fff42019c0 10000000:01000000:1.0:1789518584.750795:0:35827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518584.750804:0:35827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99fff42019c0 from 1 10000000:01000000:1.0:1789518584.750807:0:35827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789518584.750842:0:35827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.750853:0:35827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.750863:0:35827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518584.750880:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518584.750917:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518584.750985:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518584.750987:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627622144 00000100:00100000:0.0:1789518584.750992:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627622144 00000100:00100000:0.0:1789518584.751039:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518584.751047:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+5:35827:x1876445627622144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518584.751060:0:35837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518584.751074:0:35837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd600/0x631fd8698c7851a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78519f expref: -99 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.751091:0:35837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd600/0x631fd8698c7851a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78519f expref: 6 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.751102:0:35837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd600/0x631fd8698c7851a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78519f expref: 6 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.751108:0:35837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd600, rc 0) 00000100:00100000:0.0:1789518584.751137:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+6:35827:x1876445627622144:12345-0@lo:101:mount.lustre.0 Request processed in 91us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518584.751144:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518584.751165:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518584.751178:0:35827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.751186:0:35827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518584.751228:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518584.751253:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518584.751277:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.751394:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627622272 00000100:00100000:2.0:1789518584.751399:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627622272 00000100:00100000:2.0:1789518584.751459:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518584.751466:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+6:35827:x1876445627622272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518584.751703:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+6:35827:x1876445627622272:12345-0@lo:501:mount.lustre.0 Request processed in 237us (448us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518584.751710:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518584.751822:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622272:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789518584.751846:0:35827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789518584.751877:0:35827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.751887:0:35827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518584.751894:0:35827:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99fff4010800 10000000:01000000:1.0:1789518584.751898:0:35827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789518584.751902:0:35827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99fff4010800 10000000:01000000:1.0:1789518584.751905:0:35827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789518584.751907:0:35827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99fff4010800 from 1 10000000:01000000:1.0:1789518584.751910:0:35827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789518584.751926:0:35827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7851ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.751933:0:35827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7851ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.751940:0:35827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7851ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518584.751953:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518584.751980:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518584.752133:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518584.752198:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627622400 00000100:00100000:3.0:1789518584.752203:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627622400 00000100:00100000:3.0:1789518584.752226:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518584.752234:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+6:35827:x1876445627622400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518584.752241:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518584.752253:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4980000/0x631fd8698c7851b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7851ad expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.752268:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4980000/0x631fd8698c7851b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7851ad expref: 7 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.752283:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4980000/0x631fd8698c7851b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7851ad expref: 7 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.752290:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980000, rc 0) 00000100:00100000:3.0:1789518584.752338:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+7:35827:x1876445627622400:12345-0@lo:101:mount.lustre.0 Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518584.752344:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789518584.752423:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518584.752434:0:35827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7851ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851b4 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.752441:0:35827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7851ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7851b4 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518584.752457:0:35827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789518584.752478:0:35827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7851ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851b4 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.752484:0:35827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0200/0x631fd8698c7851ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851b4 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518584.752490:0:35827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789518584.752494:0:35827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789518584.752497:0:35827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99fff4010800 10000000:01000000:1.0:1789518584.752500:0:35827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789518584.752503:0:35827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789518584.752505:0:35827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789518584.752519:0:35827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c7851bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.752525:0:35827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c7851bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.752531:0:35827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c7851bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518584.752542:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518584.752569:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518584.752580:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518584.752640:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627622528 00000100:00100000:3.0:1789518584.752644:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627622528 00000100:00100000:3.0:1789518584.752659:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518584.752665:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+7:35827:x1876445627622528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518584.752671:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518584.752678:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4980600/0x631fd8698c7851c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7851bb expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.752691:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4980600/0x631fd8698c7851c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7851bb expref: 8 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.752700:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4980600/0x631fd8698c7851c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7851bb expref: 8 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.752706:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980600, rc 0) 00000100:00100000:3.0:1789518584.752741:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+8:35827:x1876445627622528:12345-0@lo:101:mount.lustre.0 Request processed in 75us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518584.752747:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789518584.752824:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518584.752833:0:35827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c7851bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851c2 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.752847:0:35827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c7851bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7851c2 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518584.752886:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518584.752917:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518584.752941:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627622656 00000100:00100000:1.0:1789518584.752946:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.752948:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627622656 00000100:00100000:2.0:1789518584.752974:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518584.753058:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+8:35827:x1876445627622656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518584.753381:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+9:35827:x1876445627622656:12345-0@lo:501:mount.lustre.0 Request processed in 400us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.753389:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518584.753672:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518584.753704:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518584.753743:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518584.753829:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518584.754239:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627622784 00000100:00100000:3.0:1789518584.754244:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627622784 00000100:00100000:1.0:1789518584.754413:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518584.754420:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+9:35827:x1876445627622784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518584.754817:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+9:35827:x1876445627622784:12345-0@lo:503:mount.lustre.0 Request processed in 396us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518584.754825:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518584.755056:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627622784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518584.755324:0:35863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35863:1876445627622912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518584.755354:0:35863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518584.755380:0:35863:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.755399:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627622912 00000100:00100000:2.0:1789518584.755411:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627622912 00000100:00100000:2.0:1789518584.755445:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518584.755451:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+9:35863:x1876445627622912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518584.755708:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+9:35863:x1876445627622912:12345-0@lo:502:llog_process_th.0 Request processed in 256us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.755715:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518584.756148:0:35863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35863:1876445627622912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518584.756175:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518584.756187:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.756190:0:35863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789518584.756196:0:35863:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789518584.756199:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518584.756212:0:35863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99ffd10f8000) 00000020:00000080:0.0:1789518584.756229:0:35863:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789518584.756234:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789518584.756310:0:35863:0:(osd_handler.c:1614:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789518584.756320:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c7851d0 00000020:00000080:0.0:1789518584.756511:0:35863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789518584.756516:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518584.756519:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.756521:0:35863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789518584.756523:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518584.756527:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.756528:0:35863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789518584.756531:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518584.756538:0:35863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99ffd10fb380) 00000020:00000080:0.0:1789518584.756547:0:35863:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789518584.756551:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789518584.756553:0:35863:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789518584.756556:0:35863:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789518584.756561:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789518584.756706:0:35863:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fff4010800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789518584.756719:0:35863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99ffd10fcd40) 00000020:00000080:0.0:1789518584.756728:0:35863:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789518584.756773:0:35863:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789518584.756789:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c7851e5 00000020:00000080:0.0:1789518584.757143:0:35863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789518584.757150:0:35863:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789518584.757155:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x631fd8698c7851ec 00080000:01000000:0.0:1789518584.757161:0:35863:0:(osd_handler.c:1614:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789518584.757165:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c7851f3 00010000:00010000:1.0:1789518584.814184:0:35863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789518584.814878:0:35863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 25769803890 00000001:00080000:1.0:1789518584.815052:0:35863:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789518584.815562:0:35863:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99ffee0619c0) 00000020:00000080:1.0:1789518584.815579:0:35863:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789518584.815677:0:35863:0:(osd_handler.c:1614:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789518584.815685:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c785201 00000020:00000080:3.0:1789518584.816585:0:35863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789518584.824062:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x631fd8698c785208 00000020:00000080:0.0:1789518584.825430:0:35863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789518584.825444:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518584.825451:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.825453:0:35863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789518584.825457:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518584.825463:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.825464:0:35863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789518584.825469:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789518584.825515:0:35863:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789518584.825530:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518584.825533:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.825535:0:35863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789518584.825538:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789518584.825540:0:35863:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1789518584.825541:0:35863:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518584.825543:0:35863:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518584.825544:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789518584.825547:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.825548:0:35863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789518584.825550:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518584.825554:0:35863:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789518584.825557:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.825559:0:35863:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789518584.825562:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789518584.825567:0:35863:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:0.0:1789518584.825593:0:35863:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789518584.825596:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518584.825609:0:35863:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99ffc6510000) 00000020:00000080:0.0:1789518584.825763:0:35863:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789518584.825769:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789518584.825832:0:35863:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789518584.825837:0:35863:0:(osd_handler.c:1614:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789518584.825844:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c785216 00010000:00080000:0.0:1789518584.825875:0:35863:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffff2cf000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1789518584.826096:0:35863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1789518584.826454:0:35863:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789518584.826500:0:35863:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789518584.827491:0:35863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518584.827546:0:35863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:0.0:1789518584.827743:0:35863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].1, 64 off8256 00000040:00080000:3.0:1789518584.828216:0:35867:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518584.828221:0:35867:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x28:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789518584.829227:0:35863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518584.829239:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789518584.829271:0:35863:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789518584.829288:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c78521d 00000100:00080000:3.0:1789518584.829297:0:35863:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518584.829308:0:35863:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffff2cf000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518584.829341:0:35863:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffed746680 x1876445627623040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518584.829368:0:35863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789518584.829433:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518584.829437:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518584.829438:0:35863:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789518584.829441:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789518584.829444:0:35863:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1789518584.829445:0:35863:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518584.829447:0:35863:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789518584.829448:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789518584.829450:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518584.829452:0:35863:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789518584.829454:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789518584.829458:0:35863:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789518584.829460:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518584.829462:0:35863:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789518584.829464:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789518584.829468:0:35863:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:3.0:1789518584.829487:0:35863:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789518584.829495:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789518584.829505:0:35863:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99fff4200000) 00000020:00000080:3.0:1789518584.829515:0:35863:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789518584.829520:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789518584.829578:0:35863:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789518584.829584:0:35863:0:(osd_handler.c:1614:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789518584.829590:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x631fd8698c78522b 00010000:00080000:3.0:1789518584.829640:0:35863:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffdf989800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00000100:00100000:0.0:1789518584.830128:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627623040:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789518584.830177:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627623040 offset 0 length 520: 4 00010000:00010000:3.0:1789518584.830529:0:35863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789518584.830730:0:35863:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789518584.830748:0:35863:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789518584.830938:0:35863:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 5, last_idx 6 00000040:00080000:3.0:1789518584.831202:0:35863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518584.831264:0:35863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:3.0:1789518584.831327:0:35863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].1, 64 off8256 00000040:00080000:0.0:1789518584.832469:0:35869:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:0.0:1789518584.832474:0:35869:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789518584.833729:0:35863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789518584.833742:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789518584.833772:0:35863:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789518584.833802:0:35863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c785232 00000100:00080000:3.0:1789518584.833821:0:35863:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518584.833831:0:35863:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffdf989800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518584.833865:0:35863:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffed747800 x1876445627623168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518584.833891:0:35863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789518584.833943:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518584.833946:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518584.833948:0:35863:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789518584.833951:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518584.833954:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518584.833955:0:35863:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518584.833958:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518584.833966:0:35863:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789518584.833969:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518584.833971:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518584.833972:0:35863:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789518584.833974:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518584.833976:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518584.833977:0:35863:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789518584.833980:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789518584.834008:0:35863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35863:1876445627623296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518584.834074:0:35863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518584.834102:0:35863:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518584.834205:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627623168:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789518584.834229:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627623296 00000400:00000100:0.0:1789518584.834236:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876445627623168 offset 0 length 520: 4 00000100:00100000:1.0:1789518584.834239:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627623296 00000100:00100000:1.0:1789518584.834282:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518584.834379:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+9:35863:x1876445627623296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518584.834608:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+9:35863:x1876445627623296:12345-0@lo:502:llog_process_th.0 Request processed in 310us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518584.835479:0:35863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35863:1876445627623296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789518584.835511:0:35863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518584.835517:0:35863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518584.835519:0:35863:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789518584.835523:0:35863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789518584.835749:0:35827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789518584.835770:0:35827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789518584.835796:0:35827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c7851bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851c2 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.835807:0:35827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0c00/0x631fd8698c7851bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851c2 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518584.835814:0:35827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99fff4010800 from 1 10000000:01000000:2.0:1789518584.835817:0:35827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789518584.835845:0:35827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.835852:0:35827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.835861:0:35827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518584.835876:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518584.835915:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518584.835942:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.835962:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627623424 00000100:00100000:2.0:1789518584.835974:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627623424 00000100:00100000:1.0:1789518584.837171:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518584.837199:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518584.837213:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+9:35827:x1876445627623424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518584.838107:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518584.838128:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c785239 expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.838153:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c785239 expref: 10 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.838165:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785239 expref: 10 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.838174:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14cc00, rc 0) 00000100:00100000:2.0:1789518584.838379:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+10:35827:x1876445627623424:12345-0@lo:101:mount.lustre.0 Request processed in 1170us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.838386:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518584.839435:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518584.839457:0:35827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.839467:0:35827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518584.840849:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623552:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789518584.840912:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518584.840955:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518584.841029:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627623552 00000100:00100000:1.0:1789518584.841038:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627623552 00000100:00100000:1.0:1789518584.841083:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789518584.841093:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+10:35827:x1876445627623552:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789518584.841112:0:35839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789518584.841118:0:35839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789518584.841207:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+10:35827:x1876445627623552:12345-0@lo:256:mount.lustre.0 Request processed in 115us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518584.841215:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518584.841271:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623552:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789518584.842518:0:35827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518584.842553:0:35827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.842654:0:35827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518584.842665:0:35827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fff4010800 from 1 10000000:01000000:3.0:1789518584.842668:0:35827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518584.842698:0:35827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.842705:0:35827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.842713:0:35827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518584.842727:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518584.842773:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518584.842820:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1000 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.842821:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627623680 00000100:00100000:2.0:1789518584.842828:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627623680 00000100:00100000:2.0:1789518584.842871:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518584.842879:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+10:35827:x1876445627623680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518584.842889:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518584.842903:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c785247 expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.842923:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c785247 expref: 11 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.842934:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785247 expref: 11 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.842949:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c000, rc 0) 00000100:00100000:2.0:1789518584.842992:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+11:35827:x1876445627623680:12345-0@lo:101:mount.lustre.0 Request processed in 114us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.842999:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518584.843225:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518584.843239:0:35827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.843248:0:35827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518584.843292:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518584.843317:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518584.843344:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518584.843374:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627623808 00000100:00100000:0.0:1789518584.843380:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627623808 00000100:00100000:0.0:1789518584.843414:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518584.843421:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+11:35827:x1876445627623808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518584.843836:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+11:35827:x1876445627623808:12345-0@lo:501:mount.lustre.0 Request processed in 414us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518584.843843:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518584.844197:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518584.844227:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518584.844264:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518584.844338:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2af1000 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.844562:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627623936 00000100:00100000:2.0:1789518584.844567:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627623936 00000100:00100000:2.0:1789518584.844597:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518584.844604:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+11:35827:x1876445627623936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518584.844985:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+11:35827:x1876445627623936:12345-0@lo:503:mount.lustre.0 Request processed in 381us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.844992:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789518584.845310:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627623936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518584.846713:0:35871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35871:1876445627624064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518584.846768:0:35871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518584.846814:0:35871:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518584.846912:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627624064 00000100:00100000:1.0:1789518584.846919:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627624064 00000100:00100000:1.0:1789518584.846961:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789518584.846970:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+11:35871:x1876445627624064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789518584.847293:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+11:35871:x1876445627624064:12345-0@lo:502:llog_process_th.0 Request processed in 323us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518584.847300:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518584.847960:0:35871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35871:1876445627624064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518584.847989:0:35871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518584.847999:0:35871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.848001:0:35871:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789518584.848008:0:35871:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fff4010800 00000020:00000080:0.0:1789518584.848011:0:35871:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518584.848018:0:35871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518584.848020:0:35871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.848022:0:35871:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789518584.848024:0:35871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518584.848026:0:35871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.848034:0:35871:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518584.848038:0:35871:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fff4010800 00000020:00000080:0.0:1789518584.848040:0:35871:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518584.848097:0:35871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518584.848101:0:35871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.851728:0:35871:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789518584.851740:0:35871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518584.851758:0:35871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.851760:0:35871:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518584.851766:0:35871:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99fff4010800 00000020:00000080:0.0:1789518584.851769:0:35871:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789518584.851882:0:35871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35871:1876445627624192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518584.851955:0:35871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518584.851997:0:35871:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.852180:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627624192 00000100:00100000:2.0:1789518584.852188:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627624192 00000100:00100000:2.0:1789518584.852284:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518584.852295:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+11:35871:x1876445627624192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518584.852514:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+11:35871:x1876445627624192:12345-0@lo:502:llog_process_th.0 Request processed in 221us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.852522:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518584.852610:0:35871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35871:1876445627624192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789518584.852657:0:35871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518584.852662:0:35871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518584.852663:0:35871:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789518584.852667:0:35871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789518584.853695:0:35827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789518584.853720:0:35827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518584.853739:0:35827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.853751:0:35827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518584.853836:0:35827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789518584.853839:0:35827:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99fff4010800 10000000:01000000:2.0:1789518584.853843:0:35827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99fff4010800 10000000:01000000:2.0:1789518584.853848:0:35827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518584.853853:0:35827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99fff4010800 from 1 10000000:01000000:2.0:1789518584.853856:0:35827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789518584.853886:0:35827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc14c800/0x631fd8698c785255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.853893:0:35827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fffc14c800/0x631fd8698c785255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.853899:0:35827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fffc14c800/0x631fd8698c785255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518584.853914:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627624320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518584.853945:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518584.853971:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518584.853984:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627624320 00000100:00100000:0.0:1789518584.853990:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627624320 00000100:00100000:0.0:1789518584.854084:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789518584.854094:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+11:35827:x1876445627624320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518584.854114:0:35837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518584.854129:0:35837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bcc00/0x631fd8698c78525c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c785255 expref: -99 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.854152:0:35837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bcc00/0x631fd8698c78525c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c785255 expref: 12 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.854177:0:35837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bcc00/0x631fd8698c78525c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785255 expref: 12 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.854187:0:35837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bcc00, rc 0) 00000100:00100000:0.0:1789518584.854227:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+12:35827:x1876445627624320:12345-0@lo:101:mount.lustre.0 Request processed in 135us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518584.854233:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518584.854325:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627624320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518584.854337:0:35827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fffc14c800/0x631fd8698c785255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78525c expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518584.854347:0:35827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fffc14c800/0x631fd8698c785255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78525c expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518584.854390:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627624448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518584.854414:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518584.854437:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.854452:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627624448 00000100:00100000:2.0:1789518584.854455:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627624448 00000100:00100000:2.0:1789518584.854478:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518584.854485:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:35827:x1876445627624448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518584.854732:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:35827:x1876445627624448:12345-0@lo:501:mount.lustre.0 Request processed in 247us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.854739:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518584.854772:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627624448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518584.854814:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627624576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518584.854853:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518584.854866:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518584.854879:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627624576 00000100:00100000:2.0:1789518584.854882:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627624576 00000100:00100000:2.0:1789518584.854902:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518584.854909:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:35827:x1876445627624576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518584.855039:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:35827:x1876445627624576:12345-0@lo:503:mount.lustre.0 Request processed in 130us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.855046:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518584.855086:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627624576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518584.855827:0:35873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35873:1876445627624704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518584.855880:0:35873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518584.855914:0:35873:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43480 going to sleep for 11 seconds 00000100:00100000:3.0:1789518584.855923:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627624704 00000100:00100000:3.0:1789518584.855929:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627624704 00000100:00100000:3.0:1789518584.856697:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518584.856708:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:35873:x1876445627624704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518584.856991:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:35873:x1876445627624704:12345-0@lo:502:llog_process_th.0 Request processed in 280us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.856999:0:35873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35873:1876445627624704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789518584.857001:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000020:01000004:2.0:1789518584.857066:0:35873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789518584.857083:0:35873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99fff783cd40) 00000020:00000080:2.0:1789518584.857099:0:35873:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789518584.857188:0:35873:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fff4010800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789518584.857193:0:35873:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fff4010800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789518584.857195:0:35873:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fff4010800 4 00010000:00080000:2.0:1789518584.857221:0:35873:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffffbf6000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:2.0:1789518584.859144:0:35873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789518584.859332:0:35873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789518584.859362:0:35873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789518584.859376:0:35873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x631fd8698c78526a 00000100:00080000:2.0:1789518584.859385:0:35873:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789518584.859395:0:35873:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ffffbf6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518584.859424:0:35873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffc638b480 x1876445627624832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789518584.859458:0:35873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518584.861249:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627624832:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518584.861315:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518584.863544:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627624832 00000100:00100000:0.0:1789518584.863557:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627624832 00000100:00100000:0.0:1789518584.863597:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518584.863606:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627624832:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789518584.863810:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1876445627624832:12345-0@lo:38:llog_process_th.0 Request processed in 204us (2493us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789518584.863817:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518584.863858:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518584.863865:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffffbf6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518584.863869:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789518584.863872:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627624832:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789518584.864108:0:35873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35873:1876445627624960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789518584.864161:0:35873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518584.864189:0:35873:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518584.864958:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627624960 00000100:00100000:0.0:1789518584.864964:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627624960 00000100:00100000:0.0:1789518584.864997:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518584.865005:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+12:35873:x1876445627624960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789518584.865325:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+12:35873:x1876445627624960:12345-0@lo:502:llog_process_th.0 Request processed in 319us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518584.865335:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518584.865396:0:35873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d183546-773a-47ec-8f5a-25077d1135e5:35873:1876445627624960:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789518584.865422:0:35873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789518584.865521:0:35827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789518584.865539:0:35827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789518584.865551:0:35827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fffc14c800/0x631fd8698c785255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78525c expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.865562:0:35827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fffc14c800/0x631fd8698c785255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78525c expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789518584.865604:0:35827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789518584.865606:0:35827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518584.865608:0:35827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518584.865609:0:35827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518584.865610:0:35827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518584.865627:0:35827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518584.865629:0:35827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518584.865631:0:35827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518584.865632:0:35827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518584.865634:0:35827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789518584.865636:0:35827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789518584.865639:0:35827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789518584.865640:0:35827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518584.865642:0:35827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518584.865643:0:35827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518584.865644:0:35827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518584.865645:0:35827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518584.865646:0:35827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518584.865647:0:35827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518584.865648:0:35827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518584.865649:0:35827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789518584.865664:0:35827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789518584.865675:0:35827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627625088:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789518584.865708:0:35827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518584.865737:0:35827:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518584.866988:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627625088 00000100:00100000:3.0:1789518584.866997:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627625088 00000100:00100000:3.0:1789518584.867042:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518584.867052:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:35827:x1876445627625088:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518584.867078:0:35840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789518584.867091:0:35840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789518584.905692:0:35840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789518584.905732:0:35840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789518584.905831:0:35861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789518584.905835:0:35861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789518584.905856:0:35861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.905888:0:35861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785239 expref: 12 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.905896:0:35861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.905930:0:35861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c785239 expref: 12 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.905944:0:35861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c785239 expref: 12 pid: 35840 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518584.905957:0:35861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35861:1876445627625216:0@lo:104: 00000100:00100000:1.0:1789518584.906013:0:35861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518584.906100:0:35861:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe0496840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518584.906208:0:35828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627625216 00000100:00100000:3.0:1789518584.906216:0:35828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627625216 00000100:00100000:3.0:1789518584.906258:0:35828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518584.906266:0:35829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789518584.906268:0:35828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d183546-773a-47ec-8f5a-25077d1135e5+3:35861:x1876445627625216:12345-0@lo:104: 00000100:00100000:2.0:1789518584.906272:0:35829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1789518584.906280:0:35828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.906378:0:35828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789518584.906383:0:35861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35861:1876445627625216:0@lo:104: 00000100:00100000:3.0:1789518584.906388:0:35828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d183546-773a-47ec-8f5a-25077d1135e5+3:35861:x1876445627625216:12345-0@lo:104: Request processed in 123us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518584.906394:0:35828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789518584.906398:0:35861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.906411:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518584.906416:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.906424:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518584.906428:0:35834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.906435:0:35834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518584.906442:0:35834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518584.906448:0:35834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789518584.906478:0:35834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.906485:0:35834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518584.906500:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518584.906507:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fffc14d800/0x631fd8698c785239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c785240 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518584.906520:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789518584.906521:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518584.906522:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518584.906524:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518584.906529:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627625344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518584.906568:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518584.906718:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627625344 00000100:00100000:0.0:1789518584.906724:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627625344 00010000:00010000:0.0:1789518584.906743:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785239 expref: 13 pid: 35840 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518584.906795:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518584.906812:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+13:3282:x1876445627625344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518584.906825:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518584.906831:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785239 expref: 13 pid: 35840 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.906842:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c785239 expref: 13 pid: 35840 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.906859:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc14cc00/0x631fd8698c785240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c785239 expref: 13 pid: 35840 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.906873:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.906880:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789518584.907261:0:35830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001426202s 00010000:00010000:0.0:1789518584.907266:0:35830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.907272:0:35830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.907277:0:35830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.907286:0:35830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.907290:0:35830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518584.907293:0:35830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.907298:0:35830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.907315:0:35830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518584.907322:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518584.907367:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+12:3282:x1876445627625344:12345-0@lo:103:ldlm_bl.0 Request processed in 566us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518584.907373:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789518584.907658:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627625344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789518584.908256:0:35861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.908267:0:35861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518584.908274:0:35861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e1600/0x631fd8698c785271 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518584.913536:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+11:35827:x1876445627625088:12345-0@lo:253:mount.lustre.0 Request processed in 46478us (47819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518584.913550:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518584.913723:0:35827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:35827:1876445627625088:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789518584.913738:0:35827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789518584.913741:0:35827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789518584.913743:0:35827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789518584.913744:0:35827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789518584.913745:0:35827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789518584.913746:0:35827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789518584.913748:0:35827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789518584.913749:0:35827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789518584.913750:0:35827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789518584.913752:0:35827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789518584.913753:0:35827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789518584.913765:0:35827:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789518584.914406:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518584.914588:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518584.914875:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518584.915029:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518584.915291:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518584.915453:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518584.916395:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518584.916598:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518584.917098:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518584.917254:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789518584.917525:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789518584.917711:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789518584.940915:0:35827:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 21474836520 00000020:00080000:3.0:1789518584.943403:0:35885:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 21474836520 00000020:00080000:3.0:1789518584.943409:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000040:01000000:0.0:1789518584.943446:0:35827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789518584.944046:0:35886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1789518584.944150:0:35886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789518584.945502:0:35827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789518584.945688:0:35827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789518584.947366:0:35827:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789518584.947383:0:35827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789518584.948121:0:35886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789518584.948191:0:35886:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789518584.948195:0:35886:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1789518584.952026:0:35827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518584.953225:0:35827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789518584.954059:0:35827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789518584.954098:0:35827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789518584.954524:0:35827:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 5, last_idx 6 00080000:10000000:3.0:1789518584.956921:0:35827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3b:0x0] (8/8/4) registered 00000001:00000004:3.0:1789518584.964230:0:35827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000001:00080000:3.0:1789518584.999902:0:35827:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789518584.999938:0:35827:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa50841923988 00100000:10000000:3.0:1789518584.999945:0:35827:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789518585.000504:0:35827:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789518585.000520:0:35827:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789518585.000534:0:35827:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789518585.000553:0:35827:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789518585.716124:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518585.907028:0:35881:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1789518585.907039:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518585.907635:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:2.0:1789518585.907642:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 10000000:01000000:0.0:1789518586.036192:0:35842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789518586.036202:0:35842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99fff4010800 from 21 10000000:01000000:0.0:1789518586.036209:0:35842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789518586.036270:0:35842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518586.036283:0:35842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518586.036297:0:35842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518586.036326:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627625472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518586.036411:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518586.036481:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518586.036953:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627625472 00000100:00100000:0.0:1789518586.036964:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627625472 00000100:00100000:0.0:1789518586.037219:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518586.037232:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+11:35842:x1876445627625472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518586.037250:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518586.037269:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c785278 expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518586.037300:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c785278 expref: 12 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518586.037314:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785278 expref: 12 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518586.037323:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:0.0:1789518586.037396:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+12:35842:x1876445627625472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518586.037404:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789518586.037490:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627625472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518586.037523:0:35842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518586.037534:0:35842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518586.037608:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627625600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789518586.037688:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518586.038065:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518586.038177:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627625600 00000100:00100000:3.0:1789518586.038183:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627625600 00000100:00100000:3.0:1789518586.038217:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518586.038225:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+12:35842:x1876445627625600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789518586.038248:0:35837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789518586.038274:0:35837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789518586.038277:0:35837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 21 00000100:00100000:3.0:1789518586.038380:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+12:35842:x1876445627625600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518586.038389:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518586.038445:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627625600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518586.038565:0:35842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518586.038575:0:35842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518586.038584:0:35842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518586.740807:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518586.930807:0:35881:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1789518586.930816:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518586.930851:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:2.0:1789518586.930857:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000001:02000400:0.0:1789518587.323742:0:36130:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789518587.762856:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518588.786822:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789518588.980071:0:36282:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5efa4210 20000000:00000080:3.0:1789518588.980089:0:36282:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffedb03800 uarg=0000000000000000 20000000:01000000:3.0:1789518588.980120:0:36282:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789518588.980127:0:36282:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789518588.980130:0:36282:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789518588.981379:0:36283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789518588.981523:0:36282:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789518588.981538:0:36282:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789518588.981556:0:36282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518588.981575:0:36282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785247 expref: 11 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518588.981583:0:36282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518588.981886:0:36282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c785247 expref: 11 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518588.981901:0:36282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c785247 expref: 11 pid: 35840 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518588.981916:0:36282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36282:1876445627625728:0@lo:104: 00000100:00100000:1.0:1789518588.982055:0:36282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518588.982143:0:36282:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518588.983823:0:35828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627625728 00000100:00100000:3.0:1789518588.983835:0:35828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627625728 00000100:00100000:3.0:1789518588.983890:0:35828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518588.983900:0:35828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d183546-773a-47ec-8f5a-25077d1135e5+3:36282:x1876445627625728:12345-0@lo:104: 00010000:00010000:3.0:1789518588.983916:0:35828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.985088:0:35828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518588.985099:0:35828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d183546-773a-47ec-8f5a-25077d1135e5+3:36282:x1876445627625728:12345-0@lo:104: Request processed in 1199us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518588.985108:0:35828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789518588.985499:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518588.985508:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518588.985518:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518588.985522:0:35833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518588.985545:0:35833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518588.985552:0:35833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518588.985558:0:35833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789518588.985607:0:35833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518588.985645:0:35833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518588.985667:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518588.985674:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fec4981600/0x631fd8698c785247 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78524e expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518588.986297:0:36282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:36282:1876445627625728:0@lo:104: 00010000:00010000:1.0:1789518588.986317:0:36282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518588.986471:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518588.986487:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627625856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518588.986553:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518588.986636:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627625856 00000100:00100000:3.0:1789518588.986642:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627625856 00010000:00010000:3.0:1789518588.986681:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785247 expref: 12 pid: 35840 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518588.986708:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518588.986716:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d183546-773a-47ec-8f5a-25077d1135e5+12:3281:x1876445627625856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518588.986728:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518588.986734:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785247 expref: 12 pid: 35840 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986744:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c785247 expref: 12 pid: 35840 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986772:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc14c000/0x631fd8698c78524e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c785247 expref: 12 pid: 35840 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986788:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986796:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986811:0:35832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986818:0:35832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986825:0:35832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986838:0:35832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986843:0:35832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518588.986847:0:35832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986855:0:35832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986866:0:35832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518588.986875:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518588.986907:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d183546-773a-47ec-8f5a-25077d1135e5+11:3281:x1876445627625856:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518588.986914:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518588.986944:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627625856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518588.987547:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518588.987550:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518588.987553:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518588.989951:0:36282:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518588.989968:0:36282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518588.989975:0:36282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785286 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 36282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518589.810744:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789518590.068506:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789518590.068512:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789518590.068515:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789518590.068518:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789518590.068520:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789518590.068523:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789518590.068527:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ffffbf6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789518590.068551:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99ffffbf6000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518590.068572:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffc638ad80 x1876445627626112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518590.068598:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518590.068628:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627625984:0@lo:400:kworker.0 00000100:00100000:2.0:1789518590.068687:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518590.068923:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627626112:0@lo:38:kworker.0 00000100:00100000:0.0:1789518590.068956:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518590.069182:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627625984 00000100:00100000:3.0:1789518590.069190:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627625984 00000100:00100000:3.0:1789518590.069292:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518590.069303:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+11:3280:x1876445627625984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518590.069356:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+11:3280:x1876445627625984:12345-0@lo:400:kworker.0 Request processed in 56us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518590.069363:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789518590.069451:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627626112 00000100:00100000:2.0:1789518590.069456:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627626112 00000100:00100000:2.0:1789518590.069485:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518590.069491:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627626112:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789518590.069511:0:35847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:2.0:1789518590.069541:0:35847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x631fd8698c78528d 00000004:00100000:2.0:1789518590.069554:0:35847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789518590.069708:0:35847:0:(import.c:65:import_set_state_nolock()) ffff99ffc76f3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518590.069749:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1876445627626112:12345-0@lo:38:kworker.0 Request processed in 256us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518590.069766:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789518590.069806:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffc638ad80 x1876445627626112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789518590.069823:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 7 00000100:00080000:0.0:1789518590.069831:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789518590.069843:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789518590.069846:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffffbf6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789518590.069852:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1876445627626112:0@lo:38:kworker.0 00000100:00100000:3.0:1789518590.070009:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627625984:0@lo:400:kworker.0 10000000:01000000:3.0:1789518590.514691:0:35842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518590.514707:0:35842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fff4010800 from 10 10000000:01000000:3.0:1789518590.514715:0:35842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518590.514786:0:35842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518590.514800:0:35842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518590.514814:0:35842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518590.514849:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627626240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518590.514946:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518590.515005:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518590.515131:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627626240 00000100:00100000:2.0:1789518590.515140:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627626240 00000100:00100000:2.0:1789518590.515350:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518590.515362:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+11:35842:x1876445627626240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518590.515380:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518590.515399:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c785294 expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518590.515430:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c785294 expref: 12 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518590.515456:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785294 expref: 12 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518590.515467:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14d800, rc 0) 00000100:00100000:2.0:1789518590.515540:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+12:35842:x1876445627626240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518590.515548:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789518590.515828:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627626240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518590.515850:0:35842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518590.515862:0:35842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518590.515936:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627626368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518590.515968:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518590.516000:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518590.516152:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627626368 00000100:00100000:1.0:1789518590.516166:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627626368 00000100:00100000:1.0:1789518590.516237:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518590.516253:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+12:35842:x1876445627626368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789518590.516870:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+12:35842:x1876445627626368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 622us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518590.516881:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789518590.516895:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627626368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518590.516932:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627626496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518590.516974:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518590.517000:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518590.517720:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627626496 00000100:00100000:1.0:1789518590.517730:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627626496 00000100:00100000:1.0:1789518590.517788:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518590.517796:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:35842:x1876445627626496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518590.518007:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:35842:x1876445627626496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518590.518016:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789518590.518047:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627626496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518590.519087:0:36406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789518590.519376:0:35842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789518590.519414:0:35842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518590.519434:0:35842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518590.519446:0:35842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518590.836258:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789518591.810451:0:36530:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789518591.810455:0:36530:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789518591.810558:0:36530:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffed4de000 00000020:01000004:0.0:1789518591.810572:0:36530:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789518591.810583:0:36530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789518591.810595:0:36530:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99ffc65119c0) 00000020:00000080:0.0:1789518591.810681:0:36530:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789518591.825021:0:36530:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789518591.826111:0:36530:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789518591.827055:0:36530:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789518591.827274:0:36530:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789518591.827526:0:36530:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xf:0x0] (8/32) 00100000:10000000:0.0:1789518591.827944:0:36530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1789518591.828040:0:36530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1789518591.828194:0:36530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1789518591.828563:0:36530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:0.0:1789518591.828841:0:36530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:0.0:1789518591.830146:0:36530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1789518591.830396:0:36530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:0.0:1789518591.830763:0:36530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1789518591.831011:0:36530:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00000020:00000080:0.0:1789518591.831551:0:36530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789518591.831563:0:36530:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789518591.831573:0:36530:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c7852a9 00000020:01000004:0.0:1789518591.831581:0:36530:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789518591.831600:0:36530:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789518591.831603:0:36530:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789518591.831609:0:36530:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789518591.831743:0:36530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789518591.831762:0:36530:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99ffc6514d40) 00000020:00000080:0.0:1789518591.831773:0:36530:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1789518591.833009:0:36530:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518591.833176:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789518591.833182:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789518591.833767:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789518591.833775:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789518591.834016:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789518591.834023:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789518591.835213:0:36530:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789518591.836925:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789518591.836933:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789518591.840774:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789518591.840785:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789518591.853880:0:36530:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518591.854093:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789518591.854099:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789518591.855899:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789518591.855916:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789518591.856610:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789518591.856712:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789518591.858381:0:36530:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789518591.858556:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789518591.858562:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00010000:00010000:0.0:1789518591.859054:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518591.862767:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789518591.862779:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789518591.889719:0:36530:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789518591.889942:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789518591.889950:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789518591.892208:0:36530:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789518591.892220:0:36530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789518591.892874:0:36530:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789518591.892896:0:36530:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789518591.892902:0:36530:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789518591.903949:0:36530:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789518591.904057:0:36530:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789518591.904062:0:36530:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789518591.904064:0:36530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789518591.904066:0:36530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518591.904067:0:36530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518591.904069:0:36530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518591.904070:0:36530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518591.904071:0:36530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518591.904073:0:36530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518591.904074:0:36530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518591.904078:0:36530:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789518591.904081:0:36530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789518591.904082:0:36530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789518591.904084:0:36530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518591.904085:0:36530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518591.904086:0:36530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518591.904087:0:36530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518591.904088:0:36530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518591.904089:0:36530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518591.904090:0:36530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789518591.904130:0:36530:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789518591.904150:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627626624:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789518591.904215:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.904318:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518591.904363:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627626624 00000100:00100000:1.0:1789518591.904371:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627626624 00000100:00100000:1.0:1789518591.904455:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789518591.904464:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+12:36530:x1876445627626624:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518591.904491:0:35837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789518591.904494:0:35837:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789518591.904497:0:35837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789518591.914661:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+12:36530:x1876445627626624:12345-0@lo:253:mount.lustre.0 Request processed in 10189us (10436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518591.914675:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518591.914817:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627626624:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789518591.914833:0:36530:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789518591.914836:0:36530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518591.914838:0:36530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789518591.914840:0:36530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518591.914841:0:36530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518591.914842:0:36530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518591.914844:0:36530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518591.914845:0:36530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518591.914847:0:36530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518591.914849:0:36530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789518591.914886:0:36530:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffed4de000 from lustre-OST0000 10000000:01000000:3.0:1789518591.914915:0:36530:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789518591.914918:0:36530:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789518591.914926:0:36530:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99fff42019c0 local copy 00010000:00010000:3.0:1789518591.914939:0:36530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518591.915246:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627626752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518591.915284:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.915427:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116900 going to sleep for 11 seconds 00000100:00100000:1.0:1789518591.915475:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627626752 00000100:00100000:1.0:1789518591.915482:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627626752 00000100:00100000:1.0:1789518591.915568:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518591.915577:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:36530:x1876445627626752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518591.915767:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+12:36530:x1876445627626752:12345-0@lo:501:mount.lustre.0 Request processed in 190us (482us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518591.915776:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518591.915847:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627626752:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789518591.915862:0:36530:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789518591.916019:0:36530:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789518591.916026:0:36530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518591.916036:0:36530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518591.916058:0:36530:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffed4de000 10000000:01000000:3.0:1789518591.916064:0:36530:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789518591.916068:0:36530:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99fff42019c0 10000000:01000000:3.0:1789518591.916071:0:36530:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789518591.916075:0:36530:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99fff42019c0 from 1 10000000:01000000:3.0:1789518591.916078:0:36530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789518591.916102:0:36530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980a00/0x631fd8698c7852b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518591.916110:0:36530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4980a00/0x631fd8698c7852b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518591.916126:0:36530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4980a00/0x631fd8698c7852b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518591.916139:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627626880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518591.916166:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.916418:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116900 going to sleep for 11 seconds 00000100:00100000:0.0:1789518591.916524:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627626880 00000100:00100000:0.0:1789518591.916531:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627626880 00000100:00100000:0.0:1789518591.916560:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789518591.916577:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+12:36530:x1876445627626880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518591.916588:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518591.916600:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd400/0x631fd8698c7852be lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7852b7 expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.916636:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd400/0x631fd8698c7852be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7852b7 expref: 13 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.916647:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd400/0x631fd8698c7852be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7852b7 expref: 13 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.916655:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd400, rc 0) 00000100:00100000:0.0:1789518591.916699:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+13:36530:x1876445627626880:12345-0@lo:101:mount.lustre.0 Request processed in 123us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.916706:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789518591.916798:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627626880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518591.916812:0:36530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4980a00/0x631fd8698c7852b7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852be expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518591.916821:0:36530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4980a00/0x631fd8698c7852b7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7852be expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518591.916839:0:36530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789518591.916860:0:36530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980a00/0x631fd8698c7852b7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852be expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518591.916868:0:36530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4980a00/0x631fd8698c7852b7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852be expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518591.916875:0:36530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789518591.916880:0:36530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518591.916884:0:36530:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789518591.916886:0:36530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789518591.916902:0:36530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980c00/0x631fd8698c7852c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518591.916910:0:36530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4980c00/0x631fd8698c7852c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518591.916925:0:36530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4980c00/0x631fd8698c7852c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518591.916939:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518591.916966:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518591.917079:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627627008 00000100:00100000:0.0:1789518591.917084:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627627008 00000100:00100000:0.0:1789518591.917105:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789518591.917111:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+13:36530:x1876445627627008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518591.917118:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518591.917127:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc200/0x631fd8698c7852cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7852c5 expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.917141:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc200/0x631fd8698c7852cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7852c5 expref: 14 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.917150:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bc200/0x631fd8698c7852cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7852c5 expref: 14 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.917167:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc200, rc 0) 00000100:00100000:0.0:1789518591.917194:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627008:12345-0@lo:101:mount.lustre.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.917201:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789518591.917257:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518591.917269:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518591.917280:0:36530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4980c00/0x631fd8698c7852c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852cc expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518591.917288:0:36530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4980c00/0x631fd8698c7852c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7852cc expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518591.918233:0:36530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000040:00080000:3.0:1789518591.919521:0:36530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518591.919857:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:3.0:1789518591.919898:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:3.0:1789518591.919926:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:3.0:1789518591.919964:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:3.0:1789518591.920075:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:3.0:1789518591.920106:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:3.0:1789518591.920149:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:3.0:1789518591.920182:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:3.0:1789518591.920216:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 80 off9712 00000040:00080000:3.0:1789518591.920261:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9936 00000040:00080000:3.0:1789518591.920367:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10160 00000040:00080000:3.0:1789518591.920421:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 120 off10280 00000040:00080000:3.0:1789518591.920496:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 224 off10504 00000040:00080000:3.0:1789518591.920512:0:36530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 14 00000100:00100000:3.0:1789518591.920601:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518591.920684:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.920787:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518591.920890:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627627136 00000100:00100000:0.0:1789518591.920898:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627627136 00000100:00100000:0.0:1789518591.921053:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518591.921063:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518591.921496:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627136:12345-0@lo:501:mount.lustre.0 Request processed in 433us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.921505:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518591.921586:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518591.921654:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518591.921694:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.921809:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518591.921858:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627627264 00000100:00100000:1.0:1789518591.921863:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627627264 00000100:00100000:1.0:1789518591.921888:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789518591.921895:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518591.922242:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627264:12345-0@lo:503:mount.lustre.0 Request processed in 345us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518591.922250:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789518591.922695:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518591.923402:0:36530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518591.923469:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518591.923520:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.923645:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518591.923813:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627627392 00000100:00100000:1.0:1789518591.923819:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627627392 00000100:00100000:1.0:1789518591.923859:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789518591.923868:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518591.924109:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627392:12345-0@lo:502:mount.lustre.0 Request processed in 241us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518591.924123:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518591.924207:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518591.924436:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:3.0:1789518591.924484:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:3.0:1789518591.924522:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:3.0:1789518591.924590:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:3.0:1789518591.924796:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:3.0:1789518591.924842:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:3.0:1789518591.924895:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:3.0:1789518591.924935:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:3.0:1789518591.924968:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 80 off9712 00000040:00080000:3.0:1789518591.925013:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9936 00000040:00080000:3.0:1789518591.925048:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10160 00000040:00080000:3.0:1789518591.925101:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 120 off10280 00000100:00100000:3.0:1789518591.925131:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518591.925172:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.925246:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518591.925319:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627627520 00000100:00100000:0.0:1789518591.925325:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627627520 00000100:00100000:0.0:1789518591.925367:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789518591.925376:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518591.925551:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627520:12345-0@lo:502:mount.lustre.0 Request processed in 176us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.925559:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789518591.925827:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518591.925925:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 224 off10504 00000040:00080000:3.0:1789518591.925937:0:36530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1789518591.926869:0:36544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518591.926878:0:36544:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789518591.926884:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.926887:0:36544:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789518591.926893:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518591.926910:0:36544:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99ffc6513380) 00000020:00000080:0.0:1789518591.926935:0:36544:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789518591.926940:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789518591.927017:0:36544:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffed4de000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789518591.927025:0:36544:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789518591.927032:0:36544:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x631fd8698c7852da 00010000:00010000:0.0:1789518591.930363:0:36544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1789518591.930943:0:36544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 25769803784 00080000:10000000:0.0:1789518591.933312:0:36544:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x10:0x0] (8/8/4) registered 00000020:00000080:0.0:1789518591.934696:0:36544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789518591.934713:0:36544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518591.934719:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.934722:0:36544:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789518591.934725:0:36544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789518591.934728:0:36544:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1789518591.934730:0:36544:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518591.934731:0:36544:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789518591.934733:0:36544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789518591.934735:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.934737:0:36544:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789518591.934739:0:36544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518591.934753:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.934755:0:36544:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789518591.934760:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789518591.934762:0:36544:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789518591.934764:0:36544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518591.934767:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.934768:0:36544:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789518591.934770:0:36544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518591.934772:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.934774:0:36544:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789518591.934777:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789518591.934839:0:36544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518591.934842:0:36544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.934844:0:36544:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789518591.934847:0:36544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 14 count 14 00000020:01000000:1.0:1789518591.935002:0:36530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789518591.935031:0:36530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789518591.935055:0:36530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980c00/0x631fd8698c7852c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852cc expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518591.935068:0:36530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4980c00/0x631fd8698c7852c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852cc expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518591.935076:0:36530:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffed4de000 from 1 10000000:01000000:1.0:1789518591.935079:0:36530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789518591.935111:0:36530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518591.935120:0:36530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518591.935131:0:36530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518591.935155:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789518591.935221:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518591.935345:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518591.937658:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627627648 00000100:00100000:2.0:1789518591.937671:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627627648 00000100:00100000:2.0:1789518591.937721:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518591.937732:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+14:36530:x1876445627627648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518591.937759:0:35837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518591.937779:0:35837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7852e1 expref: -99 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518591.937806:0:35837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7852e1 expref: 15 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518591.937831:0:35837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7852e1 expref: 15 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518591.937839:0:35837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14ce00, rc 0) 00000100:00100000:2.0:1789518591.937908:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627627648:12345-0@lo:101:mount.lustre.0 Request processed in 179us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518591.937915:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789518591.938104:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518591.938122:0:36530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518591.938131:0:36530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518591.938760:0:36530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000040:00080000:3.0:1789518591.939052:0:36530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518591.939322:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:3.0:1789518591.939368:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:3.0:1789518591.939436:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:3.0:1789518591.939472:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:3.0:1789518591.939506:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:3.0:1789518591.939552:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:3.0:1789518591.939588:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 224 off9536 00000040:00080000:3.0:1789518591.939768:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 128 off9664 00000040:00080000:3.0:1789518591.939843:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9888 00000040:00080000:3.0:1789518591.939851:0:36530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 9 count 10 00000100:00100000:3.0:1789518591.939919:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518591.939973:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.940063:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd2b76d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518591.940106:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627627776 00000100:00100000:0.0:1789518591.940119:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627627776 00000100:00100000:0.0:1789518591.940205:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518591.940213:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627627776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518591.940414:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627627776:12345-0@lo:501:mount.lustre.0 Request processed in 201us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.940422:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789518591.940492:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518591.940531:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518591.940568:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.940642:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd2b76d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518591.940721:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627627904 00000100:00100000:2.0:1789518591.940726:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627627904 00000100:00100000:2.0:1789518591.940761:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789518591.940767:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627627904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518591.940954:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627627904:12345-0@lo:503:mount.lustre.0 Request processed in 186us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518591.940961:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789518591.941057:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627627904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518591.941481:0:36530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518591.941561:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518591.941605:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.942023:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4daa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518591.942058:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627628032 00000100:00100000:2.0:1789518591.942064:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627628032 00000100:00100000:2.0:1789518591.942132:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789518591.942141:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627628032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518591.942311:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627628032:12345-0@lo:502:mount.lustre.0 Request processed in 170us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518591.942319:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789518591.942389:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518591.942628:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:3.0:1789518591.942673:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:3.0:1789518591.942723:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:3.0:1789518591.942778:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:3.0:1789518591.942818:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000040:00080000:3.0:1789518591.942870:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:3.0:1789518591.942922:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 224 off9536 00000040:00080000:3.0:1789518591.942960:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 128 off9664 00000100:00100000:3.0:1789518591.942989:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518591.943026:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518591.943209:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4daa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518591.943241:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627628160 00000100:00100000:0.0:1789518591.943246:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627628160 00000100:00100000:0.0:1789518591.943272:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518591.943278:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627628160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518591.943471:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627628160:12345-0@lo:502:mount.lustre.0 Request processed in 192us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.943478:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518591.943556:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518591.943838:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9888 00000040:00080000:3.0:1789518591.943849:0:36530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789518591.944510:0:36548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518591.944519:0:36548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.944521:0:36548:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789518591.944528:0:36548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffed4de000 00000020:00000080:0.0:1789518591.944530:0:36548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518591.944537:0:36548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518591.944539:0:36548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.944540:0:36548:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789518591.944543:0:36548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518591.944545:0:36548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.944546:0:36548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518591.944549:0:36548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffed4de000 00000020:00000080:0.0:1789518591.944551:0:36548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518591.944767:0:36548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518591.944772:0:36548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.944773:0:36548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789518591.944776:0:36548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518591.944784:0:36548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.944786:0:36548:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518591.944790:0:36548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffed4de000 00000020:00000080:0.0:1789518591.944792:0:36548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518591.946188:0:36548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518591.946195:0:36548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518591.946197:0:36548:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789518591.946200:0:36548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 10 count 10 00000020:01000000:0.0:1789518591.947677:0:36530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789518591.947707:0:36530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518591.947735:0:36530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.947757:0:36530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518591.947805:0:36530:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789518591.947809:0:36530:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffed4de000 10000000:01000000:0.0:1789518591.947812:0:36530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffed4de000 10000000:01000000:0.0:1789518591.947816:0:36530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789518591.947822:0:36530:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffed4de000 from 1 10000000:01000000:0.0:1789518591.947825:0:36530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789518591.947860:0:36530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bde00/0x631fd8698c7852ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.947869:0:36530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bde00/0x631fd8698c7852ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.947879:0:36530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bde00/0x631fd8698c7852ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518591.947901:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518591.947965:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518591.948010:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd91349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518591.948163:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627628288 00000100:00100000:1.0:1789518591.948171:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627628288 00000100:00100000:1.0:1789518591.948208:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518591.948216:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627628288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518591.948228:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518591.948247:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e1e00/0x631fd8698c7852f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7852ef expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518591.948271:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e1e00/0x631fd8698c7852f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7852ef expref: 16 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518591.948282:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e1e00/0x631fd8698c7852f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7852ef expref: 16 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518591.948290:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1e00, rc 0) 00000100:00100000:1.0:1789518591.948917:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627628288:12345-0@lo:101:mount.lustre.0 Request processed in 700us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518591.948926:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789518591.949132:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518591.949149:0:36530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bde00/0x631fd8698c7852ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852f6 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518591.949159:0:36530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bde00/0x631fd8698c7852ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7852f6 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518591.949903:0:36530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000040:00080000:0.0:1789518591.950221:0:36530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518591.950464:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:0.0:1789518591.950507:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:0.0:1789518591.950541:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:0.0:1789518591.950588:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:0.0:1789518591.950652:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:0.0:1789518591.950706:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:0.0:1789518591.950771:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:0.0:1789518591.950808:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:0.0:1789518591.950860:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:0.0:1789518591.950900:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:0.0:1789518591.950935:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:0.0:1789518591.950983:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:0.0:1789518591.951018:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:0.0:1789518591.951049:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:0.0:1789518591.951093:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:0.0:1789518591.951130:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:0.0:1789518591.951163:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:0.0:1789518591.951210:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:0.0:1789518591.951247:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:0.0:1789518591.951281:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:0.0:1789518591.951342:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:0.0:1789518591.951381:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:0.0:1789518591.951433:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:0.0:1789518591.951492:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:0.0:1789518591.951531:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 128 off12440 00000040:00080000:0.0:1789518591.951566:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12664 00000040:00080000:0.0:1789518591.951637:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12888 00000040:00080000:0.0:1789518591.951676:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off12968 00000040:00080000:0.0:1789518591.951711:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13192 00000040:00080000:0.0:1789518591.951774:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13416 00000040:00080000:0.0:1789518591.951813:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13504 00000040:00080000:0.0:1789518591.951851:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13632 00000040:00080000:0.0:1789518591.951884:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13776 00000040:00080000:0.0:1789518591.957855:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13904 00000040:00080000:0.0:1789518591.957962:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14128 00000040:00080000:0.0:1789518591.958034:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14352 00000040:00080000:0.0:1789518591.958076:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14432 00000040:00080000:0.0:1789518591.958113:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14656 00000040:00080000:0.0:1789518591.958185:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14880 00000040:00080000:0.0:1789518591.958225:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 120 off15000 00000040:00080000:0.0:1789518591.958327:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 224 off15224 00000040:00080000:0.0:1789518591.958335:0:36530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 41 count 42 00000100:00100000:0.0:1789518591.958432:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518591.958496:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518591.958542:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd91349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518591.958899:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627628416 00000100:00100000:0.0:1789518591.958907:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627628416 00000100:00100000:0.0:1789518591.958948:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518591.958956:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627628416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518591.959166:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627628416:12345-0@lo:501:mount.lustre.0 Request processed in 210us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.959181:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518591.959232:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518591.959264:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628544:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518591.959302:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518591.959332:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd91349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518591.959379:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627628544 00000100:00100000:1.0:1789518591.959384:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627628544 00000100:00100000:1.0:1789518591.959420:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789518591.959428:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627628544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518591.959562:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627628544:12345-0@lo:503:mount.lustre.0 Request processed in 135us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518591.959569:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518591.959663:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628544:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789518591.960173:0:36530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789518591.960227:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518591.960271:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518591.960304:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627628672 00000100:00100000:0.0:1789518591.960309:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627628672 00000100:00100000:0.0:1789518591.960339:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518591.960347:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627628672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518591.960551:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627628672:12345-0@lo:502:mount.lustre.0 Request processed in 205us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.960559:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518591.960605:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789518591.960641:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518591.960910:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:0.0:1789518591.960967:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:0.0:1789518591.961010:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:0.0:1789518591.961071:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:0.0:1789518591.961120:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:0.0:1789518591.961179:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:0.0:1789518591.961218:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:0.0:1789518591.961268:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:0.0:1789518591.961318:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:0.0:1789518591.961354:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:0.0:1789518591.961412:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:0.0:1789518591.961487:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:0.0:1789518591.961527:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:0.0:1789518591.961595:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:0.0:1789518591.961686:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:0.0:1789518591.961735:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:0.0:1789518591.961798:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:0.0:1789518591.961898:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:0.0:1789518591.961947:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:0.0:1789518591.961991:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:0.0:1789518591.962046:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:0.0:1789518591.962094:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:0.0:1789518591.962136:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:0.0:1789518591.962188:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:0.0:1789518591.962223:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 128 off12440 00000040:00080000:0.0:1789518591.962267:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12664 00000040:00080000:0.0:1789518591.962355:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12888 00000040:00080000:0.0:1789518591.962407:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off12968 00000040:00080000:0.0:1789518591.964698:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13192 00000040:00080000:0.0:1789518591.964829:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13416 00000040:00080000:0.0:1789518591.964888:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13504 00000040:00080000:0.0:1789518591.964955:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13632 00000040:00080000:0.0:1789518591.965004:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13776 00000040:00080000:0.0:1789518591.965097:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13904 00000040:00080000:0.0:1789518591.965148:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14128 00000040:00080000:0.0:1789518591.965269:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14352 00000040:00080000:0.0:1789518591.965319:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14432 00000040:00080000:0.0:1789518591.965367:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14656 00000040:00080000:0.0:1789518591.965452:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14880 00000040:00080000:0.0:1789518591.965945:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 120 off15000 00000100:00100000:0.0:1789518591.966003:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518591.966079:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518591.966118:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4daa180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518591.968149:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627628800 00000100:00100000:2.0:1789518591.968162:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627628800 00000100:00100000:2.0:1789518591.968283:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518591.968295:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627628800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518591.968585:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627628800:12345-0@lo:502:mount.lustre.0 Request processed in 291us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518591.968603:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518591.968852:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627628800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789518591.968977:0:36530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 224 off15224 00000040:00080000:0.0:1789518591.968993:0:36530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789518591.972903:0:36553:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789518591.972919:0:36553:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99fff4203380) 00000020:00000080:3.0:1789518591.972941:0:36553:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789518591.973023:0:36553:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffed4de000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518591.973028:0:36553:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffed4de000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789518591.973031:0:36553:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffed4de000 3 00010000:00080000:3.0:1789518591.973068:0:36553:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffed5a2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518591.975010:0:36553:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789518591.975239:0:36553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789518591.975277:0:36553:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518591.975290:0:36553:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x631fd8698c785304 00000100:00080000:3.0:1789518591.975300:0:36553:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518591.975311:0:36553:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99ffed5a2800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518591.975349:0:36553:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffed746300 x1876445627628928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518591.975377:0:36553:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518591.975590:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627628928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518591.975702:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518591.975784:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627628928 00000100:00100000:0.0:1789518591.975792:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627628928 00000100:00100000:0.0:1789518591.975831:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518591.975839:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3279:x1876445627628928:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789518591.975865:0:35846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:0.0:1789518591.975905:0:35846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x631fd8698c78530b 00000004:00100000:0.0:1789518591.975920:0:35846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789518591.975953:0:35846:0:(import.c:65:import_set_state_nolock()) ffff99ffd1030800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518591.976018:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1876445627628928:12345-0@lo:38:llog_process_th.0 Request processed in 178us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.976026:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789518591.976051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518591.976056:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789518591.976059:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518591.976062:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789518591.976109:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627629056:0@lo:400:kworker.0 00010000:00080000:1.0:1789518591.976138:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffed746300 x1876445627628928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518591.976150:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518591.976152:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518591.976162:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 7 00000100:00080000:1.0:1789518591.976170:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789518591.976175:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518591.976185:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffed5a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518591.976195:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1876445627628928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789518591.976199:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627629056 00000100:00100000:0.0:1789518591.976205:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627629056 00000100:00100000:0.0:1789518591.976250:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518591.976257:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627629056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518591.976301:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627629056:12345-0@lo:400:kworker.0 Request processed in 45us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518591.976308:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789518591.976337:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99fff78ab480 x1876445627629056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518591.976347:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627629056:0@lo:400:kworker.0 00000040:00080000:3.0:1789518591.978070:0:36553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00000020:01000000:2.0:1789518591.978608:0:36530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789518591.978653:0:36530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789518591.978667:0:36530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bde00/0x631fd8698c7852ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852f6 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518591.978678:0:36530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bde00/0x631fd8698c7852ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7852f6 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789518591.978724:0:36530:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789518591.978726:0:36530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518591.978728:0:36530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518591.978730:0:36530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518591.978731:0:36530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518591.978732:0:36530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518591.978733:0:36530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518591.978735:0:36530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518591.978737:0:36530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518591.978740:0:36530:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789518591.978752:0:36530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518591.978754:0:36530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518591.978755:0:36530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518591.978756:0:36530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518591.978757:0:36530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518591.978758:0:36530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518591.978759:0:36530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518591.978760:0:36530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518591.978761:0:36530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789518591.978794:0:36530:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789518591.978812:0:36530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627629184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789518591.978877:0:36530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518591.978911:0:36530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d43780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518591.978984:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627629184 00000100:00100000:1.0:1789518591.978991:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627629184 00000100:00100000:1.0:1789518591.979042:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518591.979052:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:36530:x1876445627629184:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789518591.979084:0:35840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789518591.979099:0:35840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789518592.002068:0:35840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789518592.002090:0:35840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789518592.002178:0:35861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789518592.002184:0:35861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789518592.002220:0:35861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.002237:0:35861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785278 expref: 16 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.002245:0:35861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.002282:0:35861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c785278 expref: 16 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.002294:0:35861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c785278 expref: 16 pid: 35839 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518592.002307:0:35861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35861:1876445627629312:0@lo:104: 00000100:00100000:2.0:1789518592.002369:0:35861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518592.002426:0:35861:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518592.002685:0:35882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627629312 00000100:00100000:3.0:1789518592.002694:0:35882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627629312 00000100:00100000:3.0:1789518592.002759:0:35882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518592.002769:0:35882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3d183546-773a-47ec-8f5a-25077d1135e5+3:35861:x1876445627629312:12345-0@lo:104: 00010000:00010000:3.0:1789518592.002784:0:35882:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518592.002856:0:35882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518592.002863:0:35882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3d183546-773a-47ec-8f5a-25077d1135e5+3:35861:x1876445627629312:12345-0@lo:104: Request processed in 96us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518592.002870:0:35882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518592.002882:0:35861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35861:1876445627629312:0@lo:104: 00010000:00010000:0.0:1789518592.002907:0:35861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518592.003217:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518592.003225:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518592.003233:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:1.0:1789518592.003238:0:35833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518592.003247:0:35833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789518592.003253:0:35833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789518592.003259:0:35833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789518592.003288:0:35833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518592.003294:0:35833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789518592.003396:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627629440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518592.003431:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518592.003485:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627629440 00010000:00010000:1.0:1789518592.003488:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518592.003491:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627629440 00010000:00010000:1.0:1789518592.003507:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bd800/0x631fd8698c785278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78527f expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003525:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785278 expref: 17 pid: 35839 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518592.003526:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518592.003529:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518592.003532:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518592.003557:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518592.003567:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+17:3283:x1876445627629440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518592.003579:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518592.003584:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785278 expref: 17 pid: 35839 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003595:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c785278 expref: 17 pid: 35839 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003648:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd000/0x631fd8698c78527f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c785278 expref: 17 pid: 35839 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003663:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003671:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789518592.003685:0:35830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001502912s 00010000:00010000:2.0:1789518592.003690:0:35830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003698:0:35830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003705:0:35830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003713:0:35830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003719:0:35830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518592.003723:0:35830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003731:0:35830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003770:0:35830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518592.003786:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518592.003819:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+16:3283:x1876445627629440:12345-0@lo:103:ldlm_bl.0 Request processed in 255us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518592.003827:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789518592.003861:0:35861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518592.003869:0:35861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518592.003876:0:35861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc14c000/0x631fd8698c785312 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518592.004010:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627629440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518592.012840:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+15:36530:x1876445627629184:12345-0@lo:253:mount.lustre.0 Request processed in 33781us (33955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518592.012855:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518592.012944:0:36530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:36530:1876445627629184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789518592.012960:0:36530:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789518592.012963:0:36530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518592.012965:0:36530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789518592.012966:0:36530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518592.012967:0:36530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518592.012969:0:36530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518592.012970:0:36530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518592.012971:0:36530:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518592.012973:0:36530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518592.012974:0:36530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789518592.012990:0:36530:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789518592.013839:0:36530:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518592.014006:0:36530:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518592.014151:0:36530:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518592.014372:0:36530:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518592.014516:0:36530:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518592.014754:0:36530:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789518592.016828:0:36530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771072 00002000:00080000:0.0:1789518592.045227:0:36530:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789518592.045235:0:36530:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789518592.045266:0:36530:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789518592.045372:0:36530:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789518592.045387:0:36530:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789518592.045412:0:36530:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789518592.885524:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789518593.524397:0:35842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789518593.524408:0:35842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99fff4010800 from 22 10000000:01000000:1.0:1789518593.524415:0:35842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789518593.524474:0:35842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518593.524487:0:35842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518593.524500:0:35842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518593.524530:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627629568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789518593.524767:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518593.524806:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627629568 00000100:00100000:0.0:1789518593.524846:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627629568 00000100:00100000:1.0:1789518593.524854:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc1254300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518593.524914:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789518593.524925:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+15:35842:x1876445627629568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518593.524955:0:35837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518593.525270:0:35837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c785319 expref: -99 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518593.525303:0:35837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c785319 expref: 16 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518593.525316:0:35837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785319 expref: 16 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518593.525327:0:35837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd200, rc 0) 00000100:00100000:0.0:1789518593.525387:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+16:35842:x1876445627629568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 464us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518593.525395:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789518593.525809:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627629568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518593.525838:0:35842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518593.525847:0:35842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518593.525906:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627629696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789518593.525946:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518593.525977:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc1254300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518593.526045:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627629696 00000100:00100000:0.0:1789518593.526051:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627629696 00000100:00100000:0.0:1789518593.527004:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789518593.527028:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:35842:x1876445627629696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789518593.527057:0:35840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789518593.527079:0:35840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789518593.527082:0:35840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 22 00000100:00100000:0.0:1789518593.527216:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:35842:x1876445627629696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518593.527225:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518593.527364:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627629696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518593.527443:0:35842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518593.527454:0:35842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518593.527516:0:35842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518593.907309:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518594.034681:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518584/real 1789518584] req@ffff99ffed747800 x1876445627623168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518594 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518594.034709:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffed747800 x1876445627623168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518594 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518594.034719:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789518584/real 1789518584] req@ffff99ffed746680 x1876445627623040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518594 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518594.034731:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffed746680 x1876445627623040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789518594 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789518594.034760:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffdf989800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518594.034782:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789518594.034786:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627623168:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789518594.034799:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffff2cf000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789518594.034806:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789518594.034809:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627623040:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789518594.035465:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518594.035470:0:19561:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789518594.035472:0:19561:0:(import.c:65:import_set_state_nolock()) ffff99ffff2cf000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518594.035478:0:19561:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:3.0:1789518594.035483:0:19561:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789518594.035495:0:19561:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffff2cf000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1789518594.035509:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627629824:0@lo:400:kworker.0 00000100:00100000:3.0:1789518594.035518:0:19561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffed746d80 x1876445627629952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518594.035570:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518594.035649:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627629824 00000100:00100000:2.0:1789518594.035657:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627629824 00000100:00100000:2.0:1789518594.035694:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518594.035702:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+16:3280:x1876445627629824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518594.035761:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+16:3280:x1876445627629824:12345-0@lo:400:kworker.0 Request processed in 59us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518594.035769:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789518594.035810:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627629824:0@lo:400:kworker.0 00000100:00080000:3.0:1789518594.035854:0:19561:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789518594.035858:0:19561:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789518594.035860:0:19561:0:(import.c:65:import_set_state_nolock()) ffff99ffdf989800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789518594.035864:0:19561:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:3.0:1789518594.035868:0:19561:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1789518594.035872:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627629952:0@lo:8:kworker.0 00000100:00080000:3.0:1789518594.035876:0:19561:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffdf989800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518594.035902:0:19561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffed745880 x1876445627630080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789518594.035913:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518594.035947:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627629952 00000100:00100000:2.0:1789518594.035953:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627630080:0@lo:8:kworker.0 00000100:00100000:0.0:1789518594.035953:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627629952 00000100:00100000:3.0:1789518594.035973:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627630336:0@lo:400:kworker.0 00000100:00100000:2.0:1789518594.035981:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518594.035983:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518594.035988:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627629952:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789518594.036003:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518594.036010:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627630208:0@lo:400:kworker.0 00010000:00080000:0.0:1789518594.036010:0:36531:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 648 last 0 00000100:00100000:3.0:1789518594.036031:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789518594.036036:0:36531:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c785327 00002000:00100000:0.0:1789518594.036049:0:36531:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99ffd1030000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789518594.036053:0:36531:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789518594.036055:0:36531:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789518594.036066:0:36532:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518594.036073:0:36532:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789518594.036177:0:36533:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789518594.036189:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627630080 00000100:00100000:2.0:1789518594.036195:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627630080 00000100:00100000:3.0:1789518594.036221:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627630336 00000100:00100000:3.0:1789518594.036231:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627630336 00000100:00100000:3.0:1789518594.036278:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518594.036286:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627630336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518594.036329:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627630336:12345-0@lo:400:kworker.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518594.036336:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789518594.036358:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1789518594.036400:0:36531:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789518594.036420:0:36531:0:(import.c:65:import_set_state_nolock()) ffff99ffd1032800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518594.036463:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627629952:12345-0@lo:8:kworker.0 Request processed in 473us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518594.036470:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518594.036483:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789518594.036487:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627630080:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789518594.036498:0:36531:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789518594.036536:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627630208 00000100:00100000:1.0:1789518594.036541:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627630208 00000100:00100000:1.0:1789518594.036569:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518594.036576:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627630208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518594.036633:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627630208:12345-0@lo:400:kworker.0 Request processed in 37us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518594.036640:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789518594.036766:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789518594.036794:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffed744700 x1876445627630336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518594.036806:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627630336:0@lo:400:kworker.0 00010000:00080000:3.0:1789518594.036834:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffed747100 x1876445627630208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518594.036843:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627630208:0@lo:400:kworker.0 00010000:00080000:2.0:1789518594.037168:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffed746d80 x1876445627629952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518594.037190:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789518594.037197:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 7 00000100:00080000:2.0:1789518594.037204:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789518594.037209:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789518594.037211:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffff2cf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789518594.037233:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789518594.037239:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627629952:0@lo:8:kworker.0 00000004:00080000:2.0:1789518594.037259:0:35867:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789518594.037358:0:35868:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0xa4:0x0] 00000100:00100000:3.0:1789518594.037377:0:35868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35868:1876445627630592:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789518594.037414:0:35868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518594.037433:0:35868:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789518594.037444:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518594.037451:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627630464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518594.037490:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789518594.037531:0:35867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648033916229ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789518594.037553:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627630464 00000100:00100000:3.0:1789518594.037559:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627630464 00000100:00100000:2.0:1789518594.037567:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627630592 00000100:00100000:2.0:1789518594.037573:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627630592 00000100:00100000:3.0:1789518594.037601:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518594.037609:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789518594.037639:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627630464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518594.037662:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518594.037700:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627630464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518594.037706:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789518594.037722:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789518594.037752:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffed747100 x1876445627630464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518594.037767:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627630464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518594.037826:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:35868:x1876445627630592:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789518594.042948:0:36532:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789518594.042958:0:36532:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -29 00002000:02000040:2.0:1789518594.042964:0:36532:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:165 to 0x240000400:193) 00000100:00100000:0.0:1789518594.049427:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627630080:12345-0@lo:8:kworker.0 Request processed in 12932us (13441us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789518594.049440:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789518594.049925:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffdf989800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518594.049932:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789518594.049937:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627630080:0@lo:8:kworker.0 00002000:00010000:2.0:1789518594.058135:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.058147:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058163:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.058167:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.058173:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058191:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058208:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058216:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058234:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518594.058246:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518594.058252:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058259:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518594.058264:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058273:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058445:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058454:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78532e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.058470:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.058478:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.058480:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.061242:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.061254:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.061270:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.061275:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.061280:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.061295:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.061305:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.061312:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.061332:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518594.061344:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518594.061349:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.061357:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518594.061361:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.061381:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.062779:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.062792:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785335 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.062811:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.062813:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.062815:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.063901:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.063909:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.063922:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.063926:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.063932:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.063944:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.063953:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.063968:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.063986:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518594.063996:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518594.064001:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064009:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518594.064013:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064022:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064037:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064045:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78533c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064064:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.064066:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.064068:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.064658:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.064671:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064681:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbe:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.064685:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.064807:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064819:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064828:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064836:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064853:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518594.064862:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518594.064867:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064875:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14da00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518594.064878:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064886:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064909:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064916:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785343 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.064932:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.064934:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.064936:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.065533:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.065540:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.065548:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.065551:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.065556:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.065565:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.065572:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.065579:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.066089:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518594.066146:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518594.066155:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.066166:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518594.066171:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.066180:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.066209:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.066217:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78534a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.066244:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518594.066247:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518594.066249:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.067131:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.067139:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.067152:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.067156:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.067161:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.067171:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.067179:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.067186:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.067207:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518594.067363:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518594.067370:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.067379:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518594.067406:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.067415:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.067430:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.067438:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785351 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.067469:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518594.067472:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518594.067475:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.069780:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.069791:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.069806:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.069816:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.069822:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.069837:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.069847:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.069855:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.069884:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789518594.070011:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1789518594.070389:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.070397:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.070406:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14da00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.070411:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.070420:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518594.070425:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.070430:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.070437:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1789518594.070438:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.070440:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.070445:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.070457:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c785358 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.070476:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.070479:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.070481:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.070718:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.070727:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.070763:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.070785:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518594.070925:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518594.070933:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518594.070953:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518594.070957:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518594.070965:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518594.070978:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518594.070984:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c78535f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518594.070998:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518594.071000:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518594.071001:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.071458:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.071464:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.071474:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.071477:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.071481:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.071492:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.071500:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.071508:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.071563:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518594.071793:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.071798:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.071804:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.071807:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.071813:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.071823:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.071827:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c785366 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.071841:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.071843:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.071849:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.072244:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.072250:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072264:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.072267:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.072272:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072282:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072291:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072304:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072326:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518594.072664:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518594.072670:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518594.072679:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518594.072683:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518594.072692:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518594.072711:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518594.072718:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c78536d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518594.072747:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518594.072749:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518594.072753:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518594.072755:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.072800:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072807:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.072810:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.072812:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072819:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072834:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072838:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.072855:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789518594.073417:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.073434:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073440:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.073442:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.073445:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073451:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073461:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073466:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073486:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789518594.073494:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518594.073497:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073501:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518594.073503:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073508:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073517:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073521:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c785374 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073531:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518594.073532:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073536:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14dc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518594.073539:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073552:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073558:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073562:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c78537b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.073570:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.073571:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.073573:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518594.073664:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.074657:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.074665:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.074677:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.074680:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.074684:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.074694:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.074702:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.074714:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.074746:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518594.074761:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.074769:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.074778:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.074782:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.074792:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.074806:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.074814:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c785382 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.074830:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.074832:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.074833:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.075697:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.075704:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.075714:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.075718:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.075722:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.075742:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.075751:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.075805:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.075827:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518594.076038:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.076046:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.076056:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14cc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.076062:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.076083:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.076097:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.076104:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c785389 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.076123:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.076125:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.076127:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.077263:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.077272:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077289:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.077293:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.077298:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077310:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077319:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077327:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077347:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518594.077359:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518594.077364:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077372:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518594.077376:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077385:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077408:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077416:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c785390 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.077435:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.077438:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.077440:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.079695:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.079706:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.079721:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.079725:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.079731:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.079761:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.079771:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.079779:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.079815:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518594.079875:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.079884:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.079895:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.079900:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.079910:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.079932:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.079952:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c785397 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.079970:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.079971:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.079973:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.080413:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.080492:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.080502:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb1:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.080506:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.080511:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.080520:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.080528:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.080535:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.080560:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789518594.081189:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.081196:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.081205:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.081214:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.081219:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.081229:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.081237:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.081244:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.081258:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789518594.082060:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.082067:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.082077:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.082080:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.082084:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.082095:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.082102:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.082118:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.082127:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789518594.082902:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789518594.082911:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.082920:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14de00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.082925:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.082934:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.082950:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.082958:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e83488/0x631fd8698c78539e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.082977:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518594.082980:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.082994:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.082996:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083003:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083014:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083021:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b70671a1/0x631fd8698c7853a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083032:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.083035:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083041:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14ca00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.083043:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083049:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083058:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083073:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7853ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083088:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.083089:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.083091:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.083104:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.083769:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.083777:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.083788:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.083792:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.083797:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.083859:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.083869:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.083876:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.083893:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518594.083932:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.083938:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083947:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.083951:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083959:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083972:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083979:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b754b6bf/0x631fd8698c7853b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.083996:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.083999:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.084008:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.084384:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.084391:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.084408:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.084412:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.084416:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.084493:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.084502:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.084507:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.084522:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518594.084692:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.084699:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.084707:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14da00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.084711:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.084721:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.084743:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.084751:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da25cd5/0x631fd8698c7853ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.084770:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.084772:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.084774:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.086299:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.086311:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.086325:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xac:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.086330:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.086334:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.086346:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.086368:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.086375:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.086389:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518594.086463:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.086471:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.086480:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14cc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.086485:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.086506:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.086523:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.086531:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009ff7f56/0x631fd8698c7853c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.086551:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.086553:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.086555:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.086934:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.086941:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.086950:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.086959:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.086964:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.086974:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.086983:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.086992:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.087031:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789518594.087478:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.087485:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.087494:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaa:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.087497:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.087501:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.087511:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.087520:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.087528:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.087556:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789518594.088059:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.088066:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088075:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa9:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.088085:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.088090:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088100:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088109:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088117:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088127:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789518594.088573:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.088580:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088589:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.088592:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.088596:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088606:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088638:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088653:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.088663:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789518594.089072:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789518594.089080:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089088:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14dc00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.089092:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089102:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089121:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089143:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a502c38/0x631fd8698c7853c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.089144:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789518594.089169:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789518594.089173:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089181:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.089184:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089193:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089204:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089210:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000674a6423/0x631fd8698c7853d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089222:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.089226:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089232:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.089242:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089250:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089261:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089269:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb3a80ec/0x631fd8698c7853dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.089282:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.089284:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.089286:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789518594.089923:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.089930:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.089939:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.089943:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.089946:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.089956:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.089964:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.089970:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.090162:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789518594.090580:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.090586:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.090603:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1789518594.090655:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.090662:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.090669:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.090673:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.090681:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.090695:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.090708:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb277711/0x631fd8698c7853e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.090724:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.090725:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.090728:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.090776:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.090779:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.090782:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518594.090850:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.090860:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518594.090864:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.090877:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.090890:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.090896:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d9015b/0x631fd8698c7853cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.090900:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.090905:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518594.090911:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518594.090913:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518594.090915:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.090916:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.090924:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.090931:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.090951:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789518594.091377:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518594.091383:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091391:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=648s v=(0 0) 00010000:00010000:2.0:1789518594.091394:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518594.091398:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091408:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091427:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091434:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091448:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1789518594.091599:0:36532:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:164 00000100:00100000:2.0:1789518594.091712:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:35868:x1876445627630592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 53885us (54293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518594.091726:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789518594.091766:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789518594.091770:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518594.091774:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091777:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.091788:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518594.091795:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091796:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5000 already unused, calling callback (ffffffffc15168b0) 00000100:00100000:0.0:1789518594.091799:0:35868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35868:1876445627630592:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1789518594.091813:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518594.091820:0:35868:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0xc1:0x0] from OST, last_created [0x240000400:0xc1:0x0]last_used is [0x240000400:0xa4:0x0] 00010000:00010000:3.0:1789518594.091827:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518594.091840:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af196085/0x631fd8698c7853eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518594.091864:0:35868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35868:1876445627630720:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1789518594.091869:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.091872:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518594.091873:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518594.091901:0:35868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789518594.091905:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091916:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091927:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518594.091940:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e1aaf58/0x631fd8698c7853f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518594.091950:0:35868:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4f15d80 going to sleep for 11 seconds 00010000:00010000:2.0:1789518594.091952:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.091955:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518594.091958:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518594.091977:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627630720 00000100:00100000:3.0:1789518594.091985:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627630720 00000100:00100000:3.0:1789518594.092031:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518594.092040:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:35868:x1876445627630720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789518594.092073:0:36533:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 194 00000100:00100000:3.0:1789518594.097146:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:35868:x1876445627630720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5102us (5239us total) trans 30064771073 rc 0/0 00000100:00100000:3.0:1789518594.097158:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518594.097365:0:35868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35868:1876445627630720:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789518594.097380:0:35868:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xc1:0x0]-[0x240000400:0xe1:0x0] 00010000:00010000:1.0:1789518594.930719:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518595.320935:0:36899:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789518595.957759:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518596.146883:0:35881:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1789518596.146895:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518596.147248:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 2 00000040:00080000:3.0:1789518596.147257:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1789518596.978784:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789518597.274478:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789518597.274542:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771073 is committed 00010000:00010000:1.0:1789518598.003737:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518599.028568:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789518599.283902:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789518599.283908:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789518599.283911:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ffdf989800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789518599.283918:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:1.0:1789518599.283923:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789518599.283933:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffdf989800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1789518599.283953:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff7a7a680 x1876445627631232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789518599.284001:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627630848:0@lo:400:kworker.0 00000100:00100000:1.0:1789518599.284058:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518599.284096:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627630976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518599.284125:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518599.284141:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627631360:0@lo:400:kworker.0 00000100:00100000:1.0:1789518599.284159:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518599.284164:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627631104:0@lo:400:kworker.0 00000100:00100000:3.0:1789518599.284170:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518599.284182:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518599.284189:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518599.284194:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627631488:0@lo:400:kworker.0 00000100:00100000:3.0:1789518599.284212:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518599.284219:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627631360 00000100:00100000:1.0:1789518599.284226:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627631360 00000100:00100000:0.0:1789518599.284361:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627631232:0@lo:8:kworker.0 00000100:00100000:0.0:1789518599.284388:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518599.284415:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627630848 00000100:00100000:0.0:1789518599.284419:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627630848 00000100:00100000:0.0:1789518599.284445:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789518599.284460:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:3280:x1876445627630848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518599.284504:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:3280:x1876445627630848:12345-0@lo:400:kworker.0 Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518599.284511:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789518599.284547:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627631104 00000100:00100000:0.0:1789518599.284550:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627631104 00000100:00100000:0.0:1789518599.284578:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627631232 00000100:00100000:0.0:1789518599.284581:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627631232 00000100:00100000:0.0:1789518599.284594:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789518599.284600:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627631104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518599.284646:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627631104:12345-0@lo:400:kworker.0 Request processed in 45us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518599.284652:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518599.284662:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627630976 00000100:00100000:0.0:1789518599.284663:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518599.284666:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627630976 00000100:00100000:0.0:1789518599.284667:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627631232:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789518599.284681:0:36531:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789518599.284690:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789518599.284696:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627630976:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518599.284723:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627631232:12345-0@lo:8:kworker.0 Request processed in 40us (320us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789518599.284728:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00000024:2.0:1789518599.284733:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789518599.284745:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518599.284765:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627630976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518599.284770:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789518599.284985:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffdf989800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789518599.284990:0:3279:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789518599.284994:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627631232:0@lo:8:kworker.0 00000100:00100000:1.0:1789518599.285859:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627631488 00000100:00100000:1.0:1789518599.285865:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627631488 00000100:00100000:1.0:1789518599.285911:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518599.285921:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627631360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518599.285936:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771073 gen 2 00000100:00100000:0.0:1789518599.285947:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627631104:0@lo:400:kworker.0 00000100:00100000:0.0:1789518599.285958:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627630848:0@lo:400:kworker.0 00000100:00100000:0.0:1789518599.285981:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627630976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518599.286018:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627631360:12345-0@lo:400:kworker.0 Request processed in 99us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.286024:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518599.286247:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789518599.286253:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627631488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518599.287016:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627631488:12345-0@lo:400:kworker.0 Request processed in 761us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518599.287024:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789518599.287047:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789518599.287352:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fff7a78a80 x1876445627631360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518599.287366:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627631360:0@lo:400:kworker.0 00010000:00080000:3.0:1789518599.288009:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fff7a78380 x1876445627631488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789518615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518599.288020:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627631488:0@lo:400:kworker.0 00000020:01000004:3.0:1789518599.521977:0:37250:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789518599.521981:0:37250:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789518599.522093:0:37250:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ffc6496800 00000020:01000004:3.0:1789518599.522124:0:37250:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789518599.522135:0:37250:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789518599.522148:0:37250:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99fff4204d40) 00000020:00000080:3.0:1789518599.522163:0:37250:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789518599.540421:0:37250:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789518599.540788:0:37250:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789518599.541566:0:37250:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789518599.541943:0:37250:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789518599.542392:0:37250:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xf:0x0] (8/32) 00100000:10000000:2.0:1789518599.542866:0:37250:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 495: rc = 0 00100000:10000000:2.0:1789518599.543035:0:37250:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 495: rc = 0 00100000:10000000:2.0:1789518599.543138:0:37250:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 495: rc = 0 00100000:10000000:2.0:1789518599.543673:0:37250:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 770: rc = 0 00100000:10000000:2.0:1789518599.544088:0:37250:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:2.0:1789518599.544434:0:37250:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:2.0:1789518599.544780:0:37250:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 770: rc = 0 00100000:10000000:2.0:1789518599.545031:0:37250:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:2.0:1789518599.546414:0:37250:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 770: rc = 0 00000020:00000080:2.0:1789518599.547000:0:37250:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789518599.547013:0:37250:0:(osd_handler.c:1614:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789518599.547027:0:37250:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c785400 00000020:01000004:2.0:1789518599.547034:0:37250:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789518599.547058:0:37250:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789518599.547063:0:37250:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789518599.547070:0:37250:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789518599.547095:0:37250:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789518599.547100:0:37250:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789518599.554942:0:37250:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789518599.554987:0:37250:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.151@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789518599.554992:0:37250:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789518599.554994:0:37250:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518599.554995:0:37250:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518599.554997:0:37250:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518599.554998:0:37250:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518599.554999:0:37250:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518599.555001:0:37250:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518599.555003:0:37250:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518599.555004:0:37250:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789518599.555008:0:37250:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789518599.555010:0:37250:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789518599.555012:0:37250:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518599.555012:0:37250:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518599.555014:0:37250:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518599.555015:0:37250:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518599.555016:0:37250:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518599.555017:0:37250:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518599.555018:0:37250:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518599.555018:0:37250:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789518599.555044:0:37250:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789518599.555070:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627631616:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789518599.555145:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518599.555271:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6926300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518599.555335:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627631616 00000100:00100000:3.0:1789518599.555344:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627631616 00000100:00100000:3.0:1789518599.555396:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789518599.555405:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+16:37250:x1876445627631616:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518599.555439:0:35839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789518599.555443:0:35839:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789518599.555447:0:35839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789518599.566066:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+16:37250:x1876445627631616:12345-0@lo:253:mount.lustre.0 Request processed in 10651us (10910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.566105:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789518599.566200:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627631616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789518599.566215:0:37250:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789518599.566219:0:37250:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789518599.566220:0:37250:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789518599.566222:0:37250:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789518599.566223:0:37250:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789518599.566224:0:37250:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789518599.566225:0:37250:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789518599.566227:0:37250:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789518599.566229:0:37250:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789518599.566230:0:37250:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789518599.566252:0:37250:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffc6496800 from lustre-OST0001 10000000:01000000:2.0:1789518599.566278:0:37250:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789518599.566281:0:37250:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789518599.566289:0:37250:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99fff42019c0 local copy 00010000:00010000:2.0:1789518599.566298:0:37250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518599.566531:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627631744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518599.566572:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518599.566607:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518599.566812:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627631744 00000100:00100000:0.0:1789518599.566819:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627631744 00000100:00100000:0.0:1789518599.566936:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518599.566946:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+16:37250:x1876445627631744:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518599.567095:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+16:37250:x1876445627631744:12345-0@lo:501:mount.lustre.0 Request processed in 150us (521us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518599.567102:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789518599.567175:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627631744:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789518599.567187:0:37250:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789518599.567323:0:37250:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789518599.567330:0:37250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.567351:0:37250:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1800/0x631fd8698c78519f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7851a6 expref: -99 pid: 35827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518599.567387:0:37250:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffc6496800 10000000:01000000:2.0:1789518599.567392:0:37250:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789518599.567396:0:37250:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789518599.567399:0:37250:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789518599.567403:0:37250:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789518599.567406:0:37250:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789518599.567426:0:37250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec26d5800/0x631fd8698c785407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.567434:0:37250:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec26d5800/0x631fd8698c785407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.567444:0:37250:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec26d5800/0x631fd8698c785407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518599.567457:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627631872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789518599.567482:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518599.567884:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518599.567969:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627631872 00000100:00100000:1.0:1789518599.567975:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627631872 00000100:00100000:1.0:1789518599.568000:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789518599.568006:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:37250:x1876445627631872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789518599.568015:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518599.568027:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e1000/0x631fd8698c78540e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c785407 expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518599.568048:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e1000/0x631fd8698c78540e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c785407 expref: 17 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518599.568059:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e1000/0x631fd8698c78540e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785407 expref: 17 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518599.568068:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1000, rc 0) 00000100:00100000:1.0:1789518599.568110:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627631872:12345-0@lo:101:mount.lustre.0 Request processed in 103us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.568117:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518599.568197:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627631872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789518599.568211:0:37250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec26d5800/0x631fd8698c785407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78540e expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.568220:0:37250:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec26d5800/0x631fd8698c785407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78540e expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518599.568796:0:37250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 11 count 11 00000040:00080000:2.0:1789518599.569855:0:37250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789518599.570012:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:2.0:1789518599.570043:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:2.0:1789518599.570061:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:2.0:1789518599.570084:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:2.0:1789518599.570108:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:2.0:1789518599.570125:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:2.0:1789518599.570149:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:2.0:1789518599.570180:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:2.0:1789518599.570302:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 120 off9752 00000040:00080000:2.0:1789518599.570349:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9976 00000040:00080000:2.0:1789518599.570404:0:37250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 10 count 11 00000100:00100000:2.0:1789518599.570467:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518599.570512:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518599.570552:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6926300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518599.570590:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627632000 00000100:00100000:1.0:1789518599.570596:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627632000 00000100:00100000:1.0:1789518599.570716:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789518599.570726:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627632000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789518599.570985:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627632000:12345-0@lo:501:mount.lustre.0 Request processed in 260us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.570992:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789518599.571014:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518599.571041:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789518599.571077:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518599.571095:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627632128 00000100:00100000:2.0:1789518599.571103:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6926300 going to sleep for 11 seconds 00000100:00100000:1.0:1789518599.571105:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627632128 00000100:00100000:1.0:1789518599.571163:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789518599.571170:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627632128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518599.571463:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627632128:12345-0@lo:503:mount.lustre.0 Request processed in 292us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.571470:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789518599.571485:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632128:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789518599.571933:0:37250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518599.571972:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518599.572002:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518599.572025:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6926300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518599.572043:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627632256 00000100:00100000:0.0:1789518599.572048:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627632256 00000100:00100000:0.0:1789518599.572084:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789518599.572092:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627632256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518599.572261:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627632256:12345-0@lo:502:mount.lustre.0 Request processed in 168us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518599.572268:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789518599.572394:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518599.572660:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:2.0:1789518599.572690:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:2.0:1789518599.572724:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:2.0:1789518599.572978:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:2.0:1789518599.573007:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:2.0:1789518599.573023:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:2.0:1789518599.573049:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:2.0:1789518599.573067:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:2.0:1789518599.573090:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 120 off9752 00000100:00100000:2.0:1789518599.573108:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518599.573138:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518599.573192:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627632384 00000100:00100000:1.0:1789518599.573198:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627632384 00000100:00100000:1.0:1789518599.573237:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518599.573244:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627632384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518599.573376:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627632384:12345-0@lo:502:mount.lustre.0 Request processed in 131us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.573383:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789518599.573547:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6926300 going to sleep for 11 seconds 00000100:00100000:2.0:1789518599.573559:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518599.573604:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9976 00000040:00080000:2.0:1789518599.573691:0:37250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789518599.574280:0:37251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789518599.574287:0:37251:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789518599.574293:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518599.574296:0:37251:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789518599.574301:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789518599.574323:0:37251:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99fec18cb380) 00000020:00000080:0.0:1789518599.574343:0:37251:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789518599.574350:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789518599.574408:0:37251:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc6496800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789518599.574416:0:37251:0:(osd_handler.c:1614:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789518599.574422:0:37251:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x631fd8698c78541c 00010000:00010000:0.0:1789518599.577887:0:37251:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789518599.578313:0:37251:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 25769803793 00080000:10000000:0.0:1789518599.579819:0:37251:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x10:0x0] (8/8/4) registered 00000020:00000080:3.0:1789518599.580931:0:37251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789518599.580943:0:37251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518599.580948:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518599.580950:0:37251:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789518599.580955:0:37251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518599.580959:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518599.580961:0:37251:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789518599.580971:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789518599.580973:0:37251:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789518599.580975:0:37251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518599.580977:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518599.580978:0:37251:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789518599.580980:0:37251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789518599.580989:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518599.580990:0:37251:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789518599.580994:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789518599.581038:0:37251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789518599.581041:0:37251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789518599.581043:0:37251:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789518599.581046:0:37251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 11 count 11 00000020:01000000:0.0:1789518599.581319:0:37250:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789518599.581344:0:37250:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789518599.581373:0:37250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec26d5800/0x631fd8698c785407 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78540e expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.581387:0:37250:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec26d5800/0x631fd8698c785407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78540e expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518599.581396:0:37250:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc6496800 from 1 10000000:01000000:0.0:1789518599.581399:0:37250:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518599.581432:0:37250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.581440:0:37250:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.581452:0:37250:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518599.581475:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789518599.581534:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518599.581574:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627632512 00000100:00100000:3.0:1789518599.581582:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627632512 00000100:00100000:0.0:1789518599.581589:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1b57000 going to sleep for 11 seconds 00000100:00100000:3.0:1789518599.581658:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518599.581668:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+17:37250:x1876445627632512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518599.581681:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518599.581695:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c785423 expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518599.581732:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c785423 expref: 18 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518599.581743:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785423 expref: 18 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518599.581751:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981000, rc 0) 00000100:00100000:3.0:1789518599.581809:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627632512:12345-0@lo:101:mount.lustre.0 Request processed in 144us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518599.581816:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789518599.581903:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518599.581920:0:37250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.581931:0:37250:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518599.582723:0:37250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000040:00080000:0.0:1789518599.583136:0:37250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789518599.583409:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:0.0:1789518599.583454:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:0.0:1789518599.583584:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:0.0:1789518599.583647:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:0.0:1789518599.583690:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:0.0:1789518599.583754:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:0.0:1789518599.583790:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 224 off9536 00000040:00080000:0.0:1789518599.583824:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 128 off9664 00000040:00080000:0.0:1789518599.583892:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9888 00000040:00080000:0.0:1789518599.583899:0:37250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 9 count 10 00000100:00100000:0.0:1789518599.583972:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518599.584102:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518599.584199:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1b57000 going to sleep for 11 seconds 00000100:00100000:2.0:1789518599.584241:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627632640 00000100:00100000:2.0:1789518599.584248:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627632640 00000100:00100000:2.0:1789518599.584291:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789518599.584299:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627632640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789518599.585968:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627632640:12345-0@lo:501:mount.lustre.0 Request processed in 1667us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518599.585978:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789518599.586467:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789518599.586515:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789518599.586583:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518599.586640:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1b57000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518599.586964:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627632768 00000100:00100000:1.0:1789518599.586971:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627632768 00000100:00100000:1.0:1789518599.587004:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518599.587012:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627632768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789518599.587358:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627632768:12345-0@lo:503:mount.lustre.0 Request processed in 345us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.587367:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789518599.587522:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789518599.588107:0:37250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789518599.588176:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518599.588227:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518599.588274:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518599.588352:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627632896 00000100:00100000:1.0:1789518599.588359:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627632896 00000100:00100000:1.0:1789518599.588400:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789518599.588409:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627632896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789518599.588580:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627632896:12345-0@lo:502:mount.lustre.0 Request processed in 172us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.588596:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789518599.588941:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627632896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518599.589245:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:2.0:1789518599.589304:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:2.0:1789518599.589399:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:2.0:1789518599.589476:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:2.0:1789518599.589594:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000040:00080000:2.0:1789518599.589667:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:2.0:1789518599.589702:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 224 off9536 00000040:00080000:2.0:1789518599.589752:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 128 off9664 00000100:00100000:2.0:1789518599.589780:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789518599.589826:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518599.589856:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789518599.589868:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627633024 00000100:00100000:0.0:1789518599.589875:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627633024 00000100:00100000:0.0:1789518599.589905:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789518599.589921:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627633024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518599.590096:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627633024:12345-0@lo:502:mount.lustre.0 Request processed in 177us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518599.590110:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789518599.590276:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789518599.590372:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9888 00000040:00080000:2.0:1789518599.590384:0:37250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789518599.592058:0:37255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518599.592068:0:37255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518599.592070:0:37255:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789518599.592078:0:37255:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc6496800 00000020:00000080:0.0:1789518599.592080:0:37255:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518599.592086:0:37255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518599.592089:0:37255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518599.592090:0:37255:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789518599.592092:0:37255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518599.592094:0:37255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518599.592096:0:37255:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789518599.592099:0:37255:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc6496800 00000020:00000080:0.0:1789518599.592101:0:37255:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518599.592156:0:37255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518599.592160:0:37255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518599.592162:0:37255:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789518599.592164:0:37255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789518599.592166:0:37255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518599.592168:0:37255:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789518599.592180:0:37255:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffc6496800 00000020:00000080:0.0:1789518599.592183:0:37255:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789518599.592217:0:37255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789518599.592221:0:37255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789518599.592222:0:37255:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789518599.592225:0:37255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 10 count 10 00000020:01000000:3.0:1789518599.592296:0:37250:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789518599.592322:0:37250:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518599.592399:0:37250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518599.592410:0:37250:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518599.592462:0:37250:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789518599.592465:0:37250:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffc6496800 10000000:01000000:3.0:1789518599.592468:0:37250:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffc6496800 10000000:01000000:3.0:1789518599.592472:0:37250:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789518599.592478:0:37250:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ffc6496800 from 1 10000000:01000000:3.0:1789518599.592481:0:37250:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789518599.592574:0:37250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c785431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518599.592583:0:37250:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c785431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518599.592593:0:37250:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c785431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518599.592635:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789518599.592691:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518599.592752:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee68c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518599.592756:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627633152 00000100:00100000:0.0:1789518599.592763:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627633152 00000100:00100000:0.0:1789518599.592808:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789518599.592820:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627633152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789518599.592830:0:35837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518599.592841:0:35837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bd800/0x631fd8698c785438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c785431 expref: -99 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.592860:0:35837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bd800/0x631fd8698c785438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c785431 expref: 19 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.592867:0:35837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bd800/0x631fd8698c785438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785431 expref: 19 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.592873:0:35837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd800, rc 0) 00000100:00100000:0.0:1789518599.592918:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633152:12345-0@lo:101:mount.lustre.0 Request processed in 98us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518599.592926:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518599.592942:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789518599.592958:0:37250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c785431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785438 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518599.592967:0:37250:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c785431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c785438 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518599.593848:0:37250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000040:00080000:3.0:1789518599.594870:0:37250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789518599.595748:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:3.0:1789518599.595811:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:3.0:1789518599.595847:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:3.0:1789518599.595922:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:3.0:1789518599.595970:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:3.0:1789518599.596033:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:3.0:1789518599.596086:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:3.0:1789518599.596139:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:3.0:1789518599.596210:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:3.0:1789518599.596262:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:3.0:1789518599.596311:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:3.0:1789518599.596365:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:3.0:1789518599.596406:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:3.0:1789518599.596443:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:3.0:1789518599.596722:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:3.0:1789518599.596791:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:3.0:1789518599.596853:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:3.0:1789518599.596949:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:3.0:1789518599.596997:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:3.0:1789518599.597057:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:3.0:1789518599.597133:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:3.0:1789518599.597193:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:3.0:1789518599.597238:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:3.0:1789518599.597310:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:3.0:1789518599.597371:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 128 off12440 00000040:00080000:3.0:1789518599.597437:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12664 00000040:00080000:3.0:1789518599.597644:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12888 00000040:00080000:3.0:1789518599.597807:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off12968 00000040:00080000:3.0:1789518599.597875:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13192 00000040:00080000:3.0:1789518599.597967:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13416 00000040:00080000:3.0:1789518599.598037:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13504 00000040:00080000:3.0:1789518599.598096:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13632 00000040:00080000:3.0:1789518599.598154:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13776 00000040:00080000:3.0:1789518599.598217:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13904 00000040:00080000:3.0:1789518599.598267:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14128 00000040:00080000:3.0:1789518599.598334:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14352 00000040:00080000:3.0:1789518599.598373:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14432 00000040:00080000:3.0:1789518599.598411:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14656 00000040:00080000:3.0:1789518599.598461:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14880 00000040:00080000:3.0:1789518599.600772:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 120 off15000 00000040:00080000:3.0:1789518599.601061:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 224 off15224 00000040:00080000:3.0:1789518599.601070:0:37250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 41 count 42 00000100:00100000:3.0:1789518599.601362:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518599.601426:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518599.601477:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627633280 00000100:00100000:3.0:1789518599.601484:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627633280 00000100:00100000:3.0:1789518599.601541:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518599.601552:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633280:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518599.602326:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633280:12345-0@lo:501:mount.lustre.0 Request processed in 772us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518599.602336:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789518599.602445:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee68c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518599.602472:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789518599.602514:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518599.602562:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518599.602591:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627633408 00000100:00100000:3.0:1789518599.602596:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627633408 00000100:00100000:3.0:1789518599.602993:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518599.603004:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789518599.603318:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633408:12345-0@lo:503:mount.lustre.0 Request processed in 313us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518599.603342:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789518599.603414:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee68c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518599.603437:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633408:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789518599.604242:0:37250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789518599.604330:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518599.604396:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518599.604432:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627633536 00000100:00100000:3.0:1789518599.604438:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627633536 00000100:00100000:3.0:1789518599.604477:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789518599.604487:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518599.604743:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633536:12345-0@lo:502:mount.lustre.0 Request processed in 257us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518599.604752:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789518599.604809:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee68c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518599.604826:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789518599.605150:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:3.0:1789518599.605212:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:3.0:1789518599.605261:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:3.0:1789518599.605323:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:3.0:1789518599.605371:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:3.0:1789518599.605448:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:3.0:1789518599.605514:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:3.0:1789518599.605598:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:3.0:1789518599.606406:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:3.0:1789518599.606478:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:3.0:1789518599.606543:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:3.0:1789518599.606606:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:3.0:1789518599.608940:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:3.0:1789518599.608995:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:3.0:1789518599.609082:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:3.0:1789518599.609146:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:3.0:1789518599.609196:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:3.0:1789518599.609255:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:3.0:1789518599.609308:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:3.0:1789518599.609357:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:3.0:1789518599.609423:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:3.0:1789518599.609467:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:3.0:1789518599.609507:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:3.0:1789518599.609583:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:3.0:1789518599.609660:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 128 off12440 00000040:00080000:3.0:1789518599.609722:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12664 00000040:00080000:3.0:1789518599.609775:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12888 00000040:00080000:3.0:1789518599.609816:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off12968 00000040:00080000:3.0:1789518599.609860:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13192 00000040:00080000:3.0:1789518599.609919:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13416 00000040:00080000:3.0:1789518599.609959:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13504 00000040:00080000:3.0:1789518599.610000:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13632 00000040:00080000:3.0:1789518599.610037:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13776 00000040:00080000:3.0:1789518599.610092:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13904 00000040:00080000:3.0:1789518599.610138:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14128 00000040:00080000:3.0:1789518599.610194:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14352 00000040:00080000:3.0:1789518599.610240:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14432 00000040:00080000:3.0:1789518599.610283:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14656 00000040:00080000:3.0:1789518599.610355:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14880 00000040:00080000:3.0:1789518599.610408:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 120 off15000 00000100:00100000:3.0:1789518599.610457:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789518599.610541:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518599.610593:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4924cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518599.610812:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627633664 00000100:00100000:0.0:1789518599.610820:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627633664 00000100:00100000:0.0:1789518599.610889:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789518599.610900:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789518599.611149:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633664:12345-0@lo:502:mount.lustre.0 Request processed in 251us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518599.611157:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789518599.611193:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789518599.611325:0:37250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 224 off15224 00000040:00080000:1.0:1789518599.611343:0:37250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789518599.612433:0:37260:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789518599.612454:0:37260:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99ffc64a4d40) 00000020:00000080:3.0:1789518599.612477:0:37260:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789518599.612563:0:37260:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc6496800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789518599.612568:0:37260:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc6496800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789518599.612571:0:37260:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc6496800 3 00010000:00080000:3.0:1789518599.612635:0:37260:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fec1e4e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1789518599.616468:0:37260:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789518599.616727:0:37260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789518599.616769:0:37260:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789518599.616783:0:37260:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x631fd8698c785446 00000100:00080000:3.0:1789518599.616798:0:37260:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789518599.616811:0:37260:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fec1e4e800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1789518599.616848:0:37260:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffed746a00 x1876445627633792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789518599.616875:0:37260:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789518599.617016:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627633792:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789518599.617091:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518599.617147:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627633792 00000100:00100000:1.0:1789518599.617154:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627633792 00000100:00100000:1.0:1789518599.617186:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518599.617194:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1876445627633792:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789518599.617215:0:35847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:1.0:1789518599.617274:0:35847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x631fd8698c78544d 00000004:00100000:1.0:1789518599.617291:0:35847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789518599.617323:0:35847:0:(import.c:65:import_set_state_nolock()) ffff99ffedb71000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518599.617374:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1876445627633792:12345-0@lo:38:llog_process_th.0 Request processed in 179us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.617381:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789518599.617433:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffed746a00 x1876445627633792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789518609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518599.617441:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789518599.617448:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 7 00000100:00080000:1.0:1789518599.617454:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789518599.617458:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789518599.617460:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99fec1e4e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789518599.617466:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1876445627633792:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789518599.617520:0:37260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00000020:01000000:1.0:1789518599.617631:0:37250:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789518599.617663:0:37250:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789518599.617680:0:37250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c785431 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785438 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518599.617691:0:37250:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4981200/0x631fd8698c785431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785438 expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789518599.617762:0:37250:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789518599.617764:0:37250:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518599.617766:0:37250:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518599.617767:0:37250:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518599.617769:0:37250:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518599.617770:0:37250:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518599.617771:0:37250:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518599.617773:0:37250:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518599.617774:0:37250:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518599.617778:0:37250:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789518599.617780:0:37250:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789518599.617781:0:37250:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789518599.617782:0:37250:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789518599.617784:0:37250:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789518599.617785:0:37250:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789518599.617785:0:37250:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789518599.617786:0:37250:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789518599.617787:0:37250:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789518599.617789:0:37250:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789518599.617802:0:37250:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789518599.617814:0:37250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633920:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789518599.617850:0:37250:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518599.617878:0:37250:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518599.618093:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627633920 00000100:00100000:3.0:1789518599.618099:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627633920 00000100:00100000:3.0:1789518599.618144:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518599.618153:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:37250:x1876445627633920:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789518599.618178:0:35837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789518599.618193:0:35837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789518599.655452:0:35837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789518599.655498:0:35837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789518599.657551:0:35861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789518599.657559:0:35861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789518599.657578:0:35861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518599.657607:0:35861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785319 expref: 19 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518599.657630:0:35861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518599.657666:0:35861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c785319 expref: 19 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518599.657678:0:35861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c785319 expref: 19 pid: 35837 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518599.657692:0:35861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35861:1876445627634048:0@lo:104: 00000100:00100000:1.0:1789518599.657758:0:35861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518599.657804:0:35861:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee68c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518599.657870:0:35829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627634048 00000100:00100000:0.0:1789518599.657877:0:35829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627634048 00000100:00100000:0.0:1789518599.657922:0:35829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518599.657929:0:35829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d183546-773a-47ec-8f5a-25077d1135e5+3:35861:x1876445627634048:12345-0@lo:104: 00010000:00010000:0.0:1789518599.657949:0:35829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.657998:0:35829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518599.658003:0:35829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d183546-773a-47ec-8f5a-25077d1135e5+3:35861:x1876445627634048:12345-0@lo:104: Request processed in 75us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518599.658011:0:35829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518599.658082:0:35861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35861:1876445627634048:0@lo:104: 00010000:00010000:1.0:1789518599.658098:0:35861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.658452:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518599.658458:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.658466:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0800 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:2.0:1789518599.658470:0:36743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.658479:0:36743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789518599.658487:0:36743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789518599.658502:0:36743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789518599.658532:0:36743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.658539:0:36743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789518599.658559:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.658567:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e0800/0x631fd8698c785319 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c785320 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.658582:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518599.658583:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518599.658585:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518599.658639:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627634176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518599.658667:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518599.659162:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627634176 00000100:00100000:2.0:1789518599.659168:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627634176 00010000:00010000:2.0:1789518599.659186:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785319 expref: 20 pid: 35837 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518599.659214:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518599.659220:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+20:3280:x1876445627634176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518599.659230:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518599.659243:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785319 expref: 20 pid: 35837 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659254:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c785319 expref: 20 pid: 35837 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659269:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bd200/0x631fd8698c785320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c785319 expref: 20 pid: 35837 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659297:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659306:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789518599.659318:0:35830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001759802s 00010000:00010000:2.0:1789518599.659323:0:35830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659330:0:35830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659337:0:35830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659344:0:35830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659350:0:35830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518599.659354:0:35830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659361:0:35830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659378:0:35830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518599.659388:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518599.659424:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627634176:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518599.659431:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789518599.659457:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627634176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789518599.659570:0:35861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.659578:0:35861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518599.659586:0:35861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0e00/0x631fd8698c785454 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518599.665744:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+18:37250:x1876445627633920:12345-0@lo:253:mount.lustre.0 Request processed in 47586us (47886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518599.665767:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518599.665830:0:37250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d183546-773a-47ec-8f5a-25077d1135e5:37250:1876445627633920:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789518599.665854:0:37250:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789518599.665857:0:37250:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789518599.665859:0:37250:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789518599.665861:0:37250:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789518599.665862:0:37250:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789518599.665864:0:37250:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789518599.665886:0:37250:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789518599.665888:0:37250:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789518599.665890:0:37250:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789518599.665891:0:37250:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789518599.665911:0:37250:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789518599.666506:0:37250:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518599.667454:0:37250:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518599.667731:0:37250:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518599.667894:0:37250:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789518599.668035:0:37250:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789518599.668203:0:37250:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789518599.672029:0:37250:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771072 00002000:00080000:3.0:1789518599.720740:0:37250:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789518599.720748:0:37250:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789518599.720783:0:37250:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789518599.720848:0:37250:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789518599.720862:0:37250:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789518599.720893:0:37250:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789518600.050696:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789518600.819919:0:35842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789518600.819930:0:35842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99fff4010800 from 23 10000000:01000000:3.0:1789518600.819937:0:35842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789518600.820002:0:35842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c78545b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518600.820017:0:35842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c78545b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518600.820031:0:35842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c78545b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518600.820066:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627634304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789518600.820184:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518600.820249:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4924cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518600.820287:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627634304 00000100:00100000:3.0:1789518600.820296:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627634304 00000100:00100000:3.0:1789518600.820372:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789518600.820383:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+18:35842:x1876445627634304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518600.820401:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518600.820416:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4981800/0x631fd8698c785462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c78545b expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518600.820447:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4981800/0x631fd8698c785462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c78545b expref: 19 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518600.821233:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4981800/0x631fd8698c785462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c78545b expref: 19 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518600.821251:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981800, rc 0) 00000100:00100000:3.0:1789518600.821316:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:35842:x1876445627634304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 934us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518600.821324:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789518600.821391:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627634304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518600.821413:0:35842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c78545b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785462 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518600.821425:0:35842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c78545b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c785462 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518600.821571:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed744e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627634432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789518600.822431:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518600.822662:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627634432 00000100:00100000:1.0:1789518600.823171:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627634432 00000100:00100000:3.0:1789518600.823223:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4924cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518600.823287:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789518600.823299:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:35842:x1876445627634432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789518600.823331:0:35837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789518600.823347:0:35837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789518600.823350:0:35837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 23 00000100:00100000:1.0:1789518600.823501:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:35842:x1876445627634432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518600.823518:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789518600.823553:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed744e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627634432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789518600.823721:0:35842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789518600.823736:0:35842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c78545b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785462 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518600.823751:0:35842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4980200/0x631fd8698c78545b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c785462 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518601.074889:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518602.098859:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518603.074302:0:37604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789518603.123807:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.146731:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518604.352786:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.352843:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617255552 00000100:00100000:0.0:1789518604.352851:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617255552 00000100:00100000:0.0:1789518604.353089:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1789518604.353158:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2341:x1876445617255552:12345-192.168.206.51@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789518604.353186:0:35840:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 061efaa1-25c0-4433-a9a7-9d7c1729c993@192.168.206.51@tcp t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:0.0:1789518604.353214:0:35840:0:(genops.c:1384:class_connect()) connect: client 061efaa1-25c0-4433-a9a7-9d7c1729c993, cookie 0x631fd8698c785469 00000100:00080000:0.0:1789518604.353343:0:35840:0:(import.c:65:import_set_state_nolock()) ffff99fec138d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518604.353417:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+5:2341:x1876445617255552:12345-192.168.206.51@tcp:250:mount.lustre.0 Request processed in 259us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.353425:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1789518604.356416:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518604.356514:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617255680 00000100:00100000:1.0:1789518604.356522:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617255680 00000100:00100000:1.0:1789518604.356570:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518604.356576:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+5:31038:x1876445617255680:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518604.356588:0:35837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518604.356600:0:35837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0000/0x631fd8698c785470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd7c8 expref: -99 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.356652:0:35837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0000/0x631fd8698c785470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7c8 expref: 6 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.356660:0:35837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0000/0x631fd8698c785470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7c8 expref: 6 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.356666:0:35837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0000, rc 0) 00000100:00100000:1.0:1789518604.356734:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+6:31038:x1876445617255680:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 157us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518604.356741:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:3.0:1789518604.359584:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.359785:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617255808 00000100:00100000:0.0:1789518604.359795:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617255808 00000100:00100000:0.0:1789518604.359845:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:0.0:1789518604.359870:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+6:31038:x1876445617255808:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518604.360449:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+6:31038:x1876445617255808:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 590us (871us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518604.360459:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1789518604.364839:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.368002:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617255936 00000100:00100000:0.0:1789518604.368016:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617255936 00000100:00100000:0.0:1789518604.368073:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1789518604.368082:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+6:31038:x1876445617255936:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518604.368098:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518604.368434:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc600/0x631fd8698c785477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd7cf expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.368462:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc600/0x631fd8698c785477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7cf expref: 7 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.368474:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bc600/0x631fd8698c785477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7cf expref: 7 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.368482:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc600, rc 0) 00000100:00100000:0.0:1789518604.368550:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+7:31038:x1876445617255936:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 468us (3719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.368557:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518604.370827:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.370932:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617256064 00000100:00100000:0.0:1789518604.370949:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617256064 00000100:00100000:0.0:1789518604.371005:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:0.0:1789518604.371014:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+7:31038:x1876445617256064:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518604.371349:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+8:31038:x1876445617256064:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 335us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.371357:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518604.373923:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.374018:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617256192 00000100:00100000:0.0:1789518604.374028:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617256192 00000100:00100000:0.0:1789518604.374083:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1789518604.374092:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+8:31038:x1876445617256192:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789518604.374447:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+8:31038:x1876445617256192:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 354us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.374459:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1789518604.376494:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.376595:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617256320 00000100:00100000:0.0:1789518604.376641:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617256320 00000100:00100000:0.0:1789518604.376701:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1789518604.376711:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+8:31057:x1876445617256320:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518604.377436:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+8:31057:x1876445617256320:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 724us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.377445:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1789518604.387823:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.387917:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617256448 00000100:00100000:0.0:1789518604.387927:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617256448 00000100:00100000:0.0:1789518604.387981:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1789518604.387990:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+8:31057:x1876445617256448:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518604.388856:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+8:31057:x1876445617256448:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 477us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.388873:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:3.0:1789518604.391768:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.391948:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617256576 00000100:00100000:0.0:1789518604.391962:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617256576 00000100:00100000:0.0:1789518604.392089:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:0.0:1789518604.392112:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+8:31038:x1876445617256576:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518604.392128:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518604.392145:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c78547e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd7f9 expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.392183:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c78547e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7f9 expref: 9 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.392194:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bdc00/0x631fd8698c78547e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd7f9 expref: 9 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.392203:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bdc00, rc 0) 00000100:00100000:0.0:1789518604.392317:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+9:31038:x1876445617256576:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 217us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.392324:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1789518604.396820:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.397404:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617256704 00000100:00100000:0.0:1789518604.397419:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617256704 00000100:00100000:0.0:1789518604.397486:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:0.0:1789518604.397496:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+9:31038:x1876445617256704:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789518604.397531:0:35839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789518604.397555:0:35839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789518604.397560:0:35839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789518604.397564:0:35839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789518604.397572:0:35839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 23 00000100:00100000:0.0:1789518604.401232:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+9:31038:x1876445617256704:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 3719us (4407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.401250:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:0.0:1789518604.402851:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518604.402880:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627634560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518604.402955:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518604.403009:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627634560 00000100:00100000:2.0:1789518604.403020:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627634560 00000100:00100000:2.0:1789518604.403102:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789518604.403106:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518604.403114:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627634560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518604.403160:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518604.403223:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627634560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518604.403231:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518604.403325:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627634560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518604.403796:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.403850:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617256832 00000100:00100000:0.0:1789518604.403856:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617256832 00000100:00100000:0.0:1789518604.403892:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1789518604.403900:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+9:31038:x1876445617256832:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518604.403911:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518604.403932:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd800 expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.403963:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd800 expref: 10 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.403975:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd800 expref: 10 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.403985:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:0.0:1789518604.404035:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31038:x1876445617256832:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 135us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.404042:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1789518604.407798:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.407872:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617256960 00000100:00100000:0.0:1789518604.407910:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617256960 00000100:00100000:0.0:1789518604.407992:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:0.0:1789518604.408005:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31038:x1876445617256960:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518604.408378:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31038:x1876445617256960:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 374us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.408388:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:2.0:1789518604.410605:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.411436:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617257088 00000100:00100000:0.0:1789518604.411447:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617257088 00000100:00100000:0.0:1789518604.411501:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:0.0:1789518604.411510:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31038:x1876445617257088:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789518604.411903:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31038:x1876445617257088:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 392us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.411911:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:2.0:1789518604.414935:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.415070:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617257216 00000100:00100000:0.0:1789518604.415084:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617257216 00000100:00100000:0.0:1789518604.415159:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:0.0:1789518604.415172:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31062:x1876445617257216:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789518604.415835:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31062:x1876445617257216:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 664us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.415846:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:2.0:1789518604.418704:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518604.418785:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617257344 00000100:00100000:1.0:1789518604.418799:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617257344 00000100:00100000:1.0:1789518604.418859:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:1.0:1789518604.418868:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31062:x1876445617257344:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518604.419109:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31062:x1876445617257344:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 241us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518604.419117:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1789518604.421667:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.422288:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617257472 00000100:00100000:0.0:1789518604.422303:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617257472 00000100:00100000:0.0:1789518604.422401:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1789518604.422409:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2341:x1876445617257472:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789518604.422450:0:35846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:0.0:1789518604.422521:0:35846:0:(genops.c:1384:class_connect()) connect: client 7a240d1d-1bdd-4db2-880d-9900b335b1a6, cookie 0x631fd8698c78548c 00000004:00100000:0.0:1789518604.422554:0:35846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789518604.422560:0:35846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000100:00080000:0.0:1789518604.441816:0:35846:0:(import.c:65:import_set_state_nolock()) ffff99fec138e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518604.441927:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2341:x1876445617257472:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 19514us (20268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.441946:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1789518604.443886:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518604.443926:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518604.443961:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617257728 00000100:00100000:1.0:1789518604.443974:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617257728 00000100:00100000:3.0:1789518604.443983:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617257600 00000100:00100000:3.0:1789518604.443990:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617257600 00000100:00100000:3.0:1789518604.444050:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518604.444063:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:0:x1876445617257600:12345-192.168.206.51@tcp:41:mount.lustre.0 00000100:00080000:0.0:1789518604.444074:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1789518604.444122:0:35847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1789518604.444219:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:0:x1876445617257600:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 159us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518604.444229:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518604.444251:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518604.444280:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31038:x1876445617257728:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789518604.444293:0:35847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1789518604.444332:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31038:x1876445617257728:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 53us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518604.444338:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518604.445572:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518604.445785:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617257856 00000100:00100000:1.0:1789518604.445793:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617257856 00000100:00100000:1.0:1789518604.445836:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518604.445843:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31038:x1876445617257856:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789518604.445893:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31038:x1876445617257856:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 51us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518604.445898:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518604.447989:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518604.448087:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518604.448214:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518604.448392:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617257984 00000100:00100000:1.0:1789518604.448393:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617258240 00000100:00100000:1.0:1789518604.448403:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617258240 00000100:00100000:0.0:1789518604.448404:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617257984 00000100:00100000:0.0:1789518604.448449:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617258112 00000100:00100000:1.0:1789518604.448452:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518604.448454:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617258112 00000100:00100000:1.0:1789518604.448473:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31038:x1876445617258240:12345-192.168.206.51@tcp:33:mount.lustre.0 00000100:00100000:0.0:1789518604.448483:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518604.448490:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1876445617257984:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789518604.448523:0:36531:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:0.0:1789518604.448558:0:36531:0:(genops.c:1384:class_connect()) connect: client 7a240d1d-1bdd-4db2-880d-9900b335b1a6, cookie 0x631fd8698c785493 00002000:00100000:0.0:1789518604.448573:0:36531:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a240d1d-1bdd-4db2-880d-9900b335b1a6/ffff99fec1389000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789518604.448600:0:36531:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789518604.448986:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518604.448994:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876445617258112:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789518604.449018:0:36533:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:3.0:1789518604.449050:0:36533:0:(genops.c:1384:class_connect()) connect: client 7a240d1d-1bdd-4db2-880d-9900b335b1a6, cookie 0x631fd8698c78549a 00002000:00100000:3.0:1789518604.449057:0:36533:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a240d1d-1bdd-4db2-880d-9900b335b1a6/ffff99fec1e4e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789518604.449080:0:36533:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789518604.449104:0:36531:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789518604.449145:0:36531:0:(import.c:65:import_set_state_nolock()) ffff99fec138a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518604.449214:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2341:x1876445617257984:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 723us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.449223:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00002000:00080000:3.0:1789518604.449532:0:36533:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518604.449551:0:36533:0:(import.c:65:import_set_state_nolock()) ffff99fec1e4f800 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1789518604.449601:0:35848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 636us 00000100:00100000:3.0:1789518604.449671:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2341:x1876445617258112:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 675us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518604.449680:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000004:00200000:1.0:1789518604.457538:0:35848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789518604.457736:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31038:x1876445617258240:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 9261us (9513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518604.457746:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518604.556317:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518604.556434:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617258368 00000100:00100000:3.0:1789518604.556447:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617258368 00000100:00100000:3.0:1789518604.556522:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518604.556534:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31083:x1876445617258368:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:3.0:1789518604.556561:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518604.556594:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981e00/0x631fd8698c7854a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd82a expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.556730:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c7854a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.556764:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c7854a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.556781:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c7854a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518604.556826:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518604.556831:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518604.556870:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c7854a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.556900:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981e00/0x631fd8698c7854a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd82a expref: 8 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.556920:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c7854a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd82a expref: 7 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.556929:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:3.0:1789518604.556933:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518604.556937:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980800, rc 0) 00000100:00100000:3.0:1789518604.557493:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:31083:x1876445617258368:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 958us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518604.557502:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00080000:0.0:1789518604.917367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789518604.917375:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789518604.917379:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ffdf989800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789518604.917389:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1789518604.917399:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 653 00000100:00080000:0.0:1789518604.917407:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1789518604.917418:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627634688:0@lo:400:kworker.0 00000100:00080000:0.0:1789518604.917424:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffdf989800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1789518604.917453:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fff78a9880 x1876445627634816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789518604.917508:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627634816:0@lo:8:kworker.0 00000100:00100000:1.0:1789518604.917523:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518604.917541:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518604.917736:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627635072:0@lo:400:kworker.0 00000100:00100000:0.0:1789518604.917744:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627635200:0@lo:400:kworker.0 00000100:00100000:2.0:1789518604.917792:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518604.917803:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627634688 00000100:00100000:0.0:1789518604.917813:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627634688 00000100:00100000:2.0:1789518604.917856:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518604.917868:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627634944:0@lo:400:kworker.0 00000100:00100000:2.0:1789518604.917897:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518604.917931:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627635072 00000100:00100000:2.0:1789518604.917935:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627635072 00000100:00100000:2.0:1789518604.917986:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627634944 00000100:00100000:2.0:1789518604.917990:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627634944 00000100:00100000:2.0:1789518604.918292:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518604.918303:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627635072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518604.918365:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627635072:12345-0@lo:400:kworker.0 Request processed in 64us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518604.918375:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518604.918405:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518604.918411:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627634944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518604.918445:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627634944:12345-0@lo:400:kworker.0 Request processed in 35us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518604.918451:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789518604.918503:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789518604.918512:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627634688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518604.918542:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627634688:12345-0@lo:400:kworker.0 Request processed in 33us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518604.918548:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789518604.918602:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518604.918659:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627635200 00000100:00100000:2.0:1789518604.918664:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627635200 00000100:00100000:2.0:1789518604.918710:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518604.918718:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627635200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518604.918737:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627634816 00000100:00100000:3.0:1789518604.918744:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627634816 00000100:00100000:2.0:1789518604.918756:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627635200:12345-0@lo:400:kworker.0 Request processed in 38us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518604.918763:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518604.918774:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518604.918781:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1876445627634816:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789518604.918812:0:36531:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:3.0:1789518604.918861:0:36531:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x631fd8698c7854af 00002000:00100000:3.0:1789518604.918878:0:36531:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99fec1e4c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789518604.918883:0:36531:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789518604.918887:0:36531:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1789518604.918971:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:3.0:1789518604.919278:0:36531:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789518604.919308:0:36531:0:(import.c:65:import_set_state_nolock()) ffff99fec1e4c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789518604.919369:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1876445627634816:12345-0@lo:8:kworker.0 Request processed in 587us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518604.919377:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789518604.919531:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627634688:0@lo:400:kworker.0 00010000:00080000:0.0:1789518604.919553:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff78a9880 x1876445627634816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789518629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518604.919564:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789518604.919572:0:3279:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 7 00000100:00080000:0.0:1789518604.919580:0:3279:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789518604.919586:0:3279:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789518604.919588:0:3279:0:(import.c:65:import_set_state_nolock()) ffff99ffdf989800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789518604.919630:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789518604.919636:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1876445627634816:0@lo:8:kworker.0 00000100:00100000:3.0:1789518604.919662:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627635072:0@lo:400:kworker.0 00000040:00080000:0.0:1789518604.919711:0:35869:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 5 count 2 00000100:00100000:3.0:1789518604.919738:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627634944:0@lo:400:kworker.0 00000100:00100000:3.0:1789518604.919759:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627635328:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1789518604.919777:0:35870:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0xa3:0x0] 00000100:00100000:1.0:1789518604.919801:0:35870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35870:1876445627635584:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789518604.919810:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518604.919837:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518604.919855:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627635456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518604.919860:0:35870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518604.919891:0:35870:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518604.919897:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789518604.919897:0:35869:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518604.919903:0:35869:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1789518604.919910:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627635328 00000100:00100000:1.0:1789518604.919916:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627635328 00000100:00100000:1.0:1789518604.919951:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627635584 00000100:00100000:1.0:1789518604.919953:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627635584 00000100:00100000:1.0:1789518604.919972:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518604.919981:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627635328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789518604.920007:0:36533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:163 count 1 00000100:00100000:3.0:1789518604.920010:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518604.920021:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:35870:x1876445627635584:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789518604.920048:0:35869:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789518604.920087:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627635200:0@lo:400:kworker.0 00000100:00100000:3.0:1789518604.920128:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627635456 00000100:00100000:3.0:1789518604.920133:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627635456 00000100:00100000:3.0:1789518604.920159:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789518604.920167:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3282:x1876445627635456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518604.920182:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789518604.920351:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3282:x1876445627635456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518604.920360:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789518604.920396:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fff7a79f80 x1876445627635456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789518620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789518604.920415:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627635456:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789518604.920521:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789518604.921739:0:35869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 658918122834ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789518604.922258:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627635328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2275us (2446us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518604.922268:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:1.0:1789518604.922320:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff78a9880, transno 0 00000004:00080000:1.0:1789518604.922326:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff78a9880/1, rc -2, transno 0 00000100:00100000:1.0:1789518604.922336:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627635328:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789518604.922522:0:36735:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789518604.922530:0:36735:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -30 00002000:02000040:0.0:1789518604.922545:0:36735:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:164 to 0x280000400:193) 00000040:00080000:1.0:1789518604.923954:0:35869:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 6, last_idx 7 00000040:00080000:1.0:1789518604.924042:0:35869:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x24:0x0] at index 6 of catalog [0x1:0x5:0x0] 00002000:00010000:0.0:1789518604.932785:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.932800:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.932820:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.932826:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.932833:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.932854:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.932866:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.932876:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.932900:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.933006:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.933021:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.933037:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.933043:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.933056:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.933124:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.933134:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.933163:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.933165:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.933167:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.934417:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.934427:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934442:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.934447:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.934453:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934539:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934552:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934560:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934581:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518604.934594:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518604.934601:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934609:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518604.934634:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934644:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934662:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934670:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c7854bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.934711:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.934713:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.934715:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.936602:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.936637:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936655:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.936660:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.936668:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936694:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936707:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936714:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936736:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518604.936751:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518604.936757:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936778:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518604.936783:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936794:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936813:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936821:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7854c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.936845:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.936847:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.936849:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.937584:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.937591:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937602:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.937606:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.937611:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937647:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937662:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937670:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937699:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518604.937712:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518604.937717:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937725:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518604.937730:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937739:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937756:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937764:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c7854cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.937784:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.937791:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.937794:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.938720:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.938728:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.938743:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.938747:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.938752:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.938764:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.938775:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.938783:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.938804:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518604.938827:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518604.938841:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518604.939431:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.939439:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939450:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.939454:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.939458:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.939545:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518604.939560:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.939573:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.939597:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.939606:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7854d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939646:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939659:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939666:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939698:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518604.939714:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518604.939719:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939728:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518604.939734:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939744:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939758:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939767:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c7854d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.939855:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.939859:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.939862:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.940306:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.940311:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.940314:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.940779:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.940787:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.940799:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.940803:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.940808:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.940818:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.940826:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.940833:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.940855:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.941060:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.941070:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.941082:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.941087:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.941098:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.941125:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.941135:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7854e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.941165:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.941170:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.941172:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.941574:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.941583:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.941608:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.941639:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.941645:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.941658:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.941667:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.941676:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.941713:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.942212:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.942221:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.942384:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.942389:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.942419:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.942435:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.942443:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c7854e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.942464:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.942465:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.942467:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.942895:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.942906:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.942919:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.942923:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.942928:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.942940:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.942962:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.942972:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.943436:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518604.943646:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518604.943656:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.943666:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518604.943672:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.943693:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.943719:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.943727:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d809ea6/0x631fd8698c7854ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.943761:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518604.943763:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518604.943765:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.944189:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.944198:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.944211:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.944216:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.944222:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.944235:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.944246:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.944253:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.944352:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.944430:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.944447:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.944457:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.944466:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.944475:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.944496:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.944514:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000460f3ef9/0x631fd8698c7854f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.944537:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.944541:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.944542:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.945242:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.945249:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.945261:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.945264:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.945268:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.945278:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.945285:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.945292:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.945311:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518604.945778:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518604.945792:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.945808:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518604.945815:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.945826:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.945847:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.945865:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c7854fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.945901:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.945903:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.945906:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.946072:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.946080:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946090:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.946100:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.946105:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946115:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946124:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946132:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946151:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518604.946165:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518604.946171:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946179:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518604.946184:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946193:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946210:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946231:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c785503 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946251:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.946253:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.946255:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.946944:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.946953:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946963:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.946967:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.946972:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946984:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.946992:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947000:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947017:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.947609:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.947643:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.947656:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.947662:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.947673:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518604.947757:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.947773:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947784:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.947788:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.947793:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947804:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947813:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947821:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947844:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518604.947860:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518604.947865:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947874:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518604.947879:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947888:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947915:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947923:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785511 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.947940:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.947943:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.947944:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.948229:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.948292:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fd1f417/0x631fd8698c78550a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.948324:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.948329:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.948334:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.948472:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.948481:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948491:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.948495:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.948499:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948509:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948518:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948525:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948555:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518604.948566:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518604.948571:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948578:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518604.948582:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948591:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948604:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948635:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785518 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.948658:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.948660:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.948663:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.949171:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.949178:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.949187:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.949196:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.949200:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.949210:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.949218:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.949226:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.949247:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.949279:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.949289:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.949299:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.949304:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.949314:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.949332:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.949340:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c78551f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.949368:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.949374:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.949376:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.949920:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.949928:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.949939:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.949942:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.949947:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.949961:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.949970:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.949986:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.950007:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.950415:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.950425:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.950436:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.950440:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.950469:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.950485:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.950494:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c785526 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.950524:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.950528:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.950530:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.951231:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.951238:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.951248:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.951251:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.951256:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.951270:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.951279:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.951288:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.951320:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518604.951427:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518604.951437:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.951446:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518604.951452:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.951461:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.951474:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.951480:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78552d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.951499:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.951503:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.951506:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.952111:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.952119:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.952136:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.952139:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.952144:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.952155:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.952165:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.952173:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.952193:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.952258:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.952266:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.952274:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.952278:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.952286:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.952303:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.952321:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ca169c6/0x631fd8698c785534 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.952342:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.952345:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.952350:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789518604.952832:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a240d1d-1bdd-4db2-880d-9900b335b1a6 00002000:00010000:0.0:1789518604.952988:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.952996:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953005:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.953009:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.953013:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953023:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953044:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953053:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953070:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.953521:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.953534:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953546:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.953550:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953560:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953579:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953586:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a71170/0x631fd8698c78553b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953689:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.953698:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.953700:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.953725:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.953733:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953744:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.953748:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.953752:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953762:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953770:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953778:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.953814:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.953844:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.953853:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953862:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.953865:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953874:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953889:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953896:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c12b388e/0x631fd8698c785542 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.953925:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.953927:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.953930:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.954336:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.954345:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.954355:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.954359:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.954363:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.954374:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.954383:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.954397:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.954424:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.954456:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.954465:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.954474:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.954478:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.954493:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.954507:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.954513:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c62e73c/0x631fd8698c785549 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.954530:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.954532:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.954534:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.955209:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.955219:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.955231:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.955241:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.955245:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.955257:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.955268:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.955276:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.955291:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.955583:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.955593:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.955604:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.955609:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.955638:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.955657:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.955677:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785550 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.955717:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.955722:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.955725:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.956075:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.956084:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.956094:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.956098:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.956103:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.956114:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.956122:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.956137:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.956168:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518604.956348:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518604.956358:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.956367:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518604.956372:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.956382:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.956400:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.956406:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4169b8e/0x631fd8698c785557 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.956428:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.956431:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.956434:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.957044:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.957052:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957064:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.957068:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.957073:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957084:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957093:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957102:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957122:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518604.957669:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518604.957690:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.957703:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518604.957709:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518604.957713:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518604.957725:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957726:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957755:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.957759:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518604.957763:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957764:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.957813:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9d192ce/0x631fd8698c78555e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957816:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.957847:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.957855:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.957857:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.957860:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518604.957864:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518604.957892:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518604.957916:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518604.957923:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.957932:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518604.957936:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.957965:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.957980:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.957989:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e2fb305/0x631fd8698c785565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518604.958014:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518604.958017:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518604.958020:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.958526:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.958533:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.958540:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.958542:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.958545:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.958552:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.958566:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.958570:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.958582:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518604.958641:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518604.958649:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.958658:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518604.958663:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.958695:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.958714:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.958721:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b56070/0x631fd8698c78556c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.958745:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.958748:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.958750:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.959139:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.959146:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.959154:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.959158:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.959162:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.959172:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.959178:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.959183:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.959206:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518604.959358:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518604.959367:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.959379:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518604.959383:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.959394:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.959412:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.959421:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a4f941/0x631fd8698c785573 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518604.959456:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.959460:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518604.959463:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.959800:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.959806:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.959814:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.959867:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.959877:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.959885:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.959892:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.959897:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.960026:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518604.960164:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518604.960173:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.960182:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518604.960186:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.960196:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.960208:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.960229:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000949cb8b0/0x631fd8698c78557a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.960246:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.960248:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.960250:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518604.961093:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518604.961102:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.961115:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789518604.961125:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518604.961131:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.961142:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.961148:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.961153:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518604.961168:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518604.961268:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518604.961276:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.961286:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518604.961290:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.961299:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.961313:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.961321:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785581 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518604.961337:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.961339:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518604.961341:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789518604.961551:0:36735:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:163 00000100:00100000:0.0:1789518604.961722:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:35870:x1876445627635584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 41698us (41870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518604.961733:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518604.961815:0:35870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35870:1876445627635584:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789518604.961832:0:35870:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0xc1:0x0] from OST, last_created [0x280000400:0xc1:0x0]last_used is [0x280000400:0xa3:0x0] 00000100:00100000:1.0:1789518604.961878:0:35870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35870:1876445627635712:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789518604.961937:0:35870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518604.961991:0:35870:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8454840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518604.962040:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627635712 00000100:00100000:3.0:1789518604.962047:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627635712 00000100:00100000:3.0:1789518604.962094:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789518604.962103:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:35870:x1876445627635712:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789518604.962174:0:36531:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 194 00000100:00100000:1.0:1789518604.966221:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:35870:x1876445627635712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4114us (4279us total) trans 30064771073 rc 0/0 00000100:00100000:1.0:1789518604.966234:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518604.966486:0:35870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35870:1876445627635712:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789518604.966500:0:35870:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xc1:0x0]-[0x280000400:0xe1:0x0] 00000004:00080000:1.0:1789518604.967372:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:1.0:1789518604.967397:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a240d1d-1bdd-4db2-880d-9900b335b1a6 00010000:00010000:2.0:1789518605.170909:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518606.150096:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518606.150159:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617258496 00000100:00100000:0.0:1789518606.150168:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617258496 00000100:00100000:0.0:1789518606.150263:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1789518606.150268:0:35846:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789518606.150273:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31135:x1876445617258496:12345-192.168.206.51@tcp:41:lfs.0 00000100:00100000:2.0:1789518606.150276:0:35846:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000004:00000024:0.0:1789518606.150313:0:35847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1789518606.150401:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31135:x1876445617258496:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 129us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518606.150408:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00080000:3.0:1789518606.150691:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518606.154866:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518606.154966:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617258624 00000100:00100000:3.0:1789518606.154976:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617258624 00000100:00100000:3.0:1789518606.155050:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518606.155060:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31135:x1876445617258624:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:3.0:1789518606.155097:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518606.155177:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31135:x1876445617258624:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 118us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518606.155201:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00080000:2.0:1789518606.155263:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518606.159493:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518606.159660:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617258752 00000100:00100000:0.0:1789518606.159693:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617258752 00000100:00100000:0.0:1789518606.159764:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518606.159773:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:31135:x1876445617258752:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1789518606.159807:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789518606.159888:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:31135:x1876445617258752:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 116us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518606.159895:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00080000:2.0:1789518606.159967:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789518606.194787:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518606.252746:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518606.252823:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617258880 00000100:00100000:1.0:1789518606.252834:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617258880 00000100:00100000:1.0:1789518606.252937:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:1.0:1789518606.252948:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+10:31168:x1876445617258880:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789518606.252964:0:35837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518606.252981:0:35837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0a00/0x631fd8698c785588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd831 expref: -99 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518606.253009:0:35837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0a00/0x631fd8698c785588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd831 expref: 11 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518606.253020:0:35837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0a00/0x631fd8698c785588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd831 expref: 11 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518606.253030:0:35837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0a00, rc 0) 00000100:00100000:1.0:1789518606.253082:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31168:x1876445617258880:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 137us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518606.253214:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1789518606.264188:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518606.264344:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617259008 00000100:00100000:0.0:1789518606.264357:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617259008 00000100:00100000:0.0:1789518606.264425:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:0.0:1789518606.264437:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31168:x1876445617259008:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789518606.264879:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31168:x1876445617259008:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 442us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518606.264888:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:2.0:1789518606.267355:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518606.267454:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617259136 00000100:00100000:1.0:1789518606.267468:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617259136 00000100:00100000:1.0:1789518606.267542:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1789518606.267553:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31168:x1876445617259136:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789518606.267882:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31168:x1876445617259136:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 330us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518606.267891:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1789518606.270170:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518606.270428:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617259264 00000100:00100000:2.0:1789518606.270441:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617259264 00000100:00100000:2.0:1789518606.270508:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1789518606.270520:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31175:x1876445617259264:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518606.270954:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31175:x1876445617259264:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 434us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518606.270963:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1789518606.281166:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518606.281527:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617259392 00000100:00100000:1.0:1789518606.281541:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617259392 00000100:00100000:1.0:1789518606.281713:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:1.0:1789518606.281726:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31175:x1876445617259392:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518606.282077:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31175:x1876445617259392:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 352us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518606.282086:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518606.283966:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518606.284045:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617259520 00000100:00100000:0.0:1789518606.284055:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617259520 00000100:00100000:0.0:1789518606.284110:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:0.0:1789518606.284121:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31168:x1876445617259520:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789518606.284140:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518606.284162:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0697e00/0x631fd8698c78558f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd85b expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518606.284199:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0697e00/0x631fd8698c78558f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd85b expref: 12 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518606.284212:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0697e00/0x631fd8698c78558f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd85b expref: 12 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518606.284259:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697e00, rc 0) 00000100:00100000:0.0:1789518606.284317:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31168:x1876445617259520:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 197us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518606.284325:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:0.0:1789518606.287751:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518606.287867:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617259648 00000100:00100000:1.0:1789518606.287880:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617259648 00000100:00100000:1.0:1789518606.288083:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:1.0:1789518606.288106:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31168:x1876445617259648:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789518606.288132:0:35837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789518606.288155:0:35837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789518606.288159:0:35837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789518606.288163:0:35837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789518606.288166:0:35837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 23 00000100:00100000:1.0:1789518606.289506:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31168:x1876445617259648:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 1404us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518606.289518:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:3.0:1789518606.293089:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518606.293683:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617259776 00000100:00100000:2.0:1789518606.293701:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617259776 00000100:00100000:2.0:1789518606.293777:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:2.0:1789518606.293786:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31168:x1876445617259776:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789518606.293805:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518606.293830:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd862 expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518606.293868:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd862 expref: 13 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518606.293914:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd862 expref: 13 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518606.293926:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5a00, rc 0) 00000100:00100000:2.0:1789518606.294006:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31168:x1876445617259776:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 219us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518606.294013:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:0.0:1789518606.295993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518606.296101:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617259904 00000100:00100000:1.0:1789518606.296110:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617259904 00000100:00100000:1.0:1789518606.296194:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:1.0:1789518606.296205:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31168:x1876445617259904:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789518606.296504:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31168:x1876445617259904:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 300us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518606.296513:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:3.0:1789518606.300825:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518606.300932:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617260032 00000100:00100000:2.0:1789518606.300951:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617260032 00000100:00100000:2.0:1789518606.301104:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:2.0:1789518606.301123:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31168:x1876445617260032:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789518606.301438:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31168:x1876445617260032:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 322us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518606.301448:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1789518606.304435:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518606.305316:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617260160 00000100:00100000:1.0:1789518606.305326:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617260160 00000100:00100000:1.0:1789518606.305383:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:1.0:1789518606.305393:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31179:x1876445617260160:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789518606.305651:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31179:x1876445617260160:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 258us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518606.305660:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:0.0:1789518606.307849:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518606.307955:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617260288 00000100:00100000:2.0:1789518606.307965:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617260288 00000100:00100000:2.0:1789518606.308073:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:2.0:1789518606.308083:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31179:x1876445617260288:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789518606.308315:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31179:x1876445617260288:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 233us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518606.308323:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:3.0:1789518606.311770:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518606.312762:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617260416 00000100:00100000:2.0:1789518606.312774:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617260416 00000100:00100000:2.0:1789518606.312827:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:2.0:1789518606.312834:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2341:x1876445617260416:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789518606.312872:0:35845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:2.0:1789518606.312907:0:35845:0:(genops.c:1384:class_connect()) connect: client 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0, cookie 0x631fd8698c78559d 00000004:00100000:2.0:1789518606.312932:0:35845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789518606.313134:0:35845:0:(import.c:65:import_set_state_nolock()) ffff99fff7b58800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789518606.313208:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2341:x1876445617260416:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 372us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518606.313215:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1789518606.317309:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518606.317429:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617260544 00000100:00100000:2.0:1789518606.317438:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617260544 00000100:00100000:2.0:1789518606.317510:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1789518606.317520:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:0:x1876445617260544:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789518606.317549:0:35846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00080000:3.0:1789518606.317641:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518606.317765:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518606.317779:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:0:x1876445617260544:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 261us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518606.317787:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518606.318078:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617260672 00000100:00100000:3.0:1789518606.318083:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617260672 00000100:00100000:3.0:1789518606.318119:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1789518606.318127:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31168:x1876445617260672:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789518606.318140:0:35845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1789518606.318180:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31168:x1876445617260672:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 54us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518606.318187:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518606.321852:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518606.321979:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617260800 00000100:00100000:0.0:1789518606.321988:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617260800 00000100:00100000:0.0:1789518606.322350:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518606.322361:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31168:x1876445617260800:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789518606.322448:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31168:x1876445617260800:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 89us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518606.322534:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1789518606.326133:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518606.326384:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617260928 00000100:00100000:0.0:1789518606.326397:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617260928 00000100:00100000:0.0:1789518606.326489:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518606.326499:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1876445617260928:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789518606.326543:0:36532:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:0.0:1789518606.326601:0:36532:0:(genops.c:1384:class_connect()) connect: client 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0, cookie 0x631fd8698c7855a4 00002000:00100000:0.0:1789518606.326648:0:36532:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0/ffff99ffeedd4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789518606.326663:0:36532:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789518606.326815:0:36532:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789518606.326854:0:36532:0:(import.c:65:import_set_state_nolock()) ffff99ffeedd4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789518606.326975:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2341:x1876445617260928:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 476us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518606.326984:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1789518606.327066:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518606.328033:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518606.328085:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617261184 00000100:00100000:2.0:1789518606.328099:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617261184 00000100:00100000:2.0:1789518606.328147:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1789518606.328158:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31168:x1876445617261184:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789518606.328259:0:35849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789518606.328333:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31168:x1876445617261184:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 176us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518606.328357:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518606.329261:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617261056 00000100:00100000:3.0:1789518606.329269:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617261056 00000100:00100000:1.0:1789518606.329369:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518606.329378:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1876445617261056:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789518606.329409:0:36533:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:1.0:1789518606.329445:0:36533:0:(genops.c:1384:class_connect()) connect: client 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0, cookie 0x631fd8698c7855ab 00002000:00100000:1.0:1789518606.329457:0:36533:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0/ffff99fec2ab8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789518606.329483:0:36533:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789518606.329680:0:36533:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789518606.329717:0:36533:0:(import.c:65:import_set_state_nolock()) ffff99fec2aba800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789518606.329781:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2341:x1876445617261056:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 401us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518606.329842:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000040:00080000:0.0:1789518606.387557:0:35881:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1789518606.387570:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518606.388227:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 1 00000040:00080000:0.0:1789518606.388319:0:35881:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518606.388362:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 1 00000100:00100000:2.0:1789518606.434099:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518606.434209:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617261312 00000100:00100000:3.0:1789518606.434222:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617261312 00000100:00100000:3.0:1789518606.434356:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518606.434368:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31200:x1876445617261312:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:3.0:1789518606.434396:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518606.434421:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981e00/0x631fd8698c7855b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd88c expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518606.434525:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518606.434542:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518606.434556:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518606.434608:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518606.434648:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518606.434688:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518606.434719:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981e00/0x631fd8698c7855b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd88c expref: 8 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518606.434740:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd88c expref: 7 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518606.434749:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:3.0:1789518606.434752:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518606.434757:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981a00, rc 0) 00000100:00100000:3.0:1789518606.434830:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:31200:x1876445617261312:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 464us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518606.434838:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00010000:00010000:2.0:1789518607.219219:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789518607.505235:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0 00000001:00100000:3.0:1789518607.505249:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a240d1d-1bdd-4db2-880d-9900b335b1a6 00000001:02000400:2.0:1789518608.000417:0:37810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789518608.242843:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518609.266776:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518609.522899:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518609.522950:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627635840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518609.523010:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518609.523179:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627635840 00000100:00100000:1.0:1789518609.523191:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627635840 00000100:00100000:1.0:1789518609.523249:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518609.523258:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627635840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518609.523290:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789518609.523349:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627635840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518609.523356:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518609.523492:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627635840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518609.523736:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789518609.999121:0:37958:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdac928790 20000000:00000080:3.0:1789518609.999141:0:37958:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fffeb84400 uarg=0000000000000000 20000000:01000000:3.0:1789518609.999179:0:37958:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789518609.999184:0:37958:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789518609.999188:0:37958:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789518609.999963:0:37959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789518610.000105:0:37958:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789518610.000113:0:37958:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789518610.000134:0:37958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000152:0:37958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785294 expref: 18 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000160:0:37958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7852e1 expref: 18 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000167:0:37958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c785423 expref: 18 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000261:0:37958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd800 expref: 12 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000269:0:37958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd862 expref: 12 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000275:0:37958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000312:0:37958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd862 expref: 12 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000326:0:37958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd862 expref: 12 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518610.000340:0:37958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627635968:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518610.000499:0:37958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd800 expref: 12 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000508:0:37958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd800 expref: 12 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518610.000517:0:37958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627636096:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518610.000551:0:37958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c785423 expref: 18 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000559:0:37958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c785423 expref: 18 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518610.000579:0:37958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627636224:0@lo:104: 00000100:00100000:1.0:1789518610.000662:0:37958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518610.000699:0:37958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c7852e1 expref: 18 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.000707:0:37958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c7852e1 expref: 18 pid: 35837 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518610.000715:0:37958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627636352:0@lo:104: 00000100:00100000:3.0:1789518610.000807:0:35829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627636224 00000100:00100000:3.0:1789518610.000815:0:35829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627636224 00000100:00100000:3.0:1789518610.000867:0:35829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518610.000879:0:35829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d183546-773a-47ec-8f5a-25077d1135e5+3:37958:x1876445627636224:12345-0@lo:104: 00010000:00010000:3.0:1789518610.000893:0:35829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.000954:0:35829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789518610.000960:0:35829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d183546-773a-47ec-8f5a-25077d1135e5+3:37958:x1876445627636224:12345-0@lo:104: Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518610.000967:0:35829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789518610.000998:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518610.001004:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.001011:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:3.0:1789518610.001015:0:35833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.001023:0:35833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789518610.001030:0:35833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518610.001043:0:35833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789518610.001072:0:35833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.001079:0:35833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789518610.001096:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.001103:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffed5bca00/0x631fd8698c785423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78542a expref: -99 pid: 37250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.001115:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518610.001117:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518610.001119:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518610.001135:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518610.001147:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627636480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789518610.001188:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518610.001231:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627636480 00000100:00100000:3.0:1789518610.001236:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627636480 00010000:00010000:3.0:1789518610.001252:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785423 expref: 19 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.001273:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518610.001279:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627636480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789518610.001289:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518610.001294:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785423 expref: 19 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.001303:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c785423 expref: 19 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.001324:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518610.001352:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627636480:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518610.001359:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518610.001395:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627636480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518610.001714:0:37958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789518610.001765:0:37958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x631fd8698c785294 expref: 18 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.001775:0:37958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x631fd8698c785294 expref: 18 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518610.001784:0:37958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7389f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627636608:0@lo:104: 00000100:00100000:1.0:1789518610.001808:0:37958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518610.001823:0:37958:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2cc00 going to sleep for 10 seconds 00010000:00010000:1.0:1789518610.001836:0:37958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fec4981000/0x631fd8698c78542a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c785423 expref: 18 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518610.001858:0:37958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627636224:0@lo:104: 00000100:00100000:0.0:1789518610.001903:0:35828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789518610.001915:0:35828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627636352 00000100:00100000:0.0:1789518610.001919:0:35828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627636352 00000100:00100000:0.0:1789518610.001954:0:35828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627636608 00000100:00100000:0.0:1789518610.001958:0:35828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627636608 00000100:00100000:0.0:1789518610.001973:0:35828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518610.001982:0:35828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d183546-773a-47ec-8f5a-25077d1135e5+4:37958:x1876445627636352:12345-0@lo:104: 00010000:00010000:0.0:1789518610.001993:0:35828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.002282:0:35828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789518610.002289:0:35828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d183546-773a-47ec-8f5a-25077d1135e5+4:37958:x1876445627636352:12345-0@lo:104: Request processed in 309us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518610.002297:0:35828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789518610.002314:0:35828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789518610.002320:0:35828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd8121850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d183546-773a-47ec-8f5a-25077d1135e5+3:37958:x1876445627636608:12345-0@lo:104: 00010000:00010000:0.0:1789518610.002335:0:35828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518610.003777:0:37958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627636352:0@lo:104: 00000100:00100000:1.0:1789518610.003790:0:37958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7389f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627636608:0@lo:104: 00000100:00100000:1.0:1789518610.004375:0:37958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627635968:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518610.004384:0:37958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a7b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37958:1876445627636096:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518610.004421:0:37958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.004906:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518610.004945:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617261440 00000100:00100000:3.0:1789518610.004954:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617261440 00010000:00010000:3.0:1789518610.004991:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd862 expref: 13 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.005026:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518610.005038:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617261440:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518610.005052:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518610.005059:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd862 expref: 13 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.005073:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd862 expref: 13 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.005094:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fec26d5a00/0x631fd8698c785596 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd862 expref: 13 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.005112:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518610.005162:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:2343:x1876445617261440:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 126us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518610.005171:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518610.006066:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518610.006089:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617261568 00000100:00100000:3.0:1789518610.006094:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617261568 00010000:00010000:3.0:1789518610.006112:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd800 expref: 12 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.006134:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518610.006142:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:2343:x1876445617261568:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518610.006151:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518610.006157:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd800 expref: 12 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.006168:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd800 expref: 12 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006225:0:35828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789518610.006235:0:35828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd8121850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d183546-773a-47ec-8f5a-25077d1135e5+3:37958:x1876445627636608:12345-0@lo:104: Request processed in 3914us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518610.006243:0:35828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789518610.006293:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffed5bc400/0x631fd8698c785485 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd800 expref: 12 pid: 35840 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006296:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789518610.006304:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.006311:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518610.006314:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518610.006320:0:36743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006330:0:36743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518610.006338:0:36743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.006349:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:2343:x1876445617261568:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 205us (283us total) trans 0 rc 0/0 10000000:01000000:0.0:1789518610.006351:0:36743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789518610.006362:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00010000:00010000:0.0:1789518610.006391:0:36743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006398:0:36743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518610.006418:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006425:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99ffc29e1600/0x631fd8698c7852e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c7852e8 expref: -99 pid: 36530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006443:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518610.006446:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006452:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981400 already unused, calling callback (ffffffffc1b17c20) 10000000:00010000:0.0:1789518610.006455:0:36743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006462:0:36743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789518610.006468:0:36743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518610.006473:0:36743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789518610.006483:0:36743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006488:0:36743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789518610.006494:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006500:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff99fec4981400/0x631fd8698c785294 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x631fd8698c78529b expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.006513:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518610.006514:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518610.006516:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518610.006530:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627636736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518610.006560:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518610.006590:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518610.006611:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627636736 00000100:00100000:2.0:1789518610.006632:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627636736 00000100:00100000:0.0:1789518610.006648:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1789518610.006667:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7852e1 expref: 18 pid: 35837 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.006667:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627636864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789518610.006699:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518610.006709:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518610.006710:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+18:3282:x1876445627636736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518610.006722:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518610.006728:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c7852e1 expref: 18 pid: 35837 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006739:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c7852e1 expref: 18 pid: 35837 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006752:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc14ce00/0x631fd8698c7852e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c7852e1 expref: 18 pid: 35837 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006761:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518610.006848:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+17:3282:x1876445627636736:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518610.006855:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518610.006867:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627636864 00000100:00100000:2.0:1789518610.006870:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627636864 00010000:00010000:2.0:1789518610.006889:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785294 expref: 17 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.006903:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789518610.006908:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+17:3282:x1876445627636864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789518610.006915:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518610.006918:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x631fd8698c785294 expref: 17 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006927:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x631fd8698c785294 expref: 17 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006937:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fffc14d800/0x631fd8698c78529b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x631fd8698c785294 expref: 17 pid: 35839 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006948:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006955:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006968:0:35830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006975:0:35830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006982:0:35830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.006988:0:35830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.007001:0:35830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518610.007005:0:35830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.007012:0:35830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.007026:0:35830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.007037:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518610.007060:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d183546-773a-47ec-8f5a-25077d1135e5+16:3282:x1876445627636864:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518610.007067:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789518610.007225:0:37958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.007234:0:37958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.007241:0:37958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffc29e0600/0x631fd8698c7855c0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.007334:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627636736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789518610.007350:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627636864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789518610.034843:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627636992:0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.034908:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518610.034946:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627637504:0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.034970:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518610.034993:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518610.034999:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff738b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627637120:0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035019:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518610.035047:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff738b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627637248:0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035070:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518610.035084:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518610.035089:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627637376:0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035109:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518610.035137:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627636992 00000100:00100000:1.0:1789518610.035144:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627636992 00000100:00100000:1.0:1789518610.035180:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627637120 00000100:00100000:1.0:1789518610.035183:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627637120 00000100:00100000:1.0:1789518610.035237:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518610.035245:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627636992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035301:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627636992:12345-0@lo:400:kworker.0 Request processed in 57us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.035308:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518610.035323:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518610.035330:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627637120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035356:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627637120:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.035361:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789518610.035378:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627637504 00000100:00100000:1.0:1789518610.035382:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627637504 00000100:00100000:1.0:1789518610.035405:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627637248 00000100:00100000:1.0:1789518610.035408:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627637248 00000100:00100000:1.0:1789518610.035418:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627637376 00000100:00100000:1.0:1789518610.035420:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627637376 00000100:00100000:1.0:1789518610.035433:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518610.035439:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627637504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035467:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627637504:12345-0@lo:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.035473:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518610.035483:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518610.035489:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627637248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035518:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627637248:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.035524:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789518610.035534:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518610.035546:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627637376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035574:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627637376:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.035580:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789518610.035598:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518610.035602:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518610.035651:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627637376:0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035674:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff738b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627637248:0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035704:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff738b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627637120:0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035712:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627636992:0@lo:400:kworker.0 00000100:00100000:1.0:1789518610.035719:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627637504:0@lo:400:kworker.0 00000100:00100000:2.0:1789518610.036099:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627637632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518610.036137:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518610.036467:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627637632 00000100:00100000:0.0:1789518610.036472:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627637632 00000100:00100000:0.0:1789518610.036505:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518610.036513:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627637632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518610.036539:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789518610.036586:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627637632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518610.036592:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789518610.037098:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627637632:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789518610.073328:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0 00000001:00100000:2.0:1789518610.085275:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0 00000001:00080000:2.0:1789518610.085289:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771073 is committed 00000001:00100000:2.0:1789518610.085298:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789518610.290924:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518610.751403:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.751486:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617261696 00000100:00100000:1.0:1789518610.751500:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617261696 00000100:00100000:1.0:1789518610.751590:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518610.751726:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31655:x1876445617261696:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518610.751746:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789518610.751759:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789518610.751771:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7855c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd893 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.751826:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.751840:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.751867:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.752394:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.752404:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.752411:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753055:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7855dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753066:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7855dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753073:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7855dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518610.753099:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518610.753102:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518610.753136:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7855dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753147:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753153:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753171:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753176:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.753180:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753188:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753199:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:1.0:1789518610.753201:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.753206:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753212:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7855ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753224:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753230:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753235:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753239:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.753242:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753256:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753264:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99ffc13ed000) 00010000:00010000:1.0:1789518610.753266:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.753269:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753275:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7855d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753307:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7855c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd893 expref: 8 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753438:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7855dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd893 expref: 7 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.753445:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc13edd00) 00010000:00010000:1.0:1789518610.753447:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518610.753450:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1400, rc 0) 00000100:00100000:1.0:1789518610.753579:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:31655:x1876445617261696:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1979us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.753586:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1789518610.757386:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.757479:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617261952 00000100:00100000:0.0:1789518610.757494:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617261952 00000100:00100000:0.0:1789518610.757577:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:0.0:1789518610.757589:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:31655:x1876445617261952:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518610.757640:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.757673:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c7855e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd89a expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.757744:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.757782:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.757795:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.757810:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.757817:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.757823:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758144:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7855f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758154:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7855f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758162:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7855f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.758177:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789518610.758369:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758377:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758383:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758394:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.758398:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758405:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758417:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc13edd00) 00010000:00010000:0.0:1789518610.758420:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.758426:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758432:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c7855ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758444:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758450:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758456:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758461:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.758464:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758469:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758486:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518610.758489:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.758492:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.758497:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7855f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.759012:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c7855e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd89a expref: 10 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.759027:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7855f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd89a expref: 9 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.759035:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518610.759038:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.759040:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696800, rc 0) 00000100:00100000:0.0:1789518610.759117:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:31655:x1876445617261952:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1530us (1746us total) trans 30064771073 rc 0/0 00000100:00100000:0.0:1789518610.759125:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:2.0:1789518610.761970:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.762119:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617262080 00000100:00100000:1.0:1789518610.762130:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617262080 00000100:00100000:1.0:1789518610.762287:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1789518610.762299:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:31655:x1876445617262080:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789518610.762568:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:31655:x1876445617262080:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 271us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.762576:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518610.803819:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518610.804170:0:35854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617262208 00000100:00100000:2.0:1789518610.804183:0:35854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617262208 00000100:00100000:2.0:1789518610.804247:0:35854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518610.804258:0:35854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:31664:x1876445617262208:12345-192.168.206.51@tcp:700:mkdir.0 00000100:00100000:2.0:1789518610.804343:0:35854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:31664:x1876445617262208:12345-192.168.206.51@tcp:700:mkdir.0 Request processed in 86us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518610.804350:0:35854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518610.806444:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518610.807528:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617262464 00000100:00100000:2.0:1789518610.807539:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617262464 00000100:00100000:2.0:1789518610.807601:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:2.0:1789518610.807670:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:31664:x1876445617262464:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:2.0:1789518610.807726:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518610.807753:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4980800/0x631fd8698c7854a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd82a expref: 9 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.807772:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:2.0:1789518610.807778:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518610.807997:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.808259:0:35846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd88c expref: 5 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.808269:0:35846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.808302:0:35846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd88c expref: 5 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.808316:0:35846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd88c expref: 5 pid: 35845 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.808330:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627637760:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518610.808435:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518610.810367:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627637760:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518610.810405:0:35846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.811170:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518610.811226:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617262592 00000100:00100000:2.0:1789518610.811235:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617262592 00010000:00010000:2.0:1789518610.811286:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd88c expref: 6 pid: 35845 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.811329:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1789518610.811338:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617262592:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518610.811353:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518610.811361:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd88c expref: 6 pid: 35845 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.811375:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd88c expref: 6 pid: 35845 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789518610.811395:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789518610.811396:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c7855b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd88c expref: 6 pid: 35845 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.811423:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:2.0:1789518610.811429:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.811441:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.811449:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.811482:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518610.811536:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617262592:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 197us (366us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518610.811537:0:35846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.811551:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00010000:00010000:0.0:1789518610.811552:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.811579:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.811605:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.811995:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.813319:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789518610.813331:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.813340:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.813347:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.813352:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.813357:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.813365:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.813378:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:0.0:1789518610.813381:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.813385:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.813391:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785606 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518610.813422:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000301ce196 reply state 00000000c97e1bea transno 30064771074 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.813431:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518610.813524:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:31664:x1876445617262464:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 5912us (7087us total) trans 30064771074 rc 0/0 00000100:00100000:0.0:1789518610.813533:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00010000:00010000:2.0:1789518610.815017:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.815031:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.815038:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.815044:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518610.815048:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.815054:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.815081:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff99ffc2d97e00) 00010000:00010000:2.0:1789518610.815084:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518610.815088:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.815093:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c78560d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.832534:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.832687:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617262720 00000100:00100000:0.0:1789518610.832696:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617262720 00000100:00100000:0.0:1789518610.833044:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1789518610.833057:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:31665:x1876445617262720:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518610.833086:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.833120:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8a1 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.833291:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78561b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.833306:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.833316:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.833350:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518610.833354:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518610.833371:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.833415:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8a1 expref: 11 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.833431:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78561b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8a1 expref: 10 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.833439:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518610.833442:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518610.833445:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697600, rc 0) 00000100:00100000:0.0:1789518610.833511:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:31665:x1876445617262720:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 457us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518610.833518:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518610.836383:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.836451:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617262848 00000100:00100000:0.0:1789518610.836459:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617262848 00000100:00100000:0.0:1789518610.836511:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1789518610.836520:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:31665:x1876445617262848:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518610.836539:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.836557:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8a8 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836644:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836671:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836682:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836726:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836744:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836752:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836848:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785637 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836857:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785637 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836864:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785637 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.836893:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518610.836898:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518610.836915:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785637 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836927:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836934:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836941:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836956:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.836961:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836969:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836982:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518610.836985:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.836991:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.836997:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837009:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837014:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837020:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837025:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.837028:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837034:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837052:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518610.837054:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.837057:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837062:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c785630 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837087:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8a8 expref: 12 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837099:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785637 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8a8 expref: 11 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.837106:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518610.837108:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518610.837110:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697c00, rc 0) 00000100:00100000:0.0:1789518610.837451:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:31665:x1876445617262848:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 930us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518610.837458:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518610.842026:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.842124:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617263104 00000100:00100000:1.0:1789518610.842135:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617263104 00000100:00100000:1.0:1789518610.842236:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1789518610.842246:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:31665:x1876445617263104:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518610.842266:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518610.842284:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78563e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8af expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518610.842370:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789518610.842497:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78563e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8af expref: 13 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.842511:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:1.0:1789518610.842513:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518610.842519:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78563e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8af expref: 13 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.842533:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0600, rc 0) 00000100:00100000:1.0:1789518610.842662:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:31665:x1876445617263104:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 358us (586us total) trans 30064771075 rc 301/301 00000100:00100000:1.0:1789518610.842671:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518610.844660:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518610.844830:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617263360 00000100:00100000:2.0:1789518610.844839:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617263360 00000100:00100000:2.0:1789518610.844907:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518610.844917:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:31665:x1876445617263360:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:2.0:1789518610.844966:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518610.844989:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785637 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8a8 expref: 12 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.845005:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97d00) 00010000:00010000:2.0:1789518610.845015:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518610.845039:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.845052:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.845064:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518610.845452:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063c3f48c reply state 0000000044efc915 transno 30064771076 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.845464:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789518610.845471:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789518610.845608:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31665:x1876445617263360:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 692us (1031us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1789518610.845666:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00010000:00010000:1.0:1789518610.847518:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.847551:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.847558:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.847564:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.847569:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.847577:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.847591:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:1.0:1789518610.847594:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789518610.847600:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.847606:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4c00/0x631fd8698c78564c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.849721:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518610.849835:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617263616 00000100:00100000:2.0:1789518610.849845:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617263616 00000100:00100000:2.0:1789518610.849939:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518610.849949:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:31665:x1876445617263616:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518610.850173:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31665:x1876445617263616:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 225us (461us total) trans 30064771077 rc 0/0 00000100:00100000:2.0:1789518610.850177:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518610.853830:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.853962:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617263872 00000100:00100000:0.0:1789518610.853970:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617263872 00000100:00100000:0.0:1789518610.854065:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:0.0:1789518610.854076:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31665:x1876445617263872:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518610.854101:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.854120:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8b6 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854209:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854223:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854235:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854248:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854255:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854261:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.854442:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789518610.854528:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854536:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854543:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854548:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.854552:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854863:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854877:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518610.854880:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.854885:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854891:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c78565a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854904:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854910:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854916:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854921:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.854923:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854929:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854937:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518610.854940:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.854943:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.854959:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785661 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.855007:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785653 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8b6 expref: 15 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.855017:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518610.855019:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518610.855023:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8b6 expref: 15 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.855032:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696200, rc 0) 00000100:00100000:0.0:1789518610.855163:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:31665:x1876445617263872:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1088us (1340us total) trans 30064771078 rc 301/301 00000100:00100000:0.0:1789518610.855171:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518610.858179:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.858259:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617264000 00000100:00100000:0.0:1789518610.858268:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617264000 00000100:00100000:0.0:1789518610.858324:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1789518610.858334:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:31665:x1876445617264000:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518610.858357:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.858377:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78566f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8bd expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.858461:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785676 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.858474:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785676 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.858501:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785676 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.858538:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518610.858542:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518610.858558:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785676 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.858583:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78566f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8bd expref: 16 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.858600:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785676 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8bd expref: 15 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.858607:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.858610:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518610.858667:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696000, rc 0) 00000100:00100000:0.0:1789518610.858739:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:31665:x1876445617264000:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 406us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518610.858747:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518610.862277:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.862378:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617264128 00000100:00100000:1.0:1789518610.862389:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617264128 00000100:00100000:1.0:1789518610.862447:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1789518610.862458:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:31665:x1876445617264128:12345-192.168.206.51@tcp:37:lfs.0 00000100:00100000:1.0:1789518610.866983:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:31665:x1876445617264128:12345-192.168.206.51@tcp:37:lfs.0 Request processed in 4517us (4704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.866996:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518610.870338:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.870452:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617264384 00000100:00100000:0.0:1789518610.870462:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617264384 00000100:00100000:0.0:1789518610.870519:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1789518610.870529:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0149450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:31665:x1876445617264384:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518610.870981:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0149450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:31665:x1876445617264384:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 452us (651us total) trans 30064771079 rc 0/0 00000100:00100000:0.0:1789518610.870990:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518610.893094:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.893702:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617264512 00000100:00100000:1.0:1789518610.893726:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617264512 00000100:00100000:1.0:1789518610.893796:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518610.893808:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:31666:x1876445617264512:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518610.893834:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518610.893855:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78567d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8c4 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.893917:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.893932:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.893959:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.893975:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.893982:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.893989:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894080:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785692 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894088:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785692 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894096:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785692 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518610.894131:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518610.894135:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518610.894170:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785692 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894183:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894189:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894196:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894216:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.894221:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894229:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894241:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:1.0:1789518610.894244:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.894249:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894256:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894269:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894285:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894292:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894296:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.894300:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894306:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894315:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff99ffc13ed000) 00010000:00010000:1.0:1789518610.894318:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.894321:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894327:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78568b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894357:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78567d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8c4 expref: 18 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894371:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785692 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8c4 expref: 17 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.894379:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518610.894381:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518610.894389:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0e00, rc 0) 00000100:00100000:1.0:1789518610.894461:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:31666:x1876445617264512:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 654us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.894468:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1789518610.897902:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.897994:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617264640 00000100:00100000:0.0:1789518610.898005:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617264640 00000100:00100000:0.0:1789518610.898080:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518610.898091:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2343:x1876445617264640:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518610.898106:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518610.898128:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785692 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8c4 expref: 17 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.898149:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.898153:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518610.898212:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2343:x1876445617264640:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 123us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518610.898218:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518610.901124:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.901205:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617264896 00000100:00100000:0.0:1789518610.901213:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617264896 00000100:00100000:0.0:1789518610.901287:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1789518610.901463:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:31666:x1876445617264896:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518610.901486:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.901489:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518610.901511:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785676 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8bd expref: 16 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.901598:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.901610:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518610.901661:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785699 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8cb expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.901793:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.901807:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.901818:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.901830:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.901837:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.901845:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.902964:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7856ae lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.902977:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7856ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.902986:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7856ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.902996:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789518610.903022:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.903029:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.903044:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.903051:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.903055:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.903063:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.903075:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518610.903078:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.903082:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.903088:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856a0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518610.903098:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bfb77a1 reply state 0000000052cae008 transno 30064771080 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.903107:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518610.903140:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785699 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8cb expref: 18 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.903158:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7856ae lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8cb expref: 17 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.903165:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff99ffc2d97000) 00010000:00010000:0.0:1789518610.903173:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789518610.903176:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697000, rc 0) 00000100:00100000:0.0:1789518610.903547:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31666:x1876445617264896:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 2249us (2428us total) trans 30064771080 rc 0/0 00000100:00100000:0.0:1789518610.903556:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00010000:00010000:2.0:1789518610.905298:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.905321:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.905328:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.905334:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518610.905444:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.905453:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.905466:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff99ffc2d97600) 00010000:00010000:2.0:1789518610.905469:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518610.905473:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.905479:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7856a7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.921159:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.921240:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617265152 00000100:00100000:1.0:1789518610.921250:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617265152 00000100:00100000:1.0:1789518610.921322:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1789518610.921332:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:31666:x1876445617265152:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789518610.921721:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31666:x1876445617265152:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 388us (570us total) trans 30064771081 rc 0/0 00000100:00100000:1.0:1789518610.921729:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518610.923817:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.923883:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617265280 00000100:00100000:0.0:1789518610.923892:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617265280 00000100:00100000:0.0:1789518610.923943:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1789518610.923953:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31666:x1876445617265280:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518610.923973:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.924000:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7856bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8d2 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924045:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924055:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924063:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924072:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924076:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924080:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924259:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c7856d1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924268:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c7856d1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924275:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c7856d1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.924298:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518610.924302:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518610.924318:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c7856d1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924444:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924453:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924460:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924465:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.924469:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924476:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924487:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518610.924496:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.924501:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924508:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7856c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924522:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924527:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924533:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924537:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.924540:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924546:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924553:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518610.924555:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.924558:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924562:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c7856ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924729:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7856bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8d2 expref: 20 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924754:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c7856d1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8d2 expref: 19 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.924761:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.924763:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789518610.924766:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697400, rc 0) 00000100:00100000:0.0:1789518610.924833:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31666:x1876445617265280:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 881us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518610.924840:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518610.927280:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.927659:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617265408 00000100:00100000:0.0:1789518610.927670:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617265408 00000100:00100000:0.0:1789518610.927728:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518610.927737:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31666:x1876445617265408:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518610.927757:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.927778:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7856d8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8d9 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927845:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927859:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927868:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927882:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927903:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927910:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927965:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927973:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927979:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927985:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.927989:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.927997:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928008:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.928011:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.928017:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928023:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7856df lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928037:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928050:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928057:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928062:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.928065:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928072:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928080:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff99ffc2d97100) 00010000:00010000:0.0:1789518610.928083:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.928085:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928091:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7856e6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928121:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7856d8 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8d9 expref: 20 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928130:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.928132:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.928136:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7856d8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8d9 expref: 20 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.928155:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697a00, rc 0) 00000100:00100000:0.0:1789518610.928218:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31666:x1876445617265408:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 482us (946us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518610.928226:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:2.0:1789518610.931353:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.931422:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617265664 00000100:00100000:1.0:1789518610.931431:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617265664 00000100:00100000:1.0:1789518610.931485:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1789518610.931495:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31666:x1876445617265664:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518610.931514:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518610.931532:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7856ed lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8e0 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.931688:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.931702:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.931714:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.931726:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.931742:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.931746:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932402:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785702 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932410:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785702 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932415:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785702 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518610.932423:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3:0x0]: returning size 0 00010000:00010000:1.0:1789518610.932447:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932454:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932461:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932466:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.932470:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932477:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932498:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518610.932501:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.932506:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932512:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7856f4 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518610.932526:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055b7584e reply state 00000000a64d2032 transno 30064771082 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518610.932534:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518610.932561:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7856ed lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8e0 expref: 22 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932573:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785702 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8e0 expref: 21 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.932578:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:1.0:1789518610.932580:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789518610.932583:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0800, rc 0) 00000100:00100000:1.0:1789518610.932673:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31666:x1876445617265664:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1178us (1327us total) trans 30064771082 rc 0/0 00000100:00100000:1.0:1789518610.932681:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1789518610.936278:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.936373:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617265920 00010000:00010000:1.0:1789518610.936378:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.936384:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617265920 00010000:00010000:1.0:1789518610.936394:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.936437:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1789518610.936448:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31666:x1876445617265920:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789518610.936582:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.936595:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.936600:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.936609:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.936665:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff99ffc13ed000) 00010000:00010000:1.0:1789518610.936669:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.936674:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.936681:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7856fb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.936759:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.936774:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.936784:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518610.936828:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771083 00000004:00010000:0.0:1789518610.936867:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c5d689a reply state 0000000009603207 transno 30064771084 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.936876:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518610.936963:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617265920:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 517us (693us total) trans 30064771084 rc 0/0 00000100:00100000:0.0:1789518610.936971:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000020:00080000:0.0:1789518610.936975:0:35846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518610.938020:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.938031:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.938039:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.938044:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.938047:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.938069:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.938081:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:1.0:1789518610.938083:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.938087:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.938093:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785710 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.939015:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.939103:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617266176 00000100:00100000:0.0:1789518610.939111:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617266176 00000100:00100000:0.0:1789518610.939169:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518610.939178:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31666:x1876445617266176:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789518610.939389:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617266176:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 211us (379us total) trans 30064771085 rc 0/0 00000100:00100000:0.0:1789518610.939396:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1789518610.942489:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.942584:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617266432 00000100:00100000:0.0:1789518610.942593:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617266432 00000100:00100000:0.0:1789518610.942712:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:0.0:1789518610.942723:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617266432:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789518610.942807:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518610.942831:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785702 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8e0 expref: 24 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.942859:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:0.0:1789518610.942870:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518610.942891:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.942904:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.942913:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.942927:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.942934:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.942955:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.943435:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.943444:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.943451:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944236:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944246:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944255:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944262:0:35847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944268:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944273:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944331:0:35847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518610.944333:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518610.944339:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.944346:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518610.944348:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944360:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944365:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.944366:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944370:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.944373:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.944374:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944379:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.944384:0:35834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:2.0:1789518610.944387:0:35834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518610.944391:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944391:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518610.944393:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789518610.944397:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78572c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944397:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944403:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785725 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.944408:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518610.944409:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518610.944411:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518610.944419:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944425:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944431:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944435:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.944445:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944451:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944459:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.944461:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.944464:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.944471:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785717 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518610.944480:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007b5c163 reply state 0000000010963e20 transno 30064771086 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.944489:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518610.944578:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31666:x1876445617266432:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 1855us (2095us total) trans 30064771086 rc 0/0 00000100:00100000:0.0:1789518610.944586:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518610.947346:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518610.947348:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.947361:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.947368:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.947374:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.947379:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.947386:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.947401:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff99ffc2d97c00) 00010000:00010000:1.0:1789518610.947404:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.947408:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.947415:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617266560 00000100:00100000:0.0:1789518610.947424:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617266560 00010000:00010000:1.0:1789518610.947433:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78571e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.947686:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:0.0:1789518610.947697:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617266560:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518610.947719:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.947733:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785733 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8e7 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947800:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947819:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947828:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947860:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947869:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947876:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947922:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947930:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947935:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947941:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.947944:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947950:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947958:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.947966:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.947976:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947982:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78573a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.947994:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.948000:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.948006:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.948011:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.948019:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.948024:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.948032:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff99ffc2d97100) 00010000:00010000:0.0:1789518610.948034:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.948037:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.948043:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785741 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.948072:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785733 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8e7 expref: 25 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.948088:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.948091:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.948095:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785733 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8e7 expref: 25 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.948104:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00000100:00100000:0.0:1789518610.948158:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617266560:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 463us (818us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518610.948165:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1789518610.950289:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.950380:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617266816 00000100:00100000:1.0:1789518610.950388:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617266816 00000100:00100000:1.0:1789518610.950441:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518610.950452:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617266816:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518610.950468:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518610.950485:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785748 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8ee expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.950598:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.950608:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.950629:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.950639:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.950643:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.950648:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951216:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78575d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951231:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78575d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951239:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78575d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518610.951249:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789518610.951275:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951281:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951287:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951292:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.951296:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951303:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951313:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518610.951316:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.951321:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951326:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78574f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518610.951338:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dc3156f reply state 0000000014e16a04 transno 30064771087 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518610.951352:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518610.951380:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785748 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8ee expref: 27 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951393:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78575d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8ee expref: 26 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.951400:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:1.0:1789518610.951402:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789518610.951404:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0800, rc 0) 00000100:00100000:1.0:1789518610.951472:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31666:x1876445617266816:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1022us (1190us total) trans 30064771087 rc 0/0 00000100:00100000:1.0:1789518610.951480:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00010000:00010000:1.0:1789518610.953685:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.953700:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.953707:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.953713:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.953717:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.953725:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.953758:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff99ffc13ed000) 00010000:00010000:1.0:1789518610.953761:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.953765:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.953771:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785756 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.954846:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518610.954957:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617267072 00000100:00100000:2.0:1789518610.954966:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617267072 00000100:00100000:2.0:1789518610.955019:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1789518610.955036:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:31666:x1876445617267072:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789518610.955531:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.955546:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.955557:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518610.955754:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771088 00000004:00010000:2.0:1789518610.955781:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b97d18a7 reply state 00000000c40468e7 transno 30064771089 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.955790:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518610.955876:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:31666:x1876445617267072:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 840us (1036us total) trans 30064771089 rc 0/0 00000100:00100000:2.0:1789518610.955883:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000020:00080000:2.0:1789518610.955888:0:35846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518610.957912:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.957927:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.957935:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.957940:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.957945:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.957952:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.957966:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:1.0:1789518610.957968:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.957973:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.957979:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78576b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518610.958264:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.958333:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617267328 00000100:00100000:1.0:1789518610.958341:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617267328 00000100:00100000:1.0:1789518610.958394:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1789518610.958403:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31666:x1876445617267328:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789518610.958799:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:31666:x1876445617267328:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 395us (537us total) trans 30064771090 rc 0/0 00000100:00100000:1.0:1789518610.958807:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1789518610.961283:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.961398:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617267584 00000100:00100000:0.0:1789518610.961407:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617267584 00000100:00100000:0.0:1789518610.961819:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1789518610.961830:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:31666:x1876445617267584:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518610.961975:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.961993:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785772 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8f5 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.962138:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785779 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.962153:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785779 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.962163:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785779 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.962174:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1789518610.962366:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785772 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8f5 expref: 32 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.962382:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785779 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8f5 expref: 31 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.962389:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:0.0:1789518610.962392:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789518610.962395:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697800, rc 0) 00000100:00100000:0.0:1789518610.962521:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31666:x1876445617267584:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 693us (1245us total) trans 30064771091 rc 0/0 00000100:00100000:0.0:1789518610.962529:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1789518610.966329:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.966414:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617267840 00000100:00100000:0.0:1789518610.966424:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617267840 00000100:00100000:0.0:1789518610.966486:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518610.966508:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31666:x1876445617267840:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789518610.966789:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31666:x1876445617267840:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 293us (468us total) trans 30064771092 rc 0/0 00000100:00100000:0.0:1789518610.966797:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1789518610.969068:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.969146:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617268096 00000100:00100000:0.0:1789518610.969154:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617268096 00000100:00100000:0.0:1789518610.969218:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:0.0:1789518610.969227:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31666:x1876445617268096:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789518610.969272:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518610.969296:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785779 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8f5 expref: 32 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969337:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78575d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8ee expref: 31 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969347:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:0.0:1789518610.969356:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518610.969376:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969389:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969399:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969412:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969419:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969425:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969511:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969519:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.969526:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970024:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970034:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970041:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970047:0:37723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970053:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970059:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970083:0:37723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518610.970100:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970107:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970113:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970118:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.970122:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970140:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970150:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518610.970152:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518610.970156:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970162:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696e00/0x631fd8698c785795 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970177:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970183:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970189:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970194:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.970197:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970202:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970210:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.970212:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.970215:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.970231:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785787 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518610.970242:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010aa8c9e reply state 000000007f13b532 transno 30064771093 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.970249:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518610.970251:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518610.970259:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.970267:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518610.970271:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.970277:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.970287:0:36743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:1.0:1789518610.970291:0:36743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518610.970294:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.970301:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c78579c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.970317:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518610.970318:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518610.970326:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518610.970549:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31666:x1876445617268096:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 1320us (1484us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1789518610.970557:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00010000:00010000:1.0:1789518610.972499:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.972515:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.972522:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.972527:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.972532:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.972539:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.972553:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff99ffc2d97100) 00010000:00010000:1.0:1789518610.972556:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.972561:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.972567:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78578e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.974824:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.974933:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617268224 00000100:00100000:1.0:1789518610.974944:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617268224 00000100:00100000:1.0:1789518610.974995:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:1.0:1789518610.975004:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31666:x1876445617268224:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518610.975028:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518610.975051:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7857a3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd8fc expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975125:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975140:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975151:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975166:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975173:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975180:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975230:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975237:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975244:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975250:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.975254:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975272:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975817:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518610.975821:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.975826:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975834:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857aa lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975848:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975853:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975859:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975865:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.975868:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975874:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975881:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff99ffc13ed000) 00010000:00010000:1.0:1789518610.975883:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.975886:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975903:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857b1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975937:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7857a3 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8fc expref: 32 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975947:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518610.975949:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.975953:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7857a3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8fc expref: 32 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.975962:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1600, rc 0) 00000100:00100000:1.0:1789518610.976025:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31666:x1876445617268224:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1020us (1209us total) trans 0 rc 301/301 00000100:00100000:1.0:1789518610.976032:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1789518610.977921:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.977966:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617268480 00000100:00100000:0.0:1789518610.977975:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617268480 00000100:00100000:0.0:1789518610.978033:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:0.0:1789518610.978045:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31666:x1876445617268480:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518610.978063:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518610.978079:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7857b8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd903 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978183:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978196:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978206:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978220:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978265:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978272:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978889:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978899:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978907:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518610.978917:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 0 00010000:00010000:0.0:1789518610.978941:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978949:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978956:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978962:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518610.978966:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978972:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.978994:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518610.978997:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518610.979002:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.979008:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c7857bf lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518610.979021:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e260a0ae reply state 00000000db253598 transno 30064771094 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.979028:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518610.979057:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7857b8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd903 expref: 34 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.979072:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd903 expref: 33 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.979079:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:0.0:1789518610.979081:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789518610.979084:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696200, rc 0) 00000100:00100000:0.0:1789518610.979137:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31666:x1876445617268480:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1095us (1222us total) trans 30064771094 rc 0/0 00000100:00100000:0.0:1789518610.979146:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00010000:00010000:1.0:1789518610.981367:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.981381:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.981389:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.981395:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.981399:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.981422:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.981437:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff99ffc2d97a00) 00010000:00010000:1.0:1789518610.981439:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.981444:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.981450:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c7857c6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.982151:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.982250:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617268736 00000100:00100000:0.0:1789518610.982260:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617268736 00000100:00100000:0.0:1789518610.982312:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:0.0:1789518610.982322:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31666:x1876445617268736:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789518610.982591:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.982606:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518610.983209:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518610.983272:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771095 00000004:00010000:0.0:1789518610.983303:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069b14c9e reply state 0000000046d581b0 transno 30064771096 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518610.983312:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518610.983450:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:31666:x1876445617268736:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 1127us (1301us total) trans 30064771096 rc 0/0 00000100:00100000:0.0:1789518610.983458:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000020:00080000:0.0:1789518610.983463:0:35847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518610.985372:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.985387:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.985395:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.985401:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.985406:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.985412:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.985436:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:1.0:1789518610.985440:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.985445:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.985473:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c7857db lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518610.986952:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518610.987007:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617268864 00000100:00100000:0.0:1789518610.987017:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617268864 00000100:00100000:2.0:1789518610.987113:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:2.0:1789518610.987126:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:31667:x1876445617268864:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518610.987145:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518610.987162:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c7857e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd90a expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.987242:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7857e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.987254:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7857e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.987264:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7857e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518610.987295:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518610.987299:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518610.987314:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7857e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.987335:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c7857e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd90a expref: 7 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.987350:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7857e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd90a expref: 6 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.987358:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:2.0:1789518610.987360:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518610.987363:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4600, rc 0) 00000100:00100000:2.0:1789518610.987422:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31667:x1876445617268864:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 300us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518610.987430:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:3.0:1789518610.989315:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518610.989403:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617268992 00000100:00100000:1.0:1789518610.989411:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617268992 00000100:00100000:1.0:1789518610.989510:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1789518610.989520:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31667:x1876445617268992:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518610.989534:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518610.989550:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7857f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd911 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989598:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989641:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989663:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989678:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989685:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989693:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989780:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785805 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989799:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785805 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989806:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785805 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518610.989829:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518610.989832:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518610.989862:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785805 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989872:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989879:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989885:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989890:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.989893:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989899:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989908:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:1.0:1789518610.989911:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.989914:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989929:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c7857f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989939:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989944:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989950:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989954:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518610.989957:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989963:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989969:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff99ffc13ed000) 00010000:00010000:1.0:1789518610.989971:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518610.989973:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.989978:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c7857fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.990002:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c7857f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd911 expref: 8 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.990021:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785805 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd911 expref: 7 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518610.990027:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518610.990030:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518610.990032:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0e00, rc 0) 00000100:00100000:1.0:1789518610.990081:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:31667:x1876445617268992:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 560us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518610.990087:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:0.0:1789518610.992780:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518610.992848:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617269248 00000100:00100000:2.0:1789518610.992861:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617269248 00000100:00100000:2.0:1789518610.992932:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:2.0:1789518610.992941:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:31667:x1876445617269248:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518610.992957:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518610.992972:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78580c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd918 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993020:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993029:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993036:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993045:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993049:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993053:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993149:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785821 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993162:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785821 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993169:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785821 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518610.993201:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:2.0:1789518610.993306:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993314:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993320:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993326:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518610.993329:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993336:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993346:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518610.993349:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518610.993353:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993358:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785813 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993371:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993376:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993392:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993398:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518610.993401:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993407:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993414:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff99ffd1b0c000) 00010000:00010000:2.0:1789518610.993416:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518610.993419:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993425:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78581a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993463:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78580c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd918 expref: 10 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993474:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785821 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd918 expref: 9 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518610.993481:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:2.0:1789518610.993482:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518610.993484:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5600, rc 0) 00000100:00100000:2.0:1789518610.993565:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31667:x1876445617269248:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 625us (800us total) trans 30064771097 rc 0/0 00000100:00100000:2.0:1789518610.993582:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:2.0:1789518610.997670:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518610.997839:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617269504 00000100:00100000:3.0:1789518610.997848:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617269504 00000100:00100000:3.0:1789518610.997915:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518610.997926:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31667:x1876445617269504:12345-192.168.206.51@tcp:103:mmap_sanity.0 00010000:00010000:3.0:1789518610.997940:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518610.997962:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785821 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd918 expref: 9 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518610.997980:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:3.0:1789518610.997984:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518610.998047:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31667:x1876445617269504:12345-192.168.206.51@tcp:103:mmap_sanity.0 Request processed in 123us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518610.998055:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:3.0:1789518611.000192:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.000774:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617269632 00000100:00100000:0.0:1789518611.000787:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617269632 00000100:00100000:0.0:1789518611.000861:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1789518611.000873:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31667:x1876445617269632:12345-192.168.206.51@tcp:58:mmap_sanity.0 00010000:00010000:0.0:1789518611.000994:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.001015:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd903 expref: 34 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.001050:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.001095:0:35847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd903 expref: 34 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.001112:0:35847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd903 expref: 34 pid: 35846 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.001128:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627637888:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518611.001746:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9216780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518611.004664:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627637888:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518611.004697:0:35847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518611.008180:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.008276:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617269760 00000100:00100000:0.0:1789518611.008291:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617269760 00010000:00010000:0.0:1789518611.008338:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd903 expref: 35 pid: 35846 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.008376:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518611.008383:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2343:x1876445617269760:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518611.008395:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518611.008400:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd903 expref: 35 pid: 35846 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.008411:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd903 expref: 35 pid: 35846 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.008429:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c7857cd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd903 expref: 35 pid: 35846 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.008478:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:0.0:1789518611.008484:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.008493:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.008498:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.008567:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518611.008671:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2343:x1876445617269760:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 286us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.008682:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00010000:00010000:1.0:1789518611.008772:0:35847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.008781:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518611.009386:0:35847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789518611.009456:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 64 off8640 00000040:00080000:1.0:1789518611.009530:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].1, 136 off8328 00000100:00100000:1.0:1789518611.009725:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31667:x1876445617269632:12345-192.168.206.51@tcp:58:mmap_sanity.0 Request processed in 8853us (9543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518611.009735:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:3.0:1789518611.011517:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.011772:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617269888 00000100:00100000:0.0:1789518611.011782:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617269888 00000100:00100000:0.0:1789518611.011839:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1789518611.011848:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31667:x1876445617269888:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518611.011864:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518611.011881:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785836 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd91f expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.011928:0:35846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.011938:0:35846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785836 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd91f expref: 9 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.011969:0:35846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.011982:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785836 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd91f expref: 9 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.011995:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:0.0:1789518611.011998:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518611.012002:0:35846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785836 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd91f expref: 9 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.012010:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697c00, rc 0) 00000100:00100000:0.0:1789518611.012116:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31667:x1876445617269888:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 268us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.012123:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00010000:00010000:3.0:1789518611.314993:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518611.342425:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.342477:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.342578:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617270144 00000100:00100000:0.0:1789518611.342584:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.342590:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617270144 00000100:00100000:0.0:1789518611.342678:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.342712:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617270400 00000100:00100000:1.0:1789518611.342717:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617270400 00000100:00100000:3.0:1789518611.342735:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617270272 00000100:00100000:3.0:1789518611.342742:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617270272 00000100:00100000:1.0:1789518611.342743:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:1.0:1789518611.342757:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2343:x1876445617270144:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518611.342776:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518611.342787:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617270400:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518611.342833:0:36735:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789518611.342842:0:36735:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789518611.342859:0:36532:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789518611.342868:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518611.342875:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2342:x1876445617270272:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518611.342926:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2343:x1876445617270144:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 172us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518611.342934:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1789518611.343258:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2342:x1876445617270272:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 382us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.343276:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518611.343459:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617270016 00000100:00100000:2.0:1789518611.343464:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617270016 00000100:00080000:0.0:1789518611.343484:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518611.343489:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518611.343554:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:2.0:1789518611.343561:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:2342:x1876445617270016:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518611.343768:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:2342:x1876445617270016:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 206us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.343776:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1789518611.344596:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.344829:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617270528 00000100:00100000:0.0:1789518611.344836:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617270528 00000100:00100000:0.0:1789518611.344888:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518611.344897:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617270528:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518611.344945:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617270528:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 49us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.344951:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00080000:1.0:1789518611.345043:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518611.346358:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617270400:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3564us (3767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518611.346369:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000040:00080000:2.0:1789518611.506860:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518611.506870:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518611.506907:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 2 count 2 00000040:00080000:2.0:1789518611.506914:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518611.507024:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627638016:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518611.507189:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789518611.511968:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627638016:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518611.513033:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518611.513166:0:35856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617270656 00000100:00100000:2.0:1789518611.513179:0:35856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617270656 00000100:00100000:2.0:1789518611.513460:0:35856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:2.0:1789518611.513476:0:35856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31669:x1876445617270656:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789518611.513561:0:35856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31669:x1876445617270656:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 Request processed in 92us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.513568:0:35856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1789518611.518024:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.518126:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617270784 00000100:00100000:1.0:1789518611.518143:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617270784 00000100:00100000:1.0:1789518611.518219:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518611.518242:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31669:x1876445617270784:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518611.518280:0:35845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518611.518399:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31669:x1876445617270784:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 171us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518611.518406:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518611.522031:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518611.522446:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617270912 00000100:00100000:2.0:1789518611.522478:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617270912 00000100:00100000:2.0:1789518611.522557:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:2.0:1789518611.522570:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31669:x1876445617270912:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789518611.522716:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522739:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522754:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522774:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522781:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522788:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522817:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522826:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522845:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518611.522893:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:2.0:1789518611.522899:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518611.522927:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522945:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522956:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522965:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522972:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518611.522977:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.522985:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523000:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518611.523003:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518611.523009:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523016:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78583d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523032:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523039:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523045:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523057:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518611.523060:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523066:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523074:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x9ebbb977 (ffff99ffd1b0c000) 00010000:00010000:2.0:1789518611.523077:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518611.523080:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523086:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c785844 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523103:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523109:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523114:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523119:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518611.523122:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523128:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523146:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:2.0:1789518611.523148:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518611.523152:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.523157:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c78584b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518611.523273:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31669:x1876445617270912:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 704us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.523283:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:0.0:1789518611.525721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.525894:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617271168 00000100:00100000:1.0:1789518611.525906:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617271168 00000100:00100000:1.0:1789518611.525970:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518611.525982:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31669:x1876445617271168:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518611.526006:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518611.526029:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c785852 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd926 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526144:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526176:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526189:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518611.526204:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:1.0:1789518611.526333:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526343:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526350:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526356:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518611.526360:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526369:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526382:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:1.0:1789518611.526385:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518611.526391:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526397:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c785859 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526457:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c785852 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd926 expref: 36 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526469:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:1.0:1789518611.526472:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518611.526475:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c785852 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd926 expref: 36 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.526485:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0600, rc 0) 00000100:00100000:1.0:1789518611.526563:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31669:x1876445617271168:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 582us (855us total) trans 30064771098 rc 301/301 00000100:00100000:1.0:1789518611.526571:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518611.529429:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518611.529494:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617271296 00000100:00100000:2.0:1789518611.529508:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617271296 00000100:00100000:2.0:1789518611.529667:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1789518611.529688:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31669:x1876445617271296:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518611.529735:0:37723:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518611.529882:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31669:x1876445617271296:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 204us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.529891:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1789518611.533527:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.533931:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617271552 00000100:00100000:1.0:1789518611.533947:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617271552 00000100:00100000:1.0:1789518611.534029:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1789518611.534041:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31669:x1876445617271552:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518611.534068:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518611.534093:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c785867 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd92d expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518611.535026:0:35845:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0xa5:0x0], count =29 00000004:00080000:1.0:1789518611.535035:0:35845:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0xa5:0x0]+29 in llog 00000004:00080000:1.0:1789518611.535101:0:35845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc2:0x0], index 0: 0 00010000:00010000:1.0:1789518611.535440:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78586e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.535479:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78586e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.535494:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78586e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.535579:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c785867 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd92d expref: 38 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.535601:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78586e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd92d expref: 37 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.535611:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed000) 00010000:00010000:1.0:1789518611.535638:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518611.535643:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1c00, rc 0) 00000100:00100000:1.0:1789518611.535749:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:31669:x1876445617271552:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1709us (2230us total) trans 30064771099 rc 0/0 00000100:00100000:1.0:1789518611.535758:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1789518611.538510:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.538606:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617271808 00000100:00100000:0.0:1789518611.538664:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617271808 00000100:00100000:0.0:1789518611.538732:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1789518611.538766:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:31669:x1876445617271808:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518611.538846:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518611.538878:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78586e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd92d expref: 37 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.538901:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed000) 00010000:00010000:0.0:1789518611.538913:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518611.538942:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.538958:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.538994:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539012:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539020:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539026:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539109:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539117:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539123:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539129:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518611.539135:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539143:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539152:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518611.539155:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518611.539159:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539174:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c78587c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539186:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539192:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539198:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539211:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518611.539215:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539221:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539230:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x966f5d0b (ffff99ffc2d97400) 00010000:00010000:0.0:1789518611.539232:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518611.539247:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.539254:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785883 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x966f5d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.539376:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:31669:x1876445617271808:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 617us (867us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518611.539383:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1789518611.541946:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.542052:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617271936 00000100:00100000:1.0:1789518611.542065:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617271936 00000100:00100000:1.0:1789518611.542137:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:1.0:1789518611.542150:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:31669:x1876445617271936:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518611.542180:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518611.542211:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78588a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd934 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.542267:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.542307:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.542321:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.542442:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c78588a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd934 expref: 38 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.542464:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd934 expref: 37 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.542474:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:1.0:1789518611.542477:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518611.542481:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0800, rc 0) 00000100:00100000:1.0:1789518611.542569:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:31669:x1876445617271936:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 421us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518611.542577:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:2.0:1789518611.545290:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.545675:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617272192 00000100:00100000:0.0:1789518611.545689:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617272192 00000100:00100000:0.0:1789518611.545766:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:0.0:1789518611.545781:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:31669:x1876445617272192:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518611.545920:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.545940:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.545954:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518611.546994:0:37723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].2, 88 off8344 00000004:00080000:0.0:1789518611.547021:0:37723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665543406239ns, next at 666543402832ns, rc = 0 00000004:00010000:0.0:1789518611.547123:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002518240d reply state 00000000a4718ed4 transno 30064771100 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.547133:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518611.547259:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:31669:x1876445617272192:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1476us (1980us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1789518611.547269:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00010000:00010000:1.0:1789518611.550313:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.550335:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.550345:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.550351:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518611.550357:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518611.550375:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518611.550375:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.550396:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:1.0:1789518611.550399:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518611.550406:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.550413:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696000/0x631fd8698c785898 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.550473:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617272320 00000100:00100000:0.0:1789518611.550485:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617272320 00000100:00100000:0.0:1789518611.550602:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:0.0:1789518611.550644:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:31669:x1876445617272320:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518611.550687:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518611.550707:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd93b expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.550790:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd93b expref: 39 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.550806:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd93b expref: 39 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.550829:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:0.0:1789518611.550832:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518611.550835:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696a00, rc 0) 00000100:00100000:0.0:1789518611.550922:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:31669:x1876445617272320:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 309us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.550930:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518611.553788:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.553872:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617272448 00000100:00100000:0.0:1789518611.553884:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617272448 00000100:00100000:0.0:1789518611.553941:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518611.553952:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2343:x1876445617272448:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789518611.554580:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617272448:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 627us (803us total) trans 30064771074 rc 0/0 00000100:00100000:0.0:1789518611.554589:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518611.556547:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518611.556788:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617272704 00000100:00100000:2.0:1789518611.556800:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617272704 00000100:00100000:2.0:1789518611.556870:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1789518611.556881:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:31669:x1876445617272704:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518611.557178:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:31669:x1876445617272704:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 298us (639us total) trans 30064771101 rc 0/0 00000100:00100000:2.0:1789518611.557203:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518611.562062:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.562246:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617272960 00000100:00100000:0.0:1789518611.562258:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617272960 00000100:00100000:0.0:1789518611.562346:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:0.0:1789518611.562357:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:31669:x1876445617272960:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518611.562502:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:31669:x1876445617272960:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 146us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.562527:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:1.0:1789518611.566760:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518611.566974:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617273088 00000100:00100000:2.0:1789518611.566988:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617273088 00000100:00100000:2.0:1789518611.567060:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:2.0:1789518611.567073:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:31669:x1876445617273088:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518611.567100:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518611.567127:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c7858a6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd942 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.567222:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7858ad lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.567240:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7858ad lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.567253:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7858ad lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518611.567298:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518611.567317:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7858ad lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.567507:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4000/0x631fd8698c7858a6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd942 expref: 42 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.567528:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7858ad lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd942 expref: 41 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.567537:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:2.0:1789518611.567557:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518611.567561:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5c00, rc 0) 00000100:00100000:2.0:1789518611.567777:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:31669:x1876445617273088:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 700us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.567785:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 10000000:01000000:3.0:1789518611.570732:0:35842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518611.570743:0:35842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffc6496800 from 10 10000000:01000000:3.0:1789518611.570751:0:35842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518611.570835:0:35842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c7858b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.570849:0:35842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c7858b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.570862:0:35842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c7858b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.570873:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518611.570913:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.570918:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617273216 00000100:00100000:0.0:1789518611.570929:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617273216 00000100:00100000:3.0:1789518611.570986:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518611.571002:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518611.571014:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617273216:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518611.571033:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789518611.571047:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf780 going to sleep for 11 seconds 00010000:00010000:0.0:1789518611.571058:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd949 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518611.571103:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e314, blocks: 0x1 00010000:00010000:0.0:1789518611.571124:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=665s v=(0 0) 00010000:00010000:0.0:1789518611.571129:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518611.571140:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd949 expref: 7 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.571165:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd949 expref: 7 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.571180:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697a00, rc 0) 00000100:00100000:2.0:1789518611.571210:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627638144 00000100:00100000:2.0:1789518611.571216:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627638144 00000100:00100000:2.0:1789518611.571248:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518611.571250:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617273216:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 239us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.571258:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518611.571265:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+16:35842:x1876445627638144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789518611.571272:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518611.571286:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec26d4c00/0x631fd8698c7858c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7858b4 expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.571306:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec26d4c00/0x631fd8698c7858c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7858b4 expref: 17 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.571317:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec26d4c00/0x631fd8698c7858c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7858b4 expref: 17 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.571324:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4c00, rc 0) 00000100:00100000:2.0:1789518611.571376:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:35842:x1876445627638144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.571382:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518611.571837:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518611.571861:0:35842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c7858b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7858c2 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.572481:0:35842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c7858b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7858c2 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.572585:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.572669:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518611.572701:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9216480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518611.572703:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627638272 00000100:00100000:2.0:1789518611.572709:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627638272 00000100:00100000:2.0:1789518611.572753:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789518611.572762:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+17:35842:x1876445627638272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518611.573180:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+17:35842:x1876445627638272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 417us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.573196:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789518611.573689:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518611.573740:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518611.573804:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518611.573838:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518611.573966:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627638400 00000100:00100000:2.0:1789518611.573971:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627638400 00000100:00100000:2.0:1789518611.574003:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789518611.574012:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:35842:x1876445627638400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518611.574216:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+17:35842:x1876445627638400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.574224:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789518611.574423:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.575515:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000040:00080000:1.0:1789518611.575561:0:37974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:2.0:1789518611.575589:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617273472 00000100:00100000:2.0:1789518611.575596:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617273472 00000100:00100000:2.0:1789518611.575673:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:2.0:1789518611.575685:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:31669:x1876445617273472:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000020:01000000:3.0:1789518611.575888:0:35842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789518611.575917:0:35842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789518611.575928:0:35842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c7858b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7858c2 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.575938:0:35842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4981e00/0x631fd8698c7858b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7858c2 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789518611.575948:0:35842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789518611.575950:0:35842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ffed4de000 from 10 10000000:01000000:3.0:1789518611.575952:0:35842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789518611.575982:0:35842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980e00/0x631fd8698c7858c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.575988:0:35842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99fec4980e00/0x631fd8698c7858c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.575995:0:35842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99fec4980e00/0x631fd8698c7858c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518611.576028:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789518611.576113:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:31669:x1876445617273472:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 429us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.576121:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:3.0:1789518611.576333:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518611.576368:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518611.576519:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627638528 00000100:00100000:0.0:1789518611.576525:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627638528 00000100:00100000:0.0:1789518611.576567:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789518611.576575:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+17:35842:x1876445627638528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518611.576585:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518611.576602:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffd0696000/0x631fd8698c7858d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7858c9 expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.576668:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffd0696000/0x631fd8698c7858d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7858c9 expref: 18 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.576682:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffd0696000/0x631fd8698c7858d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7858c9 expref: 18 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.576693:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696000, rc 0) 00000100:00100000:0.0:1789518611.576731:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+18:35842:x1876445627638528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.576737:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789518611.576949:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518611.576966:0:35842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99fec4980e00/0x631fd8698c7858c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7858d0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.576977:0:35842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99fec4980e00/0x631fd8698c7858c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7858d0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518611.577046:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518611.577075:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518611.577104:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518611.577257:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627638656 00000100:00100000:2.0:1789518611.577262:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627638656 00000100:00100000:2.0:1789518611.577294:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789518611.577301:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+18:35842:x1876445627638656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789518611.577665:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+18:35842:x1876445627638656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.577672:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789518611.577874:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518611.577909:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789518611.577959:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518611.577991:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518611.578041:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627638784 00000100:00100000:2.0:1789518611.578046:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627638784 00000100:00100000:2.0:1789518611.578119:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789518611.578126:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+18:35842:x1876445627638784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518611.578332:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+18:35842:x1876445627638784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.578340:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789518611.578420:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789518611.579476:0:37975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789518611.579754:0:35842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789518611.579798:0:35842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789518611.579816:0:35842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99fec4980e00/0x631fd8698c7858c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7858d0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.579830:0:35842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99fec4980e00/0x631fd8698c7858c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7858d0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789518611.579841:0:35842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789518611.579844:0:35842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99fff4010800 from 10 10000000:01000000:0.0:1789518611.579847:0:35842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789518611.579888:0:35842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c7858d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.579896:0:35842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c7858d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.579908:0:35842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c7858d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.579930:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.579987:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518611.580034:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518611.580471:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518611.580508:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627638912 00000100:00100000:2.0:1789518611.580516:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627638912 00000100:00100000:0.0:1789518611.580584:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617273600 00000100:00100000:0.0:1789518611.580588:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617273600 00000100:00100000:2.0:1789518611.580639:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789518611.580654:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518611.580662:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+18:35842:x1876445627638912:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.580662:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:31669:x1876445617273600:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518611.580678:0:35837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518611.580679:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518611.580695:0:35837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec26d4000/0x631fd8698c7858de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x631fd8698c7858d7 expref: -99 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.580695:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd950 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.580721:0:35837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec26d4000/0x631fd8698c7858de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x631fd8698c7858d7 expref: 19 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.580732:0:35837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec26d4000/0x631fd8698c7858de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x631fd8698c7858d7 expref: 19 pid: 35837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.580733:0:37973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd949 expref: 8 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.580742:0:35837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4000, rc 0) 00010000:00010000:0.0:1789518611.580743:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518611.580748:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518611.580752:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 8 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518611.580790:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:35842:x1876445627638912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.580797:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789518611.580861:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627638912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789518611.580874:0:35842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c7858d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7858de expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.580882:0:35842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c7858d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x631fd8698c7858de expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.580924:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627639040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.580944:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518611.580966:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518611.580975:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627639040 00000100:00100000:2.0:1789518611.580979:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627639040 00010000:00010000:0.0:1789518611.580986:0:37973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd949 expref: 8 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518611.581001:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00010000:00010000:0.0:1789518611.581001:0:37973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd949 expref: 8 pid: 36532 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518611.581011:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:35842:x1876445627639040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.581013:0:37973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:37973:1876445627639168:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518611.581086:0:37973:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518611.581383:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:35842:x1876445627639040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 371us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.581401:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789518611.581584:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627639040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.581641:0:35842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627639296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.581694:0:35842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518611.581715:0:35842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518611.581870:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627639296 00000100:00100000:2.0:1789518611.581876:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627639296 00000100:00100000:2.0:1789518611.581900:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789518611.581913:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:35842:x1876445627639296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789518611.582089:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:35842:x1876445627639296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.582095:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789518611.582278:0:35842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d183546-773a-47ec-8f5a-25077d1135e5:35842:1876445627639296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789518611.583801:0:37976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789518611.583889:0:35842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789518611.583919:0:35842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789518611.583933:0:35842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c7858d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7858de expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.583946:0:35842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff99ffd0696e00/0x631fd8698c7858d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x631fd8698c7858de expref: -99 pid: 35842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.584389:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.584407:0:37973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:37973:1876445627639168:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518611.584442:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 8 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518611.584463:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617273728 00010000:00010000:0.0:1789518611.584464:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697200, rc 0) 00000100:00100000:3.0:1789518611.584470:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617273728 00010000:00010000:3.0:1789518611.584501:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd949 expref: 9 pid: 36532 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.584527:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:31669:x1876445617273600:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3866us (4063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.584535:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1789518611.584536:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518611.584544:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617273728:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518611.584723:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518611.584750:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd949 expref: 8 pid: 36532 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.584765:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd949 expref: 8 pid: 36532 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.584805:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000949cb8b0/0x631fd8698c7858bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd949 expref: 8 pid: 36532 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.584820:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518611.584825:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518611.584833:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.585467:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.585511:0:35830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518611.585528:0:35830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35830:1876445627639424:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518611.585608:0:35830:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3063780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518611.589095:0:35830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35830:1876445627639424:192.168.206.51@tcp:105: 00010000:00010000:3.0:1789518611.589128:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518611.589247:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617273728:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4701us (4861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518611.589259:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518611.594741:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518611.594813:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617273856 00000100:00100000:3.0:1789518611.594825:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617273856 00002000:00100000:3.0:1789518611.594876:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff99fff7389880 x1876445617273856/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789518611.594886:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7389880 with x1876445617273856 ext(0->409599) 00002000:00010000:3.0:1789518611.594892:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7389880 00000100:00100000:3.0:1789518611.594959:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518611.594968:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617273856:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789518611.607092:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617273856:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 12115us (12353us total) trans 30064771075 rc 0/0 00000100:00100000:3.0:1789518611.607106:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:3.0:1789518611.607121:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff99fff7389880 x1876445617273856/t30064771075(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:257/0 lens 488/448 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789518611.607131:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7389880 with x1876445617273856 ext(0->409599) 00002000:00010000:3.0:1789518611.607137:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7389880 00000100:00100000:1.0:1789518611.609730:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.609781:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617273984 00000100:00100000:0.0:1789518611.609799:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617273984 00000100:00100000:0.0:1789518611.609889:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:0.0:1789518611.609901:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:31669:x1876445617273984:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789518611.651759:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771100 is committed 00000004:00080000:3.0:1789518611.651770:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789518611.652127:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:31669:x1876445617273984:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 42222us (42399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518611.652141:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:0.0:1789518611.652177:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627639552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789518611.652232:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1789518611.652287:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771101 is committed 00000001:00080000:3.0:1789518611.652301:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771097 is committed 00000100:00100000:0.0:1789518611.652327:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627639552 00000100:00100000:0.0:1789518611.652336:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627639552 00000100:00100000:0.0:1789518611.652400:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518611.652422:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627639552:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1789518611.652641:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789518611.652688:0:36735:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:0.0:1789518611.652693:0:36735:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1789518612 00002000:00010000:0.0:1789518611.652695:0:36735:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518611.652697:0:36735:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1789518612 -> 1789518612 00002000:00010000:0.0:1789518611.652699:0:36735:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518611.652738:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627639552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 317us (507us total) trans 30064771076 rc 0/0 00000100:00100000:0.0:1789518611.652745:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1789518611.652906:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffc6389880/2, rc 0, transno 30064771076 00000100:00100000:1.0:1789518611.652913:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627639552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789518611.655451:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518611.655639:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617274112 00000100:00100000:3.0:1789518611.655661:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617274112 00000100:00100000:3.0:1789518611.655827:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518611.655837:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617274112:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789518611.679843:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617274112:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 23997us (24390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.679857:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000001:00080000:3.0:1789518611.679943:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771076 is committed 00000001:00080000:3.0:1789518611.679952:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771074 is committed 00000001:00080000:3.0:1789518611.679958:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771075 is committed 00000100:00100000:1.0:1789518611.682094:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.682377:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617274368 00000100:00100000:0.0:1789518611.682387:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617274368 00000100:00100000:0.0:1789518611.682503:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:0.0:1789518611.682513:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31669:x1876445617274368:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518611.682565:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518611.682590:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7858ad lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd942 expref: 13 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.682611:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:0.0:1789518611.682679:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518611.682714:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.682728:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.682753:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518611.682989:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018477566 reply state 0000000082951b1f transno 30064771102 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.683012:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518611.683108:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:31669:x1876445617274368:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 596us (1021us total) trans 30064771102 rc 0/0 00000100:00100000:1.0:1789518611.683116:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00010000:00010000:2.0:1789518611.684993:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.685008:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.685015:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.685034:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518611.685039:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.685046:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.685112:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:2.0:1789518611.685116:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518611.685120:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.685126:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c7858ec lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.686396:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.686478:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617274496 00000100:00100000:0.0:1789518611.686488:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617274496 00000100:00100000:0.0:1789518611.686543:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518611.686553:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617274496:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789518611.686874:0:37973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:0.0:1789518611.686878:0:37973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 1789518612 -> 1789518611 00002000:00010000:0.0:1789518611.686880:0:37973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb atime from disk: 0 -> 1789518611 00002000:00010000:0.0:1789518611.686883:0:37973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1789518612 -> 1789518611 00002000:00010000:0.0:1789518611.686885:0:37973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:0.0:1789518611.686936:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617274496:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 384us (545us total) trans 30064771077 rc 0/0 00000100:00100000:0.0:1789518611.687266:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518611.691487:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518611.691535:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617274752 00000100:00100000:2.0:1789518611.691545:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617274752 00000100:00100000:2.0:1789518611.691638:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1789518611.691663:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31669:x1876445617274752:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789518611.691727:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.691755:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd934 expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.691765:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.691797:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd934 expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.691824:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd934 expref: 13 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518611.691836:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627639680:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518611.691915:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518611.693730:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.693756:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627639680:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518611.693779:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.693839:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617274880 00000100:00100000:0.0:1789518611.693845:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617274880 00010000:00010000:0.0:1789518611.693874:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd934 expref: 14 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.693911:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518611.693921:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617274880:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518611.693933:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518611.693940:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd934 expref: 14 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.693966:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd934 expref: 14 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.693986:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c785891 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd934 expref: 14 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.694000:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:0.0:1789518611.694005:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.694014:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.694021:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.694050:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518611.694102:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617274880:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 183us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.694110:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00010000:00010000:1.0:1789518611.694135:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.694145:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.694171:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.694179:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.694190:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.694196:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518611.694201:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.694225:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.694235:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:1.0:1789518611.694238:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789518611.694241:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.694248:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7858f3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.694362:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:31669:x1876445617274752:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 2714us (2882us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789518611.694375:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1789518611.695725:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.695827:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617275008 00000100:00100000:1.0:1789518611.695834:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617275008 00000100:00100000:1.0:1789518611.696102:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:1.0:1789518611.696111:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617275008:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789518611.696146:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.696165:0:36735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.696172:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518611.696176:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518611.696180:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.696220:0:36735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.696233:0:36735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 7 pid: 37973 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.696246:0:36735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36735:1876445627639808:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518611.696325:0:36735:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518611.699158:0:36735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36735:1876445627639808:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518611.699159:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518611.699191:0:36735:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518611.699320:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617275136 00000100:00100000:3.0:1789518611.699327:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617275136 00010000:00010000:3.0:1789518611.699358:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 8 pid: 37973 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518611.699396:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518611.699406:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617275136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518611.699420:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518611.699461:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 8 pid: 37973 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.699475:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 8 pid: 37973 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.699497:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c7858e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd950 expref: 8 pid: 37973 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.699511:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518611.699516:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518611.699521:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.699546:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.699577:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518611.699675:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617275136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 270us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518611.699683:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00010000:00010000:1.0:1789518611.699739:0:36735:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.699749:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.699777:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.699787:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.699807:0:36735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.699815:0:36735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518611.699820:0:36735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.699831:0:36735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.699844:0:36735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.699851:0:36735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d45c37ed/0x631fd8698c7858fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.699921:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617275008:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 3810us (4197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518611.699929:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518611.702235:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.702533:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617275392 00000100:00100000:0.0:1789518611.702541:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617275392 00000100:00100000:0.0:1789518611.702681:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:0.0:1789518611.702692:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:31669:x1876445617275392:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518611.702763:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.702779:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.702803:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.703038:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.703049:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd93b expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.703057:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.703089:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd93b expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.703104:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd93b expref: 13 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.703117:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627639936:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518611.703194:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518611.708929:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627639936:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518611.708962:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518611.709099:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.709327:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617275520 00000100:00100000:0.0:1789518611.709334:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617275520 00010000:00010000:0.0:1789518611.709367:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd93b expref: 14 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.709414:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518611.709423:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617275520:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518611.709440:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518611.709447:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd93b expref: 14 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.709459:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd93b expref: 14 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.709484:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c78589f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd93b expref: 14 pid: 35847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.709498:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:0.0:1789518611.709503:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.709512:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.709520:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.709550:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518611.709684:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.709693:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.709706:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617275520:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 283us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.709716:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000001:00080000:2.0:1789518611.710102:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771103 00000001:00080000:2.0:1789518611.710275:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771104 00000001:00080000:2.0:1789518611.710318:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771105 00000100:00100000:2.0:1789518611.710388:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627640064:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518611.710477:0:37723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518611.710504:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518611.710547:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627640064 00000100:00100000:1.0:1789518611.710554:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627640064 00000100:00100000:1.0:1789518611.710602:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789518611.710611:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627640064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518611.710736:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627640064:12345-0@lo:1000:mdt00_003.0 Request processed in 127us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518611.710752:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789518611.710780:0:37723:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771076 gen 2 00000004:00080000:2.0:1789518611.710786:0:37723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffc6389880, transno 30064771076 00000100:00100000:2.0:1789518611.710806:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627640064:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789518611.711460:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771106 00000100:00100000:2.0:1789518611.711515:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627640192:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518611.711546:0:37723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518611.711580:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518611.711854:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627640192 00000100:00100000:1.0:1789518611.712012:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627640192 00000100:00100000:1.0:1789518611.712048:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789518611.712057:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627640192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518611.712387:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:37723:x1876445627640192:12345-0@lo:1000:mdt00_003.0 Request processed in 330us (838us total) trans 30064771078 rc 0/0 00000100:00100000:2.0:1789518611.712394:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627640192:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518611.712400:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789518611.712431:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712442:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712451:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712457:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518611.712463:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712471:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712487:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed200) 00010000:00010000:2.0:1789518611.712490:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518611.712495:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712501:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785908 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712539:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712546:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712553:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712566:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518611.712570:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712577:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712588:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:2.0:1789518611.712591:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518611.712598:0:37723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785836 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd91f expref: 7 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712610:0:37723:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785836 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd91f expref: 7 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712639:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785836 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd91f expref: 7 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.712868:0:37723:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785836 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd91f expref: 7 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518611.712882:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627640320:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518611.713026:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518611.715754:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.715853:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617275648 00000100:00100000:0.0:1789518611.715894:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627640320:192.168.206.51@tcp:105: 00010000:00010000:0.0:1789518611.715931:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.715943:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617275648 00010000:00010000:0.0:1789518611.715944:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c78582f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.715976:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.715988:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.715998:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00010000:00010000:0.0:1789518611.716010:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.716012:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe0148c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31667:x1876445617275648:12345-192.168.206.51@tcp:49:mmap_sanity.0 00010000:00010000:0.0:1789518611.716028:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716033:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716037:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716046:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518611.716049:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716054:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716062:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:0.0:1789518611.716068:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518611.716072:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716076:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c78590f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716084:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716088:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716091:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716094:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518611.716096:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716099:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716104:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:0.0:1789518611.716105:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518611.716107:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.716110:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785901 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518611.716313:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:31669:x1876445617275392:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 13619us (14082us total) trans 30064771107 rc 0/0 00000100:00100000:0.0:1789518611.716332:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000020:00080000:0.0:1789518611.716338:0:37723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789518611.716533:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe0148c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31667:x1876445617275648:12345-192.168.206.51@tcp:49:mmap_sanity.0 Request processed in 522us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518611.716542:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000040:00080000:2.0:1789518611.716545:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518611.716551:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518611.716593:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 2 count 2 00000040:00080000:2.0:1789518611.716640:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518611.718560:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.718696:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617275776 00000100:00100000:0.0:1789518611.718705:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617275776 00000100:00100000:0.0:1789518611.718752:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1789518611.718760:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:31667:x1876445617275776:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518611.718773:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518611.718790:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd957 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518611.718797:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00002000:00010000:0.0:1789518611.718813:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6aa9e313, atime: 0x6aa9e313, ctime: 0x6aa9e313, blocks: 0x403 00010000:00010000:0.0:1789518611.718832:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=665s v=(0 0) 00010000:00010000:0.0:1789518611.718836:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518611.718845:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd957 expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518611.718860:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd957 expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518611.718868:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617276032 00000100:00100000:1.0:1789518611.718873:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617276032 00010000:00010000:0.0:1789518611.718873:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696a00, rc 0) 00000100:00100000:1.0:1789518611.718905:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1789518611.718911:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:31669:x1876445617276032:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518611.718931:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31667:x1876445617275776:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 169us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.718939:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000004:00080000:1.0:1789518611.719450:0:35849:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789518611.719597:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771108 00010000:00010000:1.0:1789518611.719642:0:35849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.719665:0:35849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.719681:0:35849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.719695:0:35849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.719699:0:35849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.719703:0:35849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.719716:0:35849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789518611.719767:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31669:x1876445617276032:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 856us (970us total) trans 30064771109 rc 0/0 00010000:00010000:2.0:1789518611.719770:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789518611.719774:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00010000:00010000:2.0:1789518611.719780:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789518611.719780:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518611.719790:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518611.719794:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.719803:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.719813:0:35834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff99ffc13ed300) 00010000:00010000:2.0:1789518611.719816:0:35834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518611.719820:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.719825:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0600/0x631fd8698c78591d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518611.719840:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518611.719841:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518611.719843:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518611.720497:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.720601:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617276160 00000100:00100000:0.0:1789518611.720608:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617276160 00002000:00100000:0.0:1789518611.720706:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->4095) req@ffff99ffefff1500 x1876445617276160/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.720724:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff1500 with x1876445617276160 ext(0->4095) 00002000:00010000:0.0:1789518611.720728:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff1500 00000100:00100000:0.0:1789518611.720791:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1789518611.720800:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617276160:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518611.725415:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617276160:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 4605us (4909us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518611.725429:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00002000:00100000:0.0:1789518611.725441:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->4095) req@ffff99ffefff1500 x1876445617276160/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/4536 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.725453:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff1500 with x1876445617276160 ext(0->4095) 00002000:00010000:0.0:1789518611.725460:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff1500 00000100:00100000:3.0:1789518611.731791:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.731987:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617276288 00000100:00100000:0.0:1789518611.731996:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617276288 00002000:00100000:0.0:1789518611.732040:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (4096->8191) req@ffff99ffefff3b80 x1876445617276288/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.732050:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff3b80 with x1876445617276288 ext(4096->8191) 00002000:00010000:0.0:1789518611.732060:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff3b80 00000100:00100000:0.0:1789518611.732089:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1789518611.732098:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2344:x1876445617276288:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518611.732289:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2344:x1876445617276288:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 192us (505us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518611.732296:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:0.0:1789518611.732319:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (4096->8191) req@ffff99ffefff3b80 x1876445617276288/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/4536 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.732327:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff3b80 with x1876445617276288 ext(4096->8191) 00002000:00010000:0.0:1789518611.732331:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff3b80 00000100:00100000:3.0:1789518611.735401:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.735472:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617276416 00000100:00100000:0.0:1789518611.735481:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617276416 00002000:00100000:0.0:1789518611.735523:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (8192->12287) req@ffff99ffefff3800 x1876445617276416/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.735533:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff3800 with x1876445617276416 ext(8192->12287) 00002000:00010000:0.0:1789518611.735539:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff3800 00000100:00100000:0.0:1789518611.735568:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1789518611.735578:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617276416:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518611.735794:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617276416:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 217us (401us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518611.735799:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00002000:00100000:0.0:1789518611.735803:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (8192->12287) req@ffff99ffefff3800 x1876445617276416/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/4536 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.735810:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff3800 with x1876445617276416 ext(8192->12287) 00002000:00010000:0.0:1789518611.735813:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff3800 00000100:00100000:1.0:1789518611.740531:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518611.740741:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617276544 00000100:00100000:3.0:1789518611.740752:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617276544 00002000:00100000:3.0:1789518611.740793:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (12288->69631) req@ffff99fff7a78000 x1876445617276544/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518611.740801:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a78000 with x1876445617276544 ext(12288->69631) 00002000:00010000:3.0:1789518611.740806:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a78000 00000100:00100000:3.0:1789518611.740826:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518611.740836:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2345:x1876445617276544:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:3.0:1789518611.743670:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2345:x1876445617276544:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 2825us (3136us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1789518611.743682:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00002000:00100000:3.0:1789518611.743695:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (12288->69631) req@ffff99fff7a78000 x1876445617276544/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518611.743724:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a78000 with x1876445617276544 ext(12288->69631) 00002000:00010000:3.0:1789518611.743731:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a78000 00000100:00100000:3.0:1789518611.751092:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.751174:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617276672 00000100:00100000:0.0:1789518611.751186:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617276672 00002000:00100000:0.0:1789518611.751238:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (69632->106495) req@ffff99ffefff3100 x1876445617276672/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.751250:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff3100 with x1876445617276672 ext(69632->106495) 00002000:00010000:0.0:1789518611.751270:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff3100 00000100:00100000:0.0:1789518611.751483:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518611.751494:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617276672:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518611.753716:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617276672:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 2215us (2625us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518611.753728:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00002000:00100000:0.0:1789518611.753739:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (69632->106495) req@ffff99ffefff3100 x1876445617276672/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.753750:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff3100 with x1876445617276672 ext(69632->106495) 00002000:00010000:0.0:1789518611.753756:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff3100 00000100:00100000:3.0:1789518611.760244:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.760377:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617276800 00000100:00100000:0.0:1789518611.760386:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617276800 00002000:00100000:0.0:1789518611.761078:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (106496->143359) req@ffff99ffefff0000 x1876445617276800/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.761091:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff0000 with x1876445617276800 ext(106496->143359) 00002000:00010000:0.0:1789518611.761097:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff0000 00000100:00100000:0.0:1789518611.761131:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518611.761142:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617276800:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:1.0:1789518611.764193:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617276800:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3042us (3947us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789518611.764211:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00002000:00100000:1.0:1789518611.764225:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (106496->143359) req@ffff99ffefff0000 x1876445617276800/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518611.764235:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff0000 with x1876445617276800 ext(106496->143359) 00002000:00010000:1.0:1789518611.764242:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff0000 00000100:00100000:3.0:1789518611.771807:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.771951:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617276928 00000100:00100000:0.0:1789518611.771960:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617276928 00002000:00100000:0.0:1789518611.772008:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (143360->180223) req@ffff99ffefff3480 x1876445617276928/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.772021:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff3480 with x1876445617276928 ext(143360->180223) 00002000:00010000:0.0:1789518611.772027:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff3480 00000100:00100000:0.0:1789518611.772071:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1789518611.772081:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2345:x1876445617276928:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518611.776069:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2345:x1876445617276928:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3980us (4263us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518611.776081:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00002000:00100000:0.0:1789518611.776094:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (143360->180223) req@ffff99ffefff3480 x1876445617276928/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.776105:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff3480 with x1876445617276928 ext(143360->180223) 00002000:00010000:0.0:1789518611.776112:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff3480 00000100:00100000:2.0:1789518611.784085:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.784198:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617277056 00000100:00100000:1.0:1789518611.784208:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617277056 00002000:00100000:1.0:1789518611.784284:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc2:0x0] (180224->217087) req@ffff99fec28af100 x1876445617277056/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518611.784589:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28af100 with x1876445617277056 ext(180224->217087) 00002000:00010000:1.0:1789518611.784597:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec28af100 00000100:00100000:3.0:1789518611.784748:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518611.784759:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2345:x1876445617277056:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:1.0:1789518611.787880:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2345:x1876445617277056:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3114us (3795us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789518611.787893:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00002000:00100000:1.0:1789518611.787905:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (180224->217087) req@ffff99fec28af100 x1876445617277056/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518611.787920:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28af100 with x1876445617277056 ext(180224->217087) 00002000:00010000:1.0:1789518611.787927:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec28af100 00000100:00100000:3.0:1789518611.792851:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.793189:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617277184 00000100:00100000:0.0:1789518611.793199:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617277184 00002000:00100000:0.0:1789518611.793913:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (217088->253951) req@ffff99ffefff2a00 x1876445617277184/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.793925:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff2a00 with x1876445617277184 ext(217088->253951) 00002000:00010000:0.0:1789518611.793931:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff2a00 00000100:00100000:0.0:1789518611.794039:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1789518611.794052:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617277184:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518611.800446:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617277184:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 6388us (7595us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518611.800459:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00002000:00100000:0.0:1789518611.800471:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (217088->253951) req@ffff99ffefff2a00 x1876445617277184/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.800481:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff2a00 with x1876445617277184 ext(217088->253951) 00002000:00010000:0.0:1789518611.800501:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff2a00 00000100:00100000:3.0:1789518611.805326:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.805792:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617277312 00000100:00100000:1.0:1789518611.805806:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617277312 00002000:00100000:1.0:1789518611.805870:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (253952->290815) req@ffff99ffefff2680 x1876445617277312/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518611.805884:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff2680 with x1876445617277312 ext(253952->290815) 00002000:00010000:1.0:1789518611.805892:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff2680 00000100:00100000:1.0:1789518611.805934:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1789518611.805946:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2345:x1876445617277312:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:1.0:1789518611.811472:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2345:x1876445617277312:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 5513us (6147us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789518611.811488:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00002000:00100000:1.0:1789518611.811505:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (253952->290815) req@ffff99ffefff2680 x1876445617277312/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518611.811536:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff2680 with x1876445617277312 ext(253952->290815) 00002000:00010000:1.0:1789518611.811544:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff2680 00000100:00100000:2.0:1789518611.819769:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.819888:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617277440 00000100:00100000:0.0:1789518611.819901:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617277440 00002000:00100000:0.0:1789518611.819962:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (290816->327679) req@ffff99fec28ac000 x1876445617277440/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.819981:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28ac000 with x1876445617277440 ext(290816->327679) 00002000:00010000:0.0:1789518611.819988:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec28ac000 00000100:00100000:0.0:1789518611.820031:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518611.820043:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617277440:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518611.822747:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617277440:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 2692us (2978us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518611.822762:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00002000:00100000:0.0:1789518611.822779:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (290816->327679) req@ffff99fec28ac000 x1876445617277440/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.822791:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28ac000 with x1876445617277440 ext(290816->327679) 00002000:00010000:0.0:1789518611.822799:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec28ac000 00000100:00100000:3.0:1789518611.827148:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.828685:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617277568 00000100:00100000:1.0:1789518611.828704:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617277568 00002000:00100000:1.0:1789518611.828777:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (327680->364543) req@ffff99ffefff0380 x1876445617277568/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518611.828791:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff0380 with x1876445617277568 ext(327680->364543) 00002000:00010000:1.0:1789518611.828799:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff0380 00000100:00100000:1.0:1789518611.828855:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518611.828866:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617277568:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:1.0:1789518611.835363:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617277568:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 6481us (8212us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789518611.835380:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00002000:00100000:1.0:1789518611.835397:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (327680->364543) req@ffff99ffefff0380 x1876445617277568/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518611.835410:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff0380 with x1876445617277568 ext(327680->364543) 00002000:00010000:1.0:1789518611.835418:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff0380 00000100:00100000:3.0:1789518611.841675:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.841731:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617277696 00000100:00100000:0.0:1789518611.841745:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617277696 00002000:00100000:0.0:1789518611.842312:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (364544->401407) req@ffff99ffefff0e00 x1876445617277696/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.842324:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff0e00 with x1876445617277696 ext(364544->401407) 00002000:00010000:0.0:1789518611.842331:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff0e00 00000100:00100000:0.0:1789518611.842374:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518611.842385:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617277696:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518611.845053:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617277696:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 2653us (3422us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518611.845068:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00002000:00100000:0.0:1789518611.845085:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (364544->401407) req@ffff99ffefff0e00 x1876445617277696/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/440 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.845098:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff0e00 with x1876445617277696 ext(364544->401407) 00002000:00010000:0.0:1789518611.845105:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff0e00 00000100:00100000:1.0:1789518611.850916:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.850988:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617277824 00000100:00100000:0.0:1789518611.851002:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617277824 00002000:00100000:0.0:1789518611.851078:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (401408->409599) req@ffff99fff7a79180 x1876445617277824/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/0 e 0 to 0 dl 1789518622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.851093:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a79180 with x1876445617277824 ext(401408->409599) 00002000:00010000:0.0:1789518611.851101:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a79180 00000100:00100000:0.0:1789518611.851143:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518611.851154:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617277824:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518611.852754:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617277824:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 1590us (1841us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1789518611.852767:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00002000:00100000:0.0:1789518611.852779:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (401408->409599) req@ffff99fff7a79180 x1876445617277824/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:257/0 lens 488/8632 e 0 to 0 dl 1789518622 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518611.852790:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a79180 with x1876445617277824 ext(401408->409599) 00002000:00010000:0.0:1789518611.852798:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a79180 00000100:00100000:3.0:1789518611.855919:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518611.856430:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617278080 00000100:00100000:2.0:1789518611.856443:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617278080 00000100:00100000:2.0:1789518611.856523:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1789518611.856535:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31667:x1876445617278080:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000001:00080000:2.0:1789518611.857873:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771110 00000100:00100000:2.0:1789518611.858046:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31667:x1876445617278080:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 1508us (2138us total) trans 30064771111 rc 0/0 00000100:00100000:2.0:1789518611.858058:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000020:00080000:2.0:1789518611.858065:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789518611.917562:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.917708:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617278208 00000100:00100000:1.0:1789518611.917721:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617278208 00000100:00100000:1.0:1789518611.917795:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:1.0:1789518611.917809:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+11:31052:x1876445617278208:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789518611.917831:0:35839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518611.917870:0:35839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785924 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd95e expref: -99 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.917910:0:35839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd95e expref: 12 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.917924:0:35839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffc29e0600/0x631fd8698c785924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd95e expref: 12 pid: 35839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518611.917934:0:35839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0600, rc 0) 00000100:00100000:1.0:1789518611.918360:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31052:x1876445617278208:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 552us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518611.918368:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:1.0:1789518611.920934:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518611.921044:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617278336 00000100:00100000:3.0:1789518611.921056:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617278336 00000100:00100000:3.0:1789518611.921335:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:3.0:1789518611.921348:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31052:x1876445617278336:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789518611.921815:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31052:x1876445617278336:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 468us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518611.921825:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:3.0:1789518611.924992:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.925069:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617278464 00000100:00100000:0.0:1789518611.925102:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617278464 00000100:00100000:0.0:1789518611.925177:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:0.0:1789518611.925190:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31052:x1876445617278464:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.926193:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31052:x1876445617278464:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 1000us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.926206:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:2.0:1789518611.932181:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518611.932244:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617278592 00000100:00100000:3.0:1789518611.932255:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617278592 00000100:00100000:3.0:1789518611.932314:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:3.0:1789518611.932324:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+12:31052:x1876445617278592:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789518611.932359:0:35840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518611.932379:0:35840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fec4980800/0x631fd8698c78592b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd965 expref: -99 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.932412:0:35840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fec4980800/0x631fd8698c78592b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd965 expref: 13 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.932424:0:35840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fec4980800/0x631fd8698c78592b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd965 expref: 13 pid: 35840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518611.932436:0:35840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4980800, rc 0) 00000100:00100000:3.0:1789518611.932518:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31052:x1876445617278592:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 193us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518611.932526:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518611.934760:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518611.934879:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617278720 00000100:00100000:0.0:1789518611.934890:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617278720 00000100:00100000:0.0:1789518611.934990:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1789518611.935002:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31052:x1876445617278720:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789518611.935658:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31052:x1876445617278720:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 646us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518611.935669:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1789518611.938854:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518611.938930:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617278848 00000100:00100000:1.0:1789518611.938944:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617278848 00000100:00100000:1.0:1789518611.939016:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:1.0:1789518611.939028:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31052:x1876445617278848:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789518611.939754:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:31052:x1876445617278848:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 582us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518611.939768:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00010000:00010000:1.0:1789518612.338736:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518612.991812:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518612.992739:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617279104 00000100:00100000:1.0:1789518612.992752:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617279104 00000100:00100000:1.0:1789518612.992844:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518612.992857:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31666:x1876445617279104:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789518612.993223:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31666:x1876445617279104:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 369us (1424us total) trans 30064771112 rc 0/0 00000100:00100000:1.0:1789518612.993248:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00080000:0.0:1789518612.994650:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518613.000745:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.000844:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617279232 00000100:00100000:0.0:1789518613.000857:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617279232 00000100:00100000:0.0:1789518613.000989:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:0.0:1789518613.001001:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31666:x1876445617279232:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518613.001034:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518613.001059:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785932 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd96c expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001144:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001162:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001213:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001232:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001240:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001248:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001572:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785947 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001583:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785947 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001590:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785947 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518613.001677:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:0.0:1789518613.001683:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518613.001707:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785947 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001721:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785947 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001730:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001748:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001755:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001762:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518613.001768:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001777:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001791:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518613.001794:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518613.001801:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001807:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785939 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001821:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001827:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001833:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001839:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518613.001848:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001855:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001863:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518613.001865:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518613.001868:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001874:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785940 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001908:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696200/0x631fd8698c785932 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd96c expref: 21 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001922:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785947 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd96c expref: 20 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.001929:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:0.0:1789518613.001931:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518613.001934:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696400, rc 0) 00000100:00100000:0.0:1789518613.002071:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617279232:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1072us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518613.002081:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1789518613.007236:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.007734:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617279488 00000100:00100000:1.0:1789518613.007749:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617279488 00000100:00100000:1.0:1789518613.007822:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:1.0:1789518613.007835:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617279488:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789518613.007910:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518613.007949:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785947 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd96c expref: 20 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.007973:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:1.0:1789518613.007979:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518613.008010:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.008027:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.008038:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.008057:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.008064:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.008072:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.008427:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.008437:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.008445:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518613.009367:0:35846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].3, 64 off8408 00000004:00080000:1.0:1789518613.009381:0:35846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 667005766615ns, next at 668005763357ns, rc = 0 00010000:00010000:1.0:1789518613.009462:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009476:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009486:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009494:0:35846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009501:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009507:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009542:0:35846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518613.009569:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009583:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009591:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009597:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.009603:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009650:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009666:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:1.0:1789518613.009670:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789518613.009675:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009682:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c78595c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.009690:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518613.009700:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009706:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.009711:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518613.009718:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.009719:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009734:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.009737:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009746:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518613.009754:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:1.0:1789518613.009757:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.009759:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518613.009767:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.009774:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009780:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:3.0:1789518613.009784:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785963 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009785:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.009792:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.009800:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c78594e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.009801:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518613.009805:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518613.009808:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1789518613.009817:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ea298c3 reply state 000000009dd1ffce transno 30064771113 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.009829:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518613.009944:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:31666:x1876445617279488:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 2107us (2719us total) trans 30064771113 rc 0/0 00000100:00100000:1.0:1789518613.009954:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00010000:00010000:1.0:1789518613.012280:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.012302:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.012312:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.012319:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.012323:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.012347:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.012365:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff99ffc13ed400) 00010000:00010000:1.0:1789518613.012368:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.012374:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.012381:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c785955 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518613.013095:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.014608:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617279616 00000100:00100000:1.0:1789518613.014665:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617279616 00000100:00100000:1.0:1789518613.014754:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:1.0:1789518613.014767:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617279616:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518613.014956:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518613.014984:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78596a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd973 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015205:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015223:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015237:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015255:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015281:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015289:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015415:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015424:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015432:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015438:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.015443:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015452:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015465:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518613.015468:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.015474:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015481:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785971 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015495:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015507:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015514:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015519:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.015522:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015527:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015534:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff99ffc13ed700) 00010000:00010000:1.0:1789518613.015537:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.015540:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015546:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785978 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015588:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78596a lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd973 expref: 21 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015599:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518613.015601:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.015605:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78596a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd973 expref: 21 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.015724:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:1.0:1789518613.015926:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617279616:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1160us (2836us total) trans 0 rc 301/301 00000100:00100000:1.0:1789518613.015935:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1789518613.020208:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.020339:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617279744 00000100:00100000:0.0:1789518613.020352:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617279744 00000100:00100000:0.0:1789518613.020429:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1789518613.020443:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617279744:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518613.020490:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518613.020517:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78597f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd97a expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020598:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020667:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020684:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020830:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020839:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020847:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020919:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020928:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020935:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020942:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518613.020954:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020963:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020978:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518613.020981:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518613.020988:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.020995:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785986 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021012:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021019:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021026:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021031:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518613.021035:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021041:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021049:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518613.021052:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518613.021062:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021068:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c78598d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021111:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78597f lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd97a expref: 21 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021123:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518613.021125:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518613.021129:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c78597f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd97a expref: 21 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.021151:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696c00, rc 0) 00000100:00100000:0.0:1789518613.021228:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617279744:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 788us (1033us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518613.021237:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1789518613.024446:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.024695:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617280000 00000100:00100000:2.0:1789518613.024710:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617280000 00000100:00100000:2.0:1789518613.024779:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:2.0:1789518613.024791:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617280000:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518613.024820:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518613.024848:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785994 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd981 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.025000:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.025017:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.025030:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.025046:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.025053:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.025059:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026728:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026746:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026757:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518613.026770:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789518613.026802:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026810:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026817:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026823:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.026828:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026838:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026851:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518613.026855:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.026861:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026881:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78599b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518613.026899:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007be78926 reply state 00000000811522a1 transno 30064771114 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.026906:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518613.026941:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785994 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd981 expref: 23 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026952:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd981 expref: 22 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.026957:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:2.0:1789518613.026959:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789518613.026961:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4200, rc 0) 00000100:00100000:2.0:1789518613.027177:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31666:x1876445617280000:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 2386us (2741us total) trans 30064771114 rc 0/0 00000100:00100000:2.0:1789518613.027185:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00010000:00010000:2.0:1789518613.029054:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.029103:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.029110:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.029115:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.029136:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.029143:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.029156:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff99ffd1b0cf00) 00010000:00010000:2.0:1789518613.029158:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.029162:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.029167:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859a2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.031523:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.031660:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617280256 00000100:00100000:1.0:1789518613.031675:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617280256 00000100:00100000:1.0:1789518613.031756:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:1.0:1789518613.031770:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31666:x1876445617280256:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789518613.032157:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.032180:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.032196:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518613.032252:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771115 00000004:00010000:1.0:1789518613.032280:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041078f39 reply state 0000000028a9718a transno 30064771116 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.032290:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518613.032408:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31666:x1876445617280256:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 641us (898us total) trans 30064771116 rc 0/0 00000100:00100000:1.0:1789518613.032417:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000020:00080000:1.0:1789518613.032423:0:35846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518613.036279:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.036318:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.036327:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.036334:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.036341:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.036350:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.036369:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:1.0:1789518613.036373:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.036378:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.036391:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7859b7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.038167:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.038360:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617280512 00000100:00100000:1.0:1789518613.038374:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617280512 00000100:00100000:1.0:1789518613.038451:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:1.0:1789518613.038464:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617280512:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518613.038501:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518613.038531:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c7859be lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd988 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.038893:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.038928:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.038942:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.038960:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.038969:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.038976:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.039986:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040001:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040011:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518613.040022:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 0 00010000:00010000:1.0:1789518613.040052:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040060:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040067:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040083:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.040087:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040096:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040110:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518613.040113:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.040118:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040125:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7859c5 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518613.040139:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000359e7603 reply state 0000000034d340ae transno 30064771117 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.040148:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518613.040187:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c7859be lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd988 expref: 27 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040278:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd988 expref: 26 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.040286:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:1.0:1789518613.040288:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789518613.040290:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:1.0:1789518613.040385:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31666:x1876445617280512:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1923us (2235us total) trans 30064771117 rc 0/0 00000100:00100000:1.0:1789518613.040404:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00010000:00010000:2.0:1789518613.042254:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.042277:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.042287:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.042293:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.042299:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.042308:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.042325:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff99ffc13ed700) 00010000:00010000:2.0:1789518613.042329:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.042348:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.042356:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7859cc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.045186:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.045342:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617280768 00000100:00100000:2.0:1789518613.045356:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617280768 00000100:00100000:2.0:1789518613.045431:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:2.0:1789518613.045444:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:31666:x1876445617280768:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789518613.045907:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.045930:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.045944:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518613.046057:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771118 00000004:00010000:2.0:1789518613.046087:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c23a19cc reply state 000000000d84e0ca transno 30064771119 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.046097:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518613.046219:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:31666:x1876445617280768:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 776us (1045us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1789518613.046228:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000020:00080000:2.0:1789518613.046234:0:37723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518613.051326:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.051359:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.051380:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.051388:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.051401:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.051411:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518613.051419:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518613.051443:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:1.0:1789518613.051448:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.051458:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.051465:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7859e1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.051726:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617281024 00000100:00100000:2.0:1789518613.051739:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617281024 00000100:00100000:2.0:1789518613.051866:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1789518613.051878:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31672:x1876445617281024:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518613.051927:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518613.051950:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c7859e8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd98f expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052040:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052056:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052068:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052084:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052092:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052098:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052253:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7859fd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052263:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7859fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052271:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7859fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518613.052281:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:2.0:1789518613.052415:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052423:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052428:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052434:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.052438:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052445:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052457:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518613.052461:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.052464:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052470:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7859ef lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052485:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052492:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052498:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052515:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.052518:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052525:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052533:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff99ffd1b0cf00) 00010000:00010000:2.0:1789518613.052535:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.052538:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052543:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7859f6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052602:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c7859e8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd98f expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052684:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7859fd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd98f expref: 12 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.052692:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518613.052695:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518613.052698:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5c00, rc 0) 00000100:00100000:2.0:1789518613.052792:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+12:31672:x1876445617281024:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 917us (1384us total) trans 30064771120 rc 0/0 00000100:00100000:2.0:1789518613.052802:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00080000:0.0:1789518613.053098:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518613.055441:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.055538:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617281280 00000100:00100000:1.0:1789518613.055553:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617281280 00000100:00100000:1.0:1789518613.055772:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1789518613.055785:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+12:31672:x1876445617281280:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518613.055820:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518613.055877:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785a0b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd996 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.055978:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.055996:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056012:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056030:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056038:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056045:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056265:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785a20 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056276:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785a20 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056283:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785a20 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518613.056296:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:1.0:1789518613.056418:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056437:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056445:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056452:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.056457:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056466:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056481:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518613.056485:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.056491:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056498:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785a12 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056518:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056524:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056531:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056537:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.056547:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056554:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056562:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff99ffc13ed700) 00010000:00010000:1.0:1789518613.056565:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.056568:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056575:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785a19 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056782:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785a0b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd996 expref: 15 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056795:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785a20 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd996 expref: 14 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.056801:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:1.0:1789518613.056803:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518613.056806:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:1.0:1789518613.056943:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+14:31672:x1876445617281280:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1159us (1512us total) trans 30064771121 rc 0/0 00000100:00100000:1.0:1789518613.056953:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1789518613.060121:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.060432:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617281536 00000100:00100000:2.0:1789518613.060462:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617281536 00000100:00100000:2.0:1789518613.060570:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1789518613.060581:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+14:31672:x1876445617281536:12345-192.168.206.51@tcp:103:mmap_sanity.0 00010000:00010000:2.0:1789518613.060600:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518613.060671:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7859fd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd98f expref: 14 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.060697:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518613.060703:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518613.060778:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+13:31672:x1876445617281536:12345-192.168.206.51@tcp:103:mmap_sanity.0 Request processed in 199us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.060787:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518613.062943:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.063013:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617281664 00000100:00100000:1.0:1789518613.063024:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617281664 00000100:00100000:1.0:1789518613.063088:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:1.0:1789518613.063099:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+13:31672:x1876445617281664:12345-192.168.206.51@tcp:58:mmap_sanity.0 00010000:00010000:1.0:1789518613.063359:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.063380:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd988 expref: 27 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.063390:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.063433:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd988 expref: 27 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.063449:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd988 expref: 27 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.063464:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627640448:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518613.063569:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518613.065999:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.066136:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617281792 00000100:00100000:0.0:1789518613.066148:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617281792 00010000:00010000:0.0:1789518613.066194:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd988 expref: 28 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.066392:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1789518613.066404:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2343:x1876445617281792:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518613.066440:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518613.066449:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd988 expref: 28 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.066464:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd988 expref: 28 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.066490:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:0.0:1789518613.066496:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.066506:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.066513:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.066535:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518613.066608:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2343:x1876445617281792:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 206us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518613.066653:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00010000:00010000:2.0:1789518613.066739:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7859d3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd988 expref: 27 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.066771:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627640448:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518613.066800:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.066810:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.066817:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518613.067274:0:35845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].2, 136 off8464 00000100:00100000:2.0:1789518613.067358:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+13:31672:x1876445617281664:12345-192.168.206.51@tcp:58:mmap_sanity.0 Request processed in 4261us (4425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.067377:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:1.0:1789518613.069850:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.069902:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617281920 00000100:00100000:2.0:1789518613.069914:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617281920 00000100:00100000:2.0:1789518613.069984:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:2.0:1789518613.070251:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+13:31672:x1876445617281920:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518613.070277:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518613.070300:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785a35 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd99d expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.070369:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.070380:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785a35 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd99d expref: 14 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.070407:0:37723:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.070421:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785a35 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd99d expref: 14 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.070436:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518613.070439:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518613.070443:0:37723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785a35 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd99d expref: 14 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.070451:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5e00, rc 0) 00000100:00100000:2.0:1789518613.070542:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+14:31672:x1876445617281920:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 297us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.070550:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00010000:00010000:2.0:1789518613.362899:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518613.747384:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518613.747397:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518613.747442:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:2.0:1789518613.747451:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518613.748263:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627640576:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518613.748696:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518613.753704:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.753932:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627640576:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518613.754188:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617282048 00000100:00100000:0.0:1789518613.754198:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617282048 00000100:00100000:0.0:1789518613.754356:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1789518613.754369:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31673:x1876445617282048:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518613.754412:0:35847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518613.754537:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31673:x1876445617282048:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 171us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518613.754566:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518613.758978:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518613.759086:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617282176 00000100:00100000:3.0:1789518613.759098:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617282176 00000100:00100000:2.0:1789518613.759366:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:2.0:1789518613.759383:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31673:x1876445617282176:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789518613.759476:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759772:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759788:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759807:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759813:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759819:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759866:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759875:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759882:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518613.759928:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:2.0:1789518613.759932:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518613.759947:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759958:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759966:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759974:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759981:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.759985:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.759994:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760005:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518613.760012:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.760018:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760022:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785a3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760035:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760038:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760042:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760045:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.760047:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760050:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760054:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x20b1fb9b (ffff99ffd1b0cf00) 00010000:00010000:2.0:1789518613.760055:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.760057:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760060:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760074:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760085:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760147:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760153:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.760156:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760162:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760171:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518613.760173:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.760176:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.760181:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a4a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.761677:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31673:x1876445617282176:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 2285us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.761695:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1789518613.765041:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.765384:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617282432 00000100:00100000:0.0:1789518613.765397:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617282432 00000100:00100000:0.0:1789518613.765472:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1789518613.765484:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31673:x1876445617282432:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518613.765509:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518613.765534:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785a51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9a4 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.765765:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.765784:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.765798:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518613.765811:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:0.0:1789518613.765930:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.765939:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.765946:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.765952:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518613.765957:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.765982:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.765997:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:0.0:1789518613.766000:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518613.766006:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.766012:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697200/0x631fd8698c785a58 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.766066:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785a51 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9a4 expref: 29 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.766078:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518613.766081:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518613.766086:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785a51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9a4 expref: 29 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.766096:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696c00, rc 0) 00000100:00100000:0.0:1789518613.766177:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31673:x1876445617282432:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 695us (1150us total) trans 30064771122 rc 301/301 00000100:00100000:0.0:1789518613.766185:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1789518613.768485:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518613.768551:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617282560 00000100:00100000:3.0:1789518613.768655:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617282560 00000100:00100000:3.0:1789518613.768905:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518613.768919:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31673:x1876445617282560:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518613.768972:0:35846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518613.769116:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31673:x1876445617282560:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 200us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518613.769125:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518613.771948:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.772081:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617282816 00000100:00100000:0.0:1789518613.772094:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617282816 00000100:00100000:0.0:1789518613.772169:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1789518613.772181:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31673:x1876445617282816:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518613.772233:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518613.772278:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a66 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9ab expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518613.772941:0:35847:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xa4:0x0], count =30 00000004:00080000:0.0:1789518613.772949:0:35847:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xa4:0x0]+30 in llog 00000004:00080000:0.0:1789518613.773008:0:35847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc2:0x0], index 1: 0 00010000:00010000:0.0:1789518613.774398:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785a6d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.774426:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785a6d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.774443:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785a6d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.774553:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a66 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ab expref: 31 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.774577:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785a6d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ab expref: 30 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.774587:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518613.774590:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518613.774594:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697800, rc 0) 00000100:00100000:0.0:1789518613.775395:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31673:x1876445617282816:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3210us (3455us total) trans 30064771123 rc 0/0 00000100:00100000:0.0:1789518613.775406:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1789518613.782314:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.782417:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617283072 00000100:00100000:2.0:1789518613.782433:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617283072 00000100:00100000:2.0:1789518613.782571:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1789518613.782584:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31673:x1876445617283072:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518613.782703:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518613.782752:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785a6d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ab expref: 30 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782775:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:2.0:1789518613.782788:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518613.782817:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782832:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782842:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782858:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782865:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782872:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782953:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782961:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782968:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782975:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.782987:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.782997:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.783007:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518613.783010:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.783014:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.783020:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a7b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.783033:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.783039:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.783045:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.783051:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.783054:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.783060:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.783067:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3c89c12c (ffff99ffd1b0cf00) 00010000:00010000:2.0:1789518613.783070:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518613.783080:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.783087:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a82 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3c89c12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.783356:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:31673:x1876445617283072:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 774us (1049us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518613.783366:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:1.0:1789518613.793520:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.793583:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617283200 00000100:00100000:2.0:1789518613.793598:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617283200 00000100:00100000:2.0:1789518613.793714:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:2.0:1789518613.793728:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:31673:x1876445617283200:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518613.793756:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518613.793784:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a89 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9b2 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.793833:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.793849:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.793864:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.793981:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785a89 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b2 expref: 31 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.794001:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b2 expref: 30 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.794019:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:2.0:1789518613.794022:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518613.794026:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5600, rc 0) 00000100:00100000:2.0:1789518613.794110:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31673:x1876445617283200:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 385us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.794118:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1789518613.798336:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518613.798467:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617283456 00000100:00100000:3.0:1789518613.798482:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617283456 00000100:00100000:3.0:1789518613.798550:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1789518613.798675:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31673:x1876445617283456:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518613.798957:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.798980:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.798995:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518613.800171:0:35846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].2, 88 off8344 00000004:00080000:3.0:1789518613.800199:0:35846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 667796584378ns, next at 668796571400ns, rc = 0 00000004:00010000:3.0:1789518613.800398:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf589803 reply state 00000000196ac68c transno 30064771124 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518613.800412:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518613.800724:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31673:x1876445617283456:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 2051us (2401us total) trans 30064771124 rc 0/0 00000100:00100000:3.0:1789518613.800735:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1789518613.804984:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.805176:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617283584 00000100:00100000:0.0:1789518613.805204:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617283584 00000100:00100000:0.0:1789518613.805282:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:0.0:1789518613.805295:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31673:x1876445617283584:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518613.805334:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518613.805358:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9b9 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.805414:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.805427:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.805434:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.805847:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b9 expref: 33 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.805865:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518613.805870:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b9 expref: 33 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.805875:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.805909:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:0.0:1789518613.805914:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518613.805919:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00010000:00010000:2.0:1789518613.805959:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.805976:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:2.0:1789518613.805979:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518613.805984:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.805992:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981a00/0x631fd8698c785a97 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.806054:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31673:x1876445617283584:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 760us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518613.806064:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518613.808178:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518613.809314:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617283712 00000100:00100000:3.0:1789518613.809330:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617283712 00000100:00100000:3.0:1789518613.809433:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518613.809447:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2343:x1876445617283712:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789518613.809988:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617283712:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 540us (1814us total) trans 30064771074 rc 0/0 00000100:00100000:3.0:1789518613.809999:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00080000:0.0:1789518613.810347:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518613.812830:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.812904:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617283968 00000100:00100000:2.0:1789518613.812916:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617283968 00000100:00100000:2.0:1789518613.812985:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:2.0:1789518613.812997:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31673:x1876445617283968:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518613.814114:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31673:x1876445617283968:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1111us (1290us total) trans 30064771125 rc 0/0 00000100:00100000:2.0:1789518613.814127:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1789518613.818023:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.818333:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617284224 00000100:00100000:2.0:1789518613.818345:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617284224 00000100:00100000:2.0:1789518613.818545:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:2.0:1789518613.818558:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31673:x1876445617284224:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518613.818762:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31673:x1876445617284224:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 206us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.818770:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:1.0:1789518613.821321:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.821659:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617284352 00000100:00100000:2.0:1789518613.821671:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617284352 00000100:00100000:2.0:1789518613.821789:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:2.0:1789518613.821801:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31673:x1876445617284352:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518613.821827:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518613.821853:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785aa5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9c0 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.821962:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785aac lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.822003:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785aac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.822016:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785aac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518613.822067:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518613.822088:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785aac lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.822117:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785aa5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c0 expref: 35 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.822138:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785aac lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c0 expref: 34 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.822147:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:2.0:1789518613.822150:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518613.822154:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5c00, rc 0) 00000100:00100000:2.0:1789518613.822311:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31673:x1876445617284352:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 512us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.822319:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:1.0:1789518613.828480:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.828579:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617284480 00000100:00100000:0.0:1789518613.828591:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617284480 00000100:00100000:0.0:1789518613.828704:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1789518613.828715:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617284480:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518613.828739:0:36735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518613.828765:0:36735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9c7 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518613.828824:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e316, blocks: 0x1 00010000:00010000:0.0:1789518613.828854:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1789518613.828860:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518613.828872:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c7 expref: 7 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.828895:0:36735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c7 expref: 7 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.828910:0:36735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696c00, rc 0) 00000100:00100000:0.0:1789518613.829126:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617284480:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 412us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518613.829134:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518613.836459:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518613.836605:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617284736 00000100:00100000:3.0:1789518613.836663:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617284736 00000100:00100000:2.0:1789518613.836747:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:2.0:1789518613.836762:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31673:x1876445617284736:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518613.836945:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31673:x1876445617284736:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 185us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.836955:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1789518613.843214:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.843716:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617284864 00000100:00100000:0.0:1789518613.843730:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617284864 00000100:00100000:0.0:1789518613.843855:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:0.0:1789518613.843868:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:31673:x1876445617284864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518613.843890:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518613.843915:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9ce expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.843967:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c7 expref: 8 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.844000:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518613.844006:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518613.844012:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 8 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.844056:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c7 expref: 8 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.844073:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c7 expref: 8 pid: 36735 timeout: 767 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.844089:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627640704:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518613.844213:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518613.847152:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627640704:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518613.847198:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 8 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.847223:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697200, rc 0) 00000100:00100000:0.0:1789518613.847306:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:31673:x1876445617284864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3440us (4106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518613.847316:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1789518613.847868:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.848002:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617284992 00000100:00100000:2.0:1789518613.848014:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617284992 00010000:00010000:2.0:1789518613.848056:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c7 expref: 8 pid: 36735 timeout: 767 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.848143:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:2.0:1789518613.848154:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617284992:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518613.848171:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518613.848200:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c7 expref: 8 pid: 36735 timeout: 767 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.848214:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c7 expref: 8 pid: 36735 timeout: 767 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.848251:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e3d6691/0x631fd8698c785ab3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c7 expref: 8 pid: 36735 timeout: 767 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.848270:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518613.848274:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518613.848282:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.848293:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.848343:0:35832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.848382:0:35832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35832:1876445627640832:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518613.848472:0:35832:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518613.852730:0:35832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35832:1876445627640832:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518613.852771:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518613.852846:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617284992:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4692us (4979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.852859:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518613.854722:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.854820:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617285120 00000100:00100000:0.0:1789518613.854832:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617285120 00002000:00100000:0.0:1789518613.854891:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff99fec81b7800 x1876445617285120/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:259/0 lens 488/0 e 0 to 0 dl 1789518624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789518613.854921:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b7800 with x1876445617285120 ext(0->409599) 00002000:00010000:0.0:1789518613.854929:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b7800 00000100:00100000:0.0:1789518613.854992:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1789518613.855001:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617285120:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518613.864429:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617285120:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9413us (9811us total) trans 30064771075 rc 0/0 00000100:00100000:0.0:1789518613.864448:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00002000:00100000:0.0:1789518613.864464:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff99fec81b7800 x1876445617285120/t30064771075(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:259/0 lens 488/448 e 0 to 0 dl 1789518624 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789518613.864476:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b7800 with x1876445617285120 ext(0->409599) 00002000:00010000:0.0:1789518613.864885:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b7800 00000100:00100000:1.0:1789518613.866314:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.866428:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617285248 00000100:00100000:0.0:1789518613.866441:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617285248 00000100:00100000:0.0:1789518613.866508:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:0.0:1789518613.866522:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31673:x1876445617285248:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789518613.908793:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771123 is committed 00000001:00080000:3.0:1789518613.908828:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771121 is committed 00000004:00080000:3.0:1789518613.908840:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789518613.908867:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771125 is committed 00000100:00100000:0.0:1789518613.909060:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518613.909078:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627640960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789518613.909141:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789518613.909390:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffd84d6600 refcount 2 committed 0 result 0 batchid 25769803891 00000020:00080000:3.0:1789518613.909395:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffd1090900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd0780e40 00000020:00080000:3.0:1789518613.909398:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffd1090700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec1f34400 00000004:00080000:3.0:1789518613.909423:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789518613.909454:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627640960 00000100:00100000:3.0:1789518613.909461:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627640960 00000100:00100000:3.0:1789518613.909513:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518613.909521:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627640960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789518613.909544:0:36532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:194 count 1 00010000:00010000:3.0:1789518613.909569:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.909590:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd957 expref: 5 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.909599:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789518613.909603:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518613.909608:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.909667:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd957 expref: 5 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.909682:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd957 expref: 5 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518613.909702:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627641088:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518613.909759:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4daa540 going to sleep for 11 seconds 00000020:00080000:2.0:1789518613.910029:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803891 committed batchid 21474836520 00000020:00080000:2.0:1789518613.910208:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000100:00080000:3.0:1789518613.910397:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518613.910478:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:31673:x1876445617285248:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 43958us (44172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518613.910487:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1789518613.910662:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627641216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518613.910699:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518613.910821:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627641216 00000100:00100000:0.0:1789518613.910826:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627641216 00000100:00100000:0.0:1789518613.910866:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789518613.910918:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518613.910942:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627641216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789518613.911312:0:36735:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:0.0:1789518613.911327:0:36735:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1789518614 00002000:00010000:0.0:1789518613.911329:0:36735:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518613.911330:0:36735:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1789518614 -> 1789518614 00002000:00010000:0.0:1789518613.911333:0:36735:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518613.911379:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627641216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 440us (678us total) trans 30064771076 rc 0/0 00000100:00100000:0.0:1789518613.911386:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518613.911552:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff664000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627641088:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518613.911571:0:36532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.911674:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771073 gen 2 00000100:00100000:2.0:1789518613.911690:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99ffd846dc00 x1876445627641216/t30064771076(30064771076) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518629 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789518613.911700:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffd846dc00/2, rc 0, transno 30064771076 00000100:00100000:2.0:1789518613.911705:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627641216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518613.914357:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518613.914397:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.914486:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617285504 00000100:00100000:1.0:1789518613.914497:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617285504 00000100:00100000:0.0:1789518613.914651:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617285376 00000100:00100000:0.0:1789518613.914656:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617285376 00010000:00010000:0.0:1789518613.914703:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd957 expref: 6 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518613.914714:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518613.914724:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617285504:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789518613.914731:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518613.914736:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617285376:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518613.914747:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518613.914765:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd957 expref: 6 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.914779:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd957 expref: 6 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.914803:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c12b388e/0x631fd8698c785916 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd957 expref: 6 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.914819:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518613.914825:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518613.914830:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.914854:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.914877:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518613.914923:0:36532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.914930:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617285376:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 193us (581us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518613.914933:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.914937:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00010000:00010000:3.0:1789518613.914943:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.914960:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.914976:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518613.915486:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627640960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5964us (6343us total) trans 30064771079 rc 0/0 00000100:00100000:3.0:1789518613.915494:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789518613.915514:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518613.915520:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.915528:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518613.915532:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.915541:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518613.915661:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789518613.916094:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.916104:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cdf056b/0x631fd8698c785ac1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.916122:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518613.916130:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518613.916132:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789518613.916167:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffd846ed80/2, rc 0, transno 30064771079 00000100:00100000:3.0:1789518613.916174:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627640960:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1789518613.945084:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771076 is committed 00000001:00080000:1.0:1789518613.945099:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771075 is committed 00000100:00100000:2.0:1789518613.945459:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617285504:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 30731us (31055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.945470:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518613.947872:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.947991:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617285760 00000100:00100000:2.0:1789518613.948001:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617285760 00000100:00100000:2.0:1789518613.948059:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1789518613.948073:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:31673:x1876445617285760:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518613.948121:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518613.948160:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785aac lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9c0 expref: 14 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.948180:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:2.0:1789518613.948185:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518613.948214:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.948327:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.948339:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518613.948570:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000746e63f3 reply state 000000006e0c322d transno 30064771126 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.948580:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518613.948999:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:31673:x1876445617285760:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 926us (1134us total) trans 30064771126 rc 0/0 00000100:00100000:2.0:1789518613.949006:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:1.0:1789518613.951298:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518613.951482:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.951493:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.951501:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.951507:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518613.951511:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.951520:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.951534:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:3.0:1789518613.951537:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518613.951542:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.951548:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785ac8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.951826:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617285888 00000100:00100000:2.0:1789518613.951837:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617285888 00000100:00100000:2.0:1789518613.951928:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518613.951938:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617285888:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518613.952209:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:2.0:1789518613.952213:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1789518614 -> 1789518613 00002000:00010000:2.0:1789518613.952215:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 1789518613 00002000:00010000:2.0:1789518613.952217:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1789518614 -> 1789518613 00002000:00010000:2.0:1789518613.952240:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:2.0:1789518613.952302:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617285888:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 366us (1010us total) trans 30064771077 rc 0/0 00000100:00100000:2.0:1789518613.952311:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1789518613.956436:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.956511:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617286144 00000100:00100000:2.0:1789518613.956520:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617286144 00000100:00100000:2.0:1789518613.956567:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:2.0:1789518613.956575:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:31673:x1876445617286144:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789518613.956673:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.956688:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b2 expref: 14 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.956696:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.956725:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b2 expref: 14 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.956737:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b2 expref: 14 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.956749:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627641344:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518613.956827:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc687bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518613.959045:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.959203:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627641344:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518613.959212:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617286272 00000100:00100000:0.0:1789518613.959219:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617286272 00010000:00010000:2.0:1789518613.959229:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.959246:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b2 expref: 15 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.959277:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518613.959284:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617286272:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518613.959294:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518613.959298:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b2 expref: 15 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.959359:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b2 expref: 15 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.959375:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785a90 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b2 expref: 15 pid: 35845 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.959387:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:0.0:1789518613.959395:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.959402:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.959407:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.960197:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.960201:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518613.960207:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.960232:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.960245:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.960250:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.960255:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518613.960258:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.960262:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.960271:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:2.0:1789518613.960273:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789518613.960276:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.960280:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c785acf lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.960486:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617286272:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1198us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518613.960505:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518613.960550:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31673:x1876445617286144:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 3975us (4121us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789518613.960570:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:3.0:1789518613.962357:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.962498:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617286400 00000100:00100000:1.0:1789518613.962507:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617286400 00000100:00100000:1.0:1789518613.962559:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:1.0:1789518613.962580:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617286400:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789518613.962656:0:36531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.962675:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.962683:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518613.962687:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518613.962691:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.962720:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.962733:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 7 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.962747:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627641472:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518613.962807:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518613.964689:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627641472:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518613.964713:0:36531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518613.965858:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.965945:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617286528 00000100:00100000:0.0:1789518613.965952:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617286528 00010000:00010000:0.0:1789518613.965985:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 8 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.966022:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1789518613.966031:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617286528:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518613.966044:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518613.966067:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 8 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.966084:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 8 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.966106:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785aba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ce expref: 8 pid: 36531 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.966122:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518613.966137:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518613.966143:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.966153:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.966182:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518613.966235:0:36531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.966251:0:36531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.966251:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617286528:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 221us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518613.966259:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00010000:00010000:1.0:1789518613.966275:0:36531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.966283:0:36531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.966292:0:36531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.966298:0:36531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518613.966302:0:36531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.966311:0:36531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.966324:0:36531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.966331:0:36531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf0ae8bc/0x631fd8698c785ad6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.966391:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617286400:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 3813us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518613.966398:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1789518613.968132:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.968378:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617286784 00000100:00100000:0.0:1789518613.968386:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617286784 00000100:00100000:0.0:1789518613.968437:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:0.0:1789518613.968446:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31673:x1876445617286784:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518613.968532:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.968553:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.968567:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.968902:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.968910:0:35846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b9 expref: 14 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.968923:0:35846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.968947:0:35846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b9 expref: 14 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.968957:0:35846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b9 expref: 14 pid: 35847 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518613.968968:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627641600:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518613.969038:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d43780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518613.974255:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627641600:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518613.974284:0:35846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518613.974977:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.975090:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617286912 00000100:00100000:1.0:1789518613.975098:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617286912 00010000:00010000:1.0:1789518613.975135:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b9 expref: 15 pid: 35847 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.975176:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518613.975186:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617286912:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518613.975199:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518613.975205:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b9 expref: 15 pid: 35847 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.975218:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b9 expref: 15 pid: 35847 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.975240:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785a9e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9b9 expref: 15 pid: 35847 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.975254:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:1.0:1789518613.975259:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.975269:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.975294:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.975381:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518613.975382:0:35846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.975393:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.975430:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617286912:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 245us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518613.975438:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000001:00080000:0.0:1789518613.975608:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771127 00000001:00080000:0.0:1789518613.975818:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771128 00000001:00080000:0.0:1789518613.975882:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771129 00000100:00100000:0.0:1789518613.975973:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35846:1876445627641728:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789518613.976032:0:35846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518613.976070:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a2c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518613.976329:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627641728 00000100:00100000:2.0:1789518613.976338:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627641728 00000100:00100000:2.0:1789518613.976372:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789518613.976377:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35846:x1876445627641728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789518613.976445:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35846:x1876445627641728:12345-0@lo:1000:mdt00_001.0 Request processed in 66us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.976452:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789518613.976477:0:35846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771076 gen 2 00000004:00080000:0.0:1789518613.976483:0:35846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffd846dc00, transno 30064771076 00000100:00100000:0.0:1789518613.976498:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35846:1876445627641728:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789518613.977217:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771130 00000100:00100000:0.0:1789518613.977259:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35846:1876445627641856:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789518613.977285:0:35846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518613.977302:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518613.977367:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627641856 00000100:00100000:1.0:1789518613.977374:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627641856 00000100:00100000:1.0:1789518613.977407:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789518613.977415:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35846:x1876445627641856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789518613.977561:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35846:x1876445627641856:12345-0@lo:1000:mdt00_001.0 Request processed in 147us (273us total) trans 30064771078 rc 0/0 00000100:00100000:1.0:1789518613.977569:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789518613.977587:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35846:1876445627641856:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789518613.977611:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977645:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977654:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977660:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518613.977664:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977675:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977689:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffd1b0cf00) 00010000:00010000:0.0:1789518613.977692:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518613.977696:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977703:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697a00/0x631fd8698c785ae4 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977740:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977747:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977753:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977758:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518613.977821:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977828:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977834:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:0.0:1789518613.977836:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518613.977841:0:35846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785a35 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd99d expref: 9 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977848:0:35846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785a35 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd99d expref: 9 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518613.977854:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785a35 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd99d expref: 9 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.977959:0:35846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785a35 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd99d expref: 9 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.977974:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627641984:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518613.978031:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789518613.981275:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518613.981288:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627641984:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518613.981366:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617287040 00000100:00100000:2.0:1789518613.981374:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617287040 00000100:00100000:2.0:1789518613.981429:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1789518613.981437:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31672:x1876445617287040:12345-192.168.206.51@tcp:49:mmap_sanity.0 00010000:00010000:1.0:1789518613.981483:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981494:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785a2e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981522:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981546:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981557:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518613.981560:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31672:x1876445617287040:12345-192.168.206.51@tcp:49:mmap_sanity.0 Request processed in 124us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.981568:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00010000:00010000:1.0:1789518613.981568:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981573:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981580:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981586:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.981590:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981597:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981608:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:1.0:1789518613.981654:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518613.981660:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981668:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785aeb lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981682:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981698:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981704:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981709:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518613.981712:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981719:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981728:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:1.0:1789518613.981730:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518613.981733:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.981739:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785add lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.981944:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:31673:x1876445617286784:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 13498us (13816us total) trans 30064771131 rc 0/0 00000100:00100000:1.0:1789518613.981954:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000020:00080000:1.0:1789518613.981957:0:35846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789518613.982046:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518613.982050:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518613.982067:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:2.0:1789518613.982072:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518613.984183:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518613.984272:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617287424 00000100:00100000:2.0:1789518613.984282:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617287424 00000100:00100000:2.0:1789518613.984351:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1789518613.984361:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:31672:x1876445617287424:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518613.984376:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518613.984395:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9d5 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789518613.984499:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518613.984927:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00002000:00010000:2.0:1789518613.985056:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6aa9e315, atime: 0x6aa9e315, ctime: 0x6aa9e315, blocks: 0x403 00010000:00010000:2.0:1789518613.985078:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1789518613.985092:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518613.985101:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.985120:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518613.985133:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5c00, rc 0) 00000100:00100000:2.0:1789518613.985200:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31672:x1876445617287424:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 840us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518613.985207:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1789518613.985504:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617287296 00000100:00100000:1.0:1789518613.985510:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617287296 00000100:00100000:1.0:1789518613.985538:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518613.985545:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:31673:x1876445617287296:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789518613.986231:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789518613.986339:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771132 00010000:00010000:1.0:1789518613.986381:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.986393:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.986418:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.986427:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.986433:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.986439:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518613.986462:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518613.986501:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518613.986510:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.986519:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518613.986523:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.986532:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518613.986539:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31673:x1876445617287296:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 991us (1610us total) trans 30064771133 rc 0/0 00010000:00010000:3.0:1789518613.986548:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff99ffc13ed700) 00000100:00100000:1.0:1789518613.986550:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00010000:00010000:3.0:1789518613.986553:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:1.0:1789518613.986556:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518613.986560:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.986568:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785af9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518613.986588:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518613.986591:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518613.986594:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518613.990374:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518613.990853:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617287552 00000100:00100000:0.0:1789518613.990863:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617287552 00002000:00100000:0.0:1789518613.990925:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->4095) req@ffff99ffd1008700 x1876445617287552/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:259/0 lens 488/0 e 0 to 0 dl 1789518624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518613.990936:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1008700 with x1876445617287552 ext(0->4095) 00002000:00010000:0.0:1789518613.990941:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1008700 00000100:00100000:0.0:1789518613.990994:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:0.0:1789518613.991004:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617287552:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518613.991334:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617287552:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 331us (967us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518613.991343:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00002000:00100000:0.0:1789518613.991350:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->4095) req@ffff99ffd1008700 x1876445617287552/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:259/0 lens 488/4536 e 0 to 0 dl 1789518624 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518613.991358:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1008700 with x1876445617287552 ext(0->4095) 00002000:00010000:0.0:1789518613.991362:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1008700 00000100:00100000:0.0:1789518613.996348:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518613.996421:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617287680 00000100:00100000:3.0:1789518613.996430:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617287680 00002000:00100000:3.0:1789518613.996474:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (4096->8191) req@ffff99ffd846c700 x1876445617287680/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:259/0 lens 488/0 e 0 to 0 dl 1789518624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518613.996545:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846c700 with x1876445617287680 ext(4096->8191) 00002000:00010000:3.0:1789518613.996552:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd846c700 00000100:00100000:3.0:1789518613.996585:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518613.996597:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617287680:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518613.997469:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617287680:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 872us (1127us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789518613.997484:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00002000:00100000:2.0:1789518613.997493:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (4096->8191) req@ffff99ffd846c700 x1876445617287680/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:259/0 lens 488/4536 e 0 to 0 dl 1789518624 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518613.997501:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846c700 with x1876445617287680 ext(4096->8191) 00002000:00010000:2.0:1789518613.997506:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd846c700 00000100:00100000:3.0:1789518614.002865:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518614.003042:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617287808 00000100:00100000:0.0:1789518614.003052:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617287808 00002000:00100000:0.0:1789518614.003104:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (8192->12287) req@ffff99ffd100a680 x1876445617287808/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/0 e 0 to 0 dl 1789518625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518614.003116:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd100a680 with x1876445617287808 ext(8192->12287) 00002000:00010000:0.0:1789518614.003122:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd100a680 00000100:00100000:0.0:1789518614.003193:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518614.003201:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617287808:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518614.003391:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617287808:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 189us (534us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518614.003414:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00002000:00100000:0.0:1789518614.003421:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (8192->12287) req@ffff99ffd100a680 x1876445617287808/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/4536 e 0 to 0 dl 1789518625 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518614.003429:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd100a680 with x1876445617287808 ext(8192->12287) 00002000:00010000:0.0:1789518614.003433:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd100a680 00000100:00100000:3.0:1789518614.007908:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518614.008031:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617287936 00000100:00100000:2.0:1789518614.008041:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617287936 00002000:00100000:2.0:1789518614.008087:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (12288->69631) req@ffff99ffd100aa00 x1876445617287936/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/0 e 0 to 0 dl 1789518625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518614.008099:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd100aa00 with x1876445617287936 ext(12288->69631) 00002000:00010000:2.0:1789518614.008104:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd100aa00 00000100:00100000:2.0:1789518614.008133:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518614.008156:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617287936:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518614.012097:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617287936:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3931us (4185us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1789518614.012109:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00002000:00100000:2.0:1789518614.012122:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (12288->69631) req@ffff99ffd100aa00 x1876445617287936/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/440 e 0 to 0 dl 1789518625 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518614.012133:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd100aa00 with x1876445617287936 ext(12288->69631) 00002000:00010000:2.0:1789518614.012140:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd100aa00 00000100:00100000:1.0:1789518614.018274:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518614.018766:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617288064 00000100:00100000:0.0:1789518614.018776:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617288064 00002000:00100000:0.0:1789518614.018822:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (69632->106495) req@ffff99fec81b5880 x1876445617288064/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/0 e 0 to 0 dl 1789518625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518614.018833:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b5880 with x1876445617288064 ext(69632->106495) 00002000:00010000:0.0:1789518614.018838:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b5880 00000100:00100000:0.0:1789518614.018870:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1789518614.018879:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617288064:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518614.021436:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617288064:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 2543us (3171us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789518614.021447:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00002000:00100000:2.0:1789518614.021457:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (69632->106495) req@ffff99fec81b5880 x1876445617288064/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/440 e 0 to 0 dl 1789518625 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518614.021465:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b5880 with x1876445617288064 ext(69632->106495) 00002000:00010000:2.0:1789518614.021470:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b5880 00000100:00100000:1.0:1789518614.028880:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518614.028977:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617288192 00000100:00100000:2.0:1789518614.028989:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617288192 00002000:00100000:2.0:1789518614.029036:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (106496->143359) req@ffff99fec81b6300 x1876445617288192/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/0 e 0 to 0 dl 1789518625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518614.029047:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b6300 with x1876445617288192 ext(106496->143359) 00002000:00010000:2.0:1789518614.029053:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b6300 00000100:00100000:2.0:1789518614.029084:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518614.029093:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617288192:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518614.033055:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617288192:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3953us (4175us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789518614.033078:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00002000:00100000:2.0:1789518614.033091:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (106496->143359) req@ffff99fec81b6300 x1876445617288192/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/440 e 0 to 0 dl 1789518625 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518614.033102:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b6300 with x1876445617288192 ext(106496->143359) 00002000:00010000:2.0:1789518614.033109:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b6300 00000100:00100000:3.0:1789518614.039608:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518614.039763:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617288320 00000100:00100000:2.0:1789518614.039773:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617288320 00002000:00100000:2.0:1789518614.039816:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (143360->180223) req@ffff99ffd1009180 x1876445617288320/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/0 e 0 to 0 dl 1789518625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518614.039828:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1009180 with x1876445617288320 ext(143360->180223) 00002000:00010000:2.0:1789518614.039834:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1009180 00000100:00100000:2.0:1789518614.039861:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518614.039942:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617288320:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518614.043127:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617288320:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3249us (3519us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789518614.043141:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00002000:00100000:2.0:1789518614.043154:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (143360->180223) req@ffff99ffd1009180 x1876445617288320/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/440 e 0 to 0 dl 1789518625 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518614.043164:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1009180 with x1876445617288320 ext(143360->180223) 00002000:00010000:2.0:1789518614.043170:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1009180 00000100:00100000:3.0:1789518614.047340:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518614.047690:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617288448 00000100:00100000:2.0:1789518614.047714:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617288448 00002000:00100000:2.0:1789518614.047755:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (180224->217087) req@ffff99ffd1008000 x1876445617288448/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/0 e 0 to 0 dl 1789518625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518614.047766:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1008000 with x1876445617288448 ext(180224->217087) 00002000:00010000:2.0:1789518614.047772:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1008000 00000100:00100000:2.0:1789518614.047803:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1789518614.047812:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617288448:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518614.050364:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617288448:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 2545us (3026us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789518614.050389:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00002000:00100000:2.0:1789518614.050400:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (180224->217087) req@ffff99ffd1008000 x1876445617288448/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:260/0 lens 488/440 e 0 to 0 dl 1789518625 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518614.050411:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1008000 with x1876445617288448 ext(180224->217087) 00002000:00010000:2.0:1789518614.050417:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1008000 00010000:00010000:2.0:1789518614.389857:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518614.643948:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627642112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518614.644026:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518614.644187:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627642112 00000100:00100000:0.0:1789518614.644194:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627642112 00000100:00100000:0.0:1789518614.644242:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789518614.644250:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627642112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518614.644279:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518614.644525:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627642112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 275us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518614.644532:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518614.644596:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627642112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518615.054080:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518615.054143:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617288576 00000100:00100000:3.0:1789518615.054152:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617288576 00000100:00100000:3.0:1789518615.054296:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1789518615.054307:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31666:x1876445617288576:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789518615.054329:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518615.054347:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981600/0x631fd8698c785b00 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9dc expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518615.054401:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981600/0x631fd8698c785b00 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9dc expref: 20 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518615.054415:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981600/0x631fd8698c785b00 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9dc expref: 20 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518615.054450:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:3.0:1789518615.054453:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518615.054457:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981600, rc 0) 00000100:00100000:3.0:1789518615.054515:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617288576:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 209us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518615.054522:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00080000:1.0:1789518615.054728:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518615.057101:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518615.057202:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617288704 00000100:00100000:2.0:1789518615.057212:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617288704 00000100:00100000:2.0:1789518615.057277:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1789518615.057287:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31666:x1876445617288704:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518615.057301:0:36533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518615.057315:0:36533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9e3 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518615.057350:0:36533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 5 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518615.057378:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789518615.057382:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518615.057388:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 7 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518615.057426:0:36533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 5 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518615.057440:0:36533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 5 pid: 37973 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518615.057454:0:36533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627642240:192.168.206.51@tcp:104: 00000100:00080000:1.0:1789518615.057588:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518615.057698:0:36533:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc687ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518615.061573:0:36533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627642240:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518615.061804:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:2.0:1789518615.061844:0:36533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 7 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518615.061913:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617288832 00000100:00100000:3.0:1789518615.061925:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617288832 00010000:00010000:2.0:1789518615.061932:0:36533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4a00, rc 0) 00002000:00100000:3.0:1789518615.061997:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->204799) req@ffff99ffd846c380 x1876445617288832/t0(0) o4->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:261/0 lens 488/0 e 0 to 0 dl 1789518626 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00000100:00100000:2.0:1789518615.062016:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:31666:x1876445617288704:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 4726us (4918us total) trans 0 rc 0/0 00002000:00100000:3.0:1789518615.062040:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846c380 with x1876445617288832 ext(0->204799) 00000100:00100000:2.0:1789518615.062047:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00010000:00010000:3.0:1789518615.062056:0:36537:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 6 pid: 37973 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518615.062076:0:36537:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 6 pid: 37973 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518615.062085:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ffd846c380 00000100:00100000:3.0:1789518615.062116:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1789518615.062127:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2343:x1876445617288832:12345-192.168.206.51@tcp:4:ldlm_bl.0 00000100:00080000:1.0:1789518615.062188:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518615.069289:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2343:x1876445617288832:12345-192.168.206.51@tcp:4:ldlm_bl.0 Request processed in 7150us (7482us total) trans 30064771079 rc 0/0 00000100:00100000:3.0:1789518615.069306:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:3.0:1789518615.069322:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->204799) req@ffff99ffd846c380 x1876445617288832/t30064771079(0) o4->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:261/0 lens 488/448 e 0 to 0 dl 1789518626 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518615.069348:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846c380 with x1876445617288832 ext(0->204799) 00010000:00010000:3.0:1789518615.069360:0:36537:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 8 pid: 37973 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518615.069383:0:36537:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 8 pid: 37973 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518615.069391:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ffd846c380 00000100:00100000:0.0:1789518615.071349:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518615.071463:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617288960 00000100:00100000:2.0:1789518615.071474:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617288960 00010000:00010000:2.0:1789518615.071515:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 8 pid: 37973 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518615.071572:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518615.071582:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617288960:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518615.071654:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789518615.071679:0:35831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1789518613 -> 1789518614 00002000:00010000:2.0:1789518615.071682:0:35831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1789518613 -> 1789518614 00010000:00010000:2.0:1789518615.071688:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 8 pid: 37973 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518615.071698:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 8 pid: 37973 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518615.071722:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785af2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9d5 expref: 8 pid: 37973 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518615.071740:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518615.071743:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518615.071751:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 6 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518615.071759:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 6 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518615.071805:0:35831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 6 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518615.071835:0:35831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627642368:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518615.071937:0:35831:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc687ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518615.076256:0:35831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627642368:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518615.076290:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518615.076407:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:2342:x1876445617288960:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4826us (5116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518615.076423:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:2.0:1789518615.154842:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518615.154877:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627642496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518615.155335:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518615.155411:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627642496 00000100:00100000:2.0:1789518615.155421:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627642496 00000100:00100000:2.0:1789518615.155485:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518615.155494:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627642496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518615.155526:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789518615.155583:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627642496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518615.155591:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789518615.155647:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518615.155691:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627642496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518615.156093:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627643008:0@lo:400:kworker.0 00000100:00100000:2.0:1789518615.156099:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627642624:0@lo:400:kworker.0 00000100:00100000:3.0:1789518615.156148:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518615.156154:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518615.156166:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627642752:0@lo:400:kworker.0 00000100:00100000:0.0:1789518615.156211:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518615.156237:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518615.156245:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627642880:0@lo:400:kworker.0 00000100:00100000:0.0:1789518615.156271:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518615.156307:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627642752 00000100:00100000:0.0:1789518615.156312:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627642752 00000100:00100000:3.0:1789518615.156316:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627643008 00000100:00100000:3.0:1789518615.156323:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627643008 00000100:00100000:0.0:1789518615.156363:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518615.156364:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627642880 00000100:00100000:3.0:1789518615.156368:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627642880 00000100:00100000:0.0:1789518615.156375:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627642752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518615.156391:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518615.156400:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627643008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518615.156427:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627643136:0@lo:400:kworker.0 00000100:00100000:0.0:1789518615.156429:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627642752:12345-0@lo:400:kworker.0 Request processed in 56us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518615.156437:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518615.156454:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627643008:12345-0@lo:400:kworker.0 Request processed in 54us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518615.156462:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789518615.156483:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518615.156491:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518615.156494:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627642880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518615.156536:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627642624 00000100:00100000:3.0:1789518615.156537:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627642880:12345-0@lo:400:kworker.0 Request processed in 47us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518615.156543:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627642624 00000100:00100000:3.0:1789518615.156547:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518615.156565:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627643136 00000100:00100000:3.0:1789518615.156577:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627643136 00000100:00100000:2.0:1789518615.156586:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789518615.156595:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627642624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518615.156609:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518615.156656:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627643136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518615.156677:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627642624:12345-0@lo:400:kworker.0 Request processed in 83us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518615.156687:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789518615.156705:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627643136:12345-0@lo:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518615.156713:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518615.156720:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627642880:0@lo:400:kworker.0 00000100:00080000:2.0:1789518615.156724:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518615.156731:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518615.156738:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627642752:0@lo:400:kworker.0 00000100:00100000:2.0:1789518615.156759:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627642624:0@lo:400:kworker.0 00000100:00100000:3.0:1789518615.156767:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627643008:0@lo:400:kworker.0 00000100:00100000:2.0:1789518615.156778:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627643136:0@lo:400:kworker.0 00010000:00010000:3.0:1789518615.410838:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518616.051064:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518616.051077:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518616.051113:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:2.0:1789518616.051122:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789518616.055064:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518616.055223:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617289088 00000100:00100000:2.0:1789518616.055236:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617289088 00000100:00100000:2.0:1789518616.055312:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518616.055324:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:31672:x1876445617289088:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518616.055663:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518616.055689:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785b0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9ea expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.055730:0:37973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 6 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.055757:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1789518616.055762:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789518616.055769:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785b0e lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ea expref: 8 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.055810:0:37973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 6 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.055825:0:37973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 6 pid: 36533 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518616.055841:0:37973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:37973:1876445627643264:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518616.056019:0:37973:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc687b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789518616.058322:0:37973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:37973:1876445627643264:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518616.058368:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785b0e lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ea expref: 8 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.058392:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5c00, rc 0) 00000100:00100000:2.0:1789518616.058461:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31672:x1876445617289088:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 3139us (3412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518616.058471:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:0.0:1789518616.062008:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518616.062088:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617289216 00000100:00100000:2.0:1789518616.062191:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617289216 00002000:00100000:2.0:1789518616.062281:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff99ffd846fb80 x1876445617289216/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:262/0 lens 488/0 e 0 to 0 dl 1789518627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789518616.062313:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846fb80 with x1876445617289216 ext(0->409599) 00010000:00010000:2.0:1789518616.062326:0:36539:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 7 pid: 36533 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.062346:0:36539:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 7 pid: 36533 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518616.062357:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ffd846fb80 00000100:00100000:2.0:1789518616.062408:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:2.0:1789518616.062420:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617289216:12345-192.168.206.51@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1789518616.069073:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617289216:12345-192.168.206.51@tcp:4:mmap_sanity.0 Request processed in 6642us (7069us total) trans 30064771080 rc 0/0 00000100:00100000:2.0:1789518616.069089:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00002000:00100000:2.0:1789518616.069103:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff99ffd846fb80 x1876445617289216/t30064771080(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:262/0 lens 488/448 e 0 to 0 dl 1789518627 ref 1 fl Complete:H/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789518616.069115:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846fb80 with x1876445617289216 ext(0->409599) 00010000:00010000:2.0:1789518616.069129:0:36539:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 9 pid: 36533 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.069154:0:36539:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 9 pid: 36533 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518616.069164:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ffd846fb80 00000100:00100000:1.0:1789518616.072039:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518616.072274:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617289344 00000100:00100000:2.0:1789518616.072286:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617289344 00010000:00010000:2.0:1789518616.072403:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 9 pid: 36533 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518616.072500:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1789518616.072512:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2344:x1876445617289344:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518616.072531:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789518616.072556:0:35832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1789518614 -> 1789518615 00002000:00010000:2.0:1789518616.072559:0:35832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1789518614 -> 1789518615 00010000:00010000:2.0:1789518616.072566:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 9 pid: 36533 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.072581:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 9 pid: 36533 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.072611:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cae27945/0x631fd8698c785b07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9e3 expref: 9 pid: 36533 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.072695:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789518616.072701:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789518616.072712:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ea expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.072725:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785b0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ea expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.072800:0:35832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785b0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ea expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518616.072816:0:35832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35832:1876445627643392:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518616.072920:0:35832:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc687b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518616.076162:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518616.076257:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617289472 00000100:00100000:3.0:1789518616.076269:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617289472 00002000:00100000:3.0:1789518616.076341:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (176128->241663) req@ffff99ffd846e300 x1876445617289472/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/0 e 0 to 0 dl 1789518627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518616.076354:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846e300 with x1876445617289472 ext(176128->241663) 00002000:00010000:3.0:1789518616.076360:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd846e300 00000100:00100000:3.0:1789518616.076398:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518616.076409:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2343:x1876445617289472:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518616.077303:0:35832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35832:1876445627643392:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518616.077916:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518616.078019:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2344:x1876445617289344:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 5507us (5990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518616.078031:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1789518616.079347:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2343:x1876445617289472:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 2929us (3190us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1789518616.079359:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00002000:00100000:3.0:1789518616.079371:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (176128->241663) req@ffff99ffd846e300 x1876445617289472/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/440 e 0 to 0 dl 1789518627 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518616.079381:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846e300 with x1876445617289472 ext(176128->241663) 00002000:00010000:3.0:1789518616.079387:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd846e300 00000100:00100000:1.0:1789518616.088281:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518616.088503:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617289600 00000100:00100000:2.0:1789518616.088517:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617289600 00002000:00100000:2.0:1789518616.088585:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (241664->278527) req@ffff99fec81b6680 x1876445617289600/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/0 e 0 to 0 dl 1789518627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.088599:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b6680 with x1876445617289600 ext(241664->278527) 00002000:00010000:2.0:1789518616.088606:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b6680 00000100:00100000:2.0:1789518616.088732:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1789518616.088745:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617289600:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518616.092919:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617289600:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 4160us (4636us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789518616.092934:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00002000:00100000:2.0:1789518616.092950:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (241664->278527) req@ffff99fec81b6680 x1876445617289600/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/440 e 0 to 0 dl 1789518627 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.092987:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b6680 with x1876445617289600 ext(241664->278527) 00002000:00010000:2.0:1789518616.092995:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b6680 00000100:00100000:0.0:1789518616.098556:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518616.098661:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617289728 00000100:00100000:3.0:1789518616.098700:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617289728 00002000:00100000:2.0:1789518616.098839:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (278528->315391) req@ffff99ffd846f100 x1876445617289728/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/0 e 0 to 0 dl 1789518627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.098854:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846f100 with x1876445617289728 ext(278528->315391) 00002000:00010000:2.0:1789518616.098862:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd846f100 00000100:00100000:2.0:1789518616.098903:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1789518616.098914:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617289728:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518616.104269:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617289728:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 5340us (5712us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789518616.104295:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00002000:00100000:2.0:1789518616.104313:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (278528->315391) req@ffff99ffd846f100 x1876445617289728/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/440 e 0 to 0 dl 1789518627 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.104325:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846f100 with x1876445617289728 ext(278528->315391) 00002000:00010000:2.0:1789518616.104334:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd846f100 00000100:00100000:0.0:1789518616.110040:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518616.110114:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617289856 00000100:00100000:2.0:1789518616.110128:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617289856 00002000:00100000:2.0:1789518616.110207:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (315392->352255) req@ffff99ffd846ea00 x1876445617289856/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/0 e 0 to 0 dl 1789518627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.110219:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846ea00 with x1876445617289856 ext(315392->352255) 00002000:00010000:2.0:1789518616.110227:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd846ea00 00000100:00100000:2.0:1789518616.110326:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518616.110363:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617289856:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518616.113949:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617289856:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3572us (3908us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789518616.113965:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00002000:00100000:2.0:1789518616.113982:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (315392->352255) req@ffff99ffd846ea00 x1876445617289856/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/440 e 0 to 0 dl 1789518627 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.113993:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846ea00 with x1876445617289856 ext(315392->352255) 00002000:00010000:2.0:1789518616.114001:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd846ea00 00000100:00100000:3.0:1789518616.121913:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518616.122012:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617289984 00000100:00100000:2.0:1789518616.122028:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617289984 00002000:00100000:2.0:1789518616.122093:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (352256->389119) req@ffff99ffd1009f80 x1876445617289984/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/0 e 0 to 0 dl 1789518627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.122107:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1009f80 with x1876445617289984 ext(352256->389119) 00002000:00010000:2.0:1789518616.122114:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1009f80 00000100:00100000:2.0:1789518616.122147:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:2.0:1789518616.122158:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2343:x1876445617289984:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518616.127414:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2343:x1876445617289984:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 5241us (5493us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789518616.127431:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00002000:00100000:2.0:1789518616.127446:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (352256->389119) req@ffff99ffd1009f80 x1876445617289984/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/440 e 0 to 0 dl 1789518627 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.127457:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1009f80 with x1876445617289984 ext(352256->389119) 00002000:00010000:2.0:1789518616.127464:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1009f80 00000100:00100000:3.0:1789518616.134348:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518616.135456:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617290112 00000100:00100000:2.0:1789518616.135474:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617290112 00002000:00100000:2.0:1789518616.135546:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (389120->409599) req@ffff99ffd100b800 x1876445617290112/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/0 e 0 to 0 dl 1789518627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.135559:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd100b800 with x1876445617290112 ext(389120->409599) 00002000:00010000:2.0:1789518616.135566:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd100b800 00000100:00100000:2.0:1789518616.135657:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1789518616.135671:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617290112:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518616.138124:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617290112:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 2442us (3768us total) trans 0 rc 20480/20480 00000100:00100000:2.0:1789518616.138140:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00002000:00100000:2.0:1789518616.138155:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (389120->409599) req@ffff99ffd100b800 x1876445617290112/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:262/0 lens 488/440 e 0 to 0 dl 1789518627 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518616.138167:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd100b800 with x1876445617290112 ext(389120->409599) 00002000:00010000:2.0:1789518616.138175:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd100b800 00000100:00100000:1.0:1789518616.142822:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518616.142929:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617290368 00000100:00100000:2.0:1789518616.142942:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617290368 00000100:00080000:0.0:1789518616.143049:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518616.143113:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1789518616.143125:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31672:x1876445617290368:12345-192.168.206.51@tcp:103:mmap_sanity.0 00010000:00010000:2.0:1789518616.143143:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518616.143171:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785a20 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd996 expref: 10 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.143188:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:2.0:1789518616.143221:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518616.143387:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31672:x1876445617290368:12345-192.168.206.51@tcp:103:mmap_sanity.0 Request processed in 262us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518616.143395:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1789518616.145722:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518616.146398:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617290496 00000100:00100000:3.0:1789518616.146412:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617290496 00000100:00100000:3.0:1789518616.146486:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:3.0:1789518616.146498:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31672:x1876445617290496:12345-192.168.206.51@tcp:58:mmap_sanity.0 00010000:00010000:3.0:1789518616.146650:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.146672:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd981 expref: 19 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.146684:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.146731:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd981 expref: 19 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.146746:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd981 expref: 19 pid: 35847 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518616.146764:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627643520:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518616.146891:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4daa600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518616.151812:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627643520:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518616.151850:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518616.153712:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518616.153792:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617290624 00000100:00100000:2.0:1789518616.153802:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617290624 00010000:00010000:2.0:1789518616.153838:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd981 expref: 20 pid: 35847 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518616.153874:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1789518616.153881:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2343:x1876445617290624:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518616.153895:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518616.153900:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd981 expref: 20 pid: 35847 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.153910:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd981 expref: 20 pid: 35847 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.153932:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7859a9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd981 expref: 20 pid: 35847 timeout: 770 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.153947:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:2.0:1789518616.153953:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.153976:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.153984:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518616.154015:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518616.154054:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.154068:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518616.154139:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2343:x1876445617290624:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 255us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518616.154149:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000040:00080000:3.0:1789518616.154506:0:37723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].3, 136 off8600 00000100:00100000:3.0:1789518616.154599:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31672:x1876445617290496:12345-192.168.206.51@tcp:58:mmap_sanity.0 Request processed in 8100us (8885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518616.154610:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:0.0:1789518616.160576:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518616.160753:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617290752 00000100:00100000:3.0:1789518616.160767:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617290752 00000100:00100000:3.0:1789518616.160854:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1789518616.160867:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31672:x1876445617290752:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789518616.160893:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518616.160920:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9f1 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.160992:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.161006:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f1 expref: 10 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.161029:0:35847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.161046:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f1 expref: 10 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.161061:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:3.0:1789518616.161064:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518616.161069:0:35847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f1 expref: 10 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518616.161096:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981000, rc 0) 00000100:00100000:3.0:1789518616.161216:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31672:x1876445617290752:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 351us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518616.161226:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00010000:00010000:3.0:1789518616.434971:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518616.463167:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518616.463220:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518616.463257:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518616.463325:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617291008 00000100:00100000:0.0:1789518616.463335:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617291008 00000100:00100000:2.0:1789518616.463349:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617291136 00000100:00100000:2.0:1789518616.463354:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617291136 00000100:00080000:1.0:1789518616.463463:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518616.463475:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617290880 00000100:00100000:3.0:1789518616.463487:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617290880 00000100:00100000:2.0:1789518616.463533:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518616.463550:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1789518616.463551:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617291136:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518616.463565:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617291008:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518616.463576:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1789518616.463595:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617290880:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518616.463695:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617291136:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 147us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518616.463696:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617291008:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 130us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518616.463713:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1789518616.463730:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1789518616.463731:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617290880:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 134us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518616.463747:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000001:00080000:0.0:1789518616.720868:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771077 is committed 00000001:00080000:0.0:1789518616.720886:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771078 is committed 00000001:00080000:0.0:1789518616.720893:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771079 is committed 00000040:00080000:2.0:1789518617.074863:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518617.074873:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518617.074915:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 4 count 4 00000040:00080000:2.0:1789518617.074923:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518617.075047:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ae680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627643648:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518617.075231:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc687bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518617.077803:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.077907:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617291264 00000100:00100000:0.0:1789518617.077918:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617291264 00000100:00100000:0.0:1789518617.077994:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:0.0:1789518617.078006:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31674:x1876445617291264:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518617.078049:0:35846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518617.078150:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31674:x1876445617291264:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 147us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.078158:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00080000:1.0:1789518617.078225:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518617.078388:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ae680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627643648:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518617.082457:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.082662:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617291392 00000100:00100000:3.0:1789518617.082676:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617291392 00000100:00100000:3.0:1789518617.082739:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:3.0:1789518617.082751:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31674:x1876445617291392:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789518617.083554:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083721:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083739:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083816:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083837:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083845:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083870:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083879:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083885:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518617.083922:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:3.0:1789518617.083927:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518617.083939:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083949:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083955:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083961:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083967:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.083971:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083985:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.083997:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:3.0:1789518617.084000:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.084005:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084012:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785b23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084033:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084039:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084045:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084050:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.084052:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084057:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084065:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb6096ffe (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518617.084067:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.084070:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084085:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785b2a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084102:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084107:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084113:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084118:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.084120:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084126:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084133:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:3.0:1789518617.084135:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.084138:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.084143:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785b31 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.084278:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31674:x1876445617291392:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 1525us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.084297:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:3.0:1789518617.085937:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.086023:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617291520 00000100:00100000:2.0:1789518617.086033:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617291520 00000100:00100000:2.0:1789518617.086147:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:2.0:1789518617.086156:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31666:x1876445617291520:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518617.086177:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518617.086194:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785b38 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9f8 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086249:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086261:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086270:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086283:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086290:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086306:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086531:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785b4d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086540:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785b4d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086547:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785b4d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518617.086587:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:2.0:1789518617.086591:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518617.086608:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785b4d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086668:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785b4d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086676:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086684:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086695:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086703:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.086708:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086715:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086725:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518617.086728:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.086733:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086739:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785b3f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086770:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086776:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086783:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086789:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.086792:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086799:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086807:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff99ffd1b0c700) 00010000:00010000:2.0:1789518617.086810:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.086813:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086818:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785b46 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086855:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785b38 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f8 expref: 21 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086869:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785b4d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f8 expref: 20 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.086889:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518617.086892:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518617.086894:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4e00, rc 0) 00000100:00100000:2.0:1789518617.087273:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617291520:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1116us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.087281:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:1.0:1789518617.087563:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.087652:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617291776 00000100:00100000:2.0:1789518617.087661:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617291776 00000100:00100000:2.0:1789518617.087717:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:2.0:1789518617.087727:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31674:x1876445617291776:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518617.087743:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518617.087760:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785b54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfd9ff expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.087840:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.087853:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.087862:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518617.087873:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:2.0:1789518617.087965:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.087974:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.087989:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.087995:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.087999:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.088007:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.088019:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:2.0:1789518617.088023:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518617.088027:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.088033:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785b5b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.088072:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785b54 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ff expref: 22 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.088083:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518617.088085:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518617.088089:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785b54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ff expref: 22 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.088099:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4400, rc 0) 00000100:00100000:2.0:1789518617.088150:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:31674:x1876445617291776:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 424us (599us total) trans 30064771134 rc 301/301 00000100:00100000:2.0:1789518617.088165:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1789518617.093330:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.093530:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.095027:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617292032 00000100:00100000:0.0:1789518617.095039:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617292032 00000100:00100000:0.0:1789518617.095090:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617292160 00000100:00100000:0.0:1789518617.095093:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617292160 00000100:00100000:0.0:1789518617.095176:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:0.0:1789518617.095186:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31666:x1876445617292032:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789518617.095240:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518617.095267:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785b4d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f8 expref: 22 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095289:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981600/0x631fd8698c785b00 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9dc expref: 21 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095320:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:0.0:1789518617.095324:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518617.095347:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095359:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095369:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095382:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095388:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095394:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095659:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095669:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.095677:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.095786:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:1.0:1789518617.095814:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31674:x1876445617292160:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518617.095856:0:35847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518617.096104:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31674:x1876445617292160:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 303us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.096114:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000004:00080000:0.0:1789518617.096280:0:35846:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000032e1:0x8:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1789518617.096576:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097182:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097189:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097195:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.097200:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097208:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097219:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:0.0:1789518617.097222:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518617.097226:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097231:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785b77 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097245:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097251:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097256:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097260:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.097271:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097277:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097284:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518617.097286:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.097288:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.097294:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785b69 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518617.097302:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5f63648 reply state 00000000e2150992 transno 30064771135 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.097310:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518617.097387:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:31666:x1876445617292032:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 2200us (4063us total) trans 30064771135 rc 0/0 00000100:00100000:0.0:1789518617.097395:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00010000:00010000:2.0:1789518617.099826:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.099843:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.099851:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.099857:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.099861:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.099869:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.099884:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff99ffc2d97900) 00010000:00010000:2.0:1789518617.099886:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.099891:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.099897:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785b70 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.100907:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.101891:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617292416 00000100:00100000:1.0:1789518617.101906:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617292416 00000100:00100000:1.0:1789518617.102024:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:1.0:1789518617.102038:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31674:x1876445617292416:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518617.102072:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518617.102096:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785b7e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda06 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518617.102801:0:35847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc3:0x0], index 0: 0 00010000:00010000:1.0:1789518617.103027:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785b85 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.103062:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785b85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.103077:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785b85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.103148:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785b7e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda06 expref: 23 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.103170:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785b85 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda06 expref: 22 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.103179:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffc13ed300) 00010000:00010000:1.0:1789518617.103183:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518617.103187:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:1.0:1789518617.103286:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31674:x1876445617292416:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1251us (2390us total) trans 30064771136 rc 0/0 00000100:00100000:1.0:1789518617.103296:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:3.0:1789518617.106430:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.106949:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617292544 00000100:00100000:1.0:1789518617.106964:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617292544 00000100:00100000:1.0:1789518617.107053:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:1.0:1789518617.107066:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31666:x1876445617292544:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518617.107102:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518617.107130:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785b93 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda0d expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107227:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107265:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107278:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107296:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107304:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107311:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107423:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ba8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107432:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ba8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107439:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ba8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518617.107481:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:1.0:1789518617.107486:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518617.107508:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ba8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107520:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ba8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107556:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107564:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107572:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107578:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518617.107583:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107592:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107607:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518617.107610:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518617.107647:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107655:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785b9a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107671:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107677:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107683:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107695:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518617.107699:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107705:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107713:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff99ffc13ed200) 00010000:00010000:1.0:1789518617.107716:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518617.107719:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107726:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ba1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107766:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785b93 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda0d expref: 24 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107783:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ba8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda0d expref: 23 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.107791:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:1.0:1789518617.107793:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518617.107796:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7000, rc 0) 00000100:00100000:1.0:1789518617.107873:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31666:x1876445617292544:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 809us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.107881:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:1.0:1789518617.110324:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.110415:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617292800 00000100:00100000:3.0:1789518617.110429:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617292800 00000100:00100000:3.0:1789518617.110499:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:3.0:1789518617.110511:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31666:x1876445617292800:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1789518617.110593:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518617.110675:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ba8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda0d expref: 23 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110698:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:3.0:1789518617.110705:0:35845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f1 expref: 9 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110717:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518617.110746:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110760:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110773:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110792:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110811:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110818:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110945:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110954:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.110961:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518617.111394:0:35845:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000032e1:0x7:0x0] is inserted into orphan list, open count = 3 00010000:00010000:3.0:1789518617.111513:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111521:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111527:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111533:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.111538:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111546:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111565:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:3.0:1789518617.111567:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789518617.111571:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111576:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bbd lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111588:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111594:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111599:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111603:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.111605:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111610:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111648:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:3.0:1789518617.111651:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.111655:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.111661:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785baf lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518617.111680:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021345d60 reply state 00000000266207e0 transno 30064771137 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.111690:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518617.111788:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617292800:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 1278us (1476us total) trans 30064771137 rc 0/0 00000100:00100000:3.0:1789518617.111796:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00010000:00010000:3.0:1789518617.116996:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.117020:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.117038:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.117044:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.117048:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.117055:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.117167:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518617.117170:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.117175:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.117180:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785bb6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.117548:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.117607:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617293056 00000100:00100000:0.0:1789518617.117646:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617293056 00000100:00100000:0.0:1789518617.117713:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:0.0:1789518617.117961:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31674:x1876445617293056:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518617.118036:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518617.118062:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785b85 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda06 expref: 23 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118078:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffc13ed300) 00010000:00010000:0.0:1789518617.118101:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518617.118129:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118146:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118157:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118173:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118180:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118186:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118300:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118307:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118313:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118319:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.118323:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118330:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118347:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518617.118350:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.118354:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118361:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785bc4 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118382:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118388:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118394:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118399:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.118402:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118408:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118415:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xae58182a (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518617.118417:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.118420:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.118425:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bcb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xae58182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.118549:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31674:x1876445617293056:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 824us (1006us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518617.118557:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:1.0:1789518617.120920:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.120967:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.121061:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617293184 00000100:00100000:2.0:1789518617.121073:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617293184 00000100:00100000:3.0:1789518617.121109:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617293312 00000100:00100000:3.0:1789518617.121114:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617293312 00000100:00100000:2.0:1789518617.121141:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:3.0:1789518617.121148:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:2.0:1789518617.121151:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31674:x1876445617293184:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1789518617.121154:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31666:x1876445617293312:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789518617.121174:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518617.121174:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518617.121212:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785bd2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda1b expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.121212:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785bd9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda14 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.121254:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121289:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121299:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.121323:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121331:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.121332:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121347:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121354:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121361:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121424:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.121428:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785bd9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda14 expref: 26 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121432:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121444:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.121446:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda14 expref: 25 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121451:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.121455:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:3.0:1789518617.121456:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.121458:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518617.121462:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5600, rc 0) 00010000:00010000:3.0:1789518617.121465:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121473:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:3.0:1789518617.121476:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.121479:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121485:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c785be7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121493:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121498:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121503:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121508:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.121510:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.121519:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31674:x1876445617293184:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 370us (614us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518617.121527:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.121527:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00010000:00010000:3.0:1789518617.121535:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff99ffeaa78700) 00010000:00010000:3.0:1789518617.121537:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.121540:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121559:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785bee lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121599:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785bd2 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda1b expref: 24 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121610:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:3.0:1789518617.121655:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.121660:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785bd2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda1b expref: 24 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.121671:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16000, rc 0) 00000100:00100000:3.0:1789518617.121709:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31666:x1876445617293312:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 554us (742us total) trans 0 rc 301/301 00000100:00100000:3.0:1789518617.121718:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1789518617.124135:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.124439:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617293568 00000100:00100000:1.0:1789518617.124574:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.124656:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617293568 00000100:00100000:2.0:1789518617.124755:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617293824 00000100:00100000:2.0:1789518617.124760:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617293824 00000100:00100000:2.0:1789518617.124799:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:2.0:1789518617.124812:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31674:x1876445617293568:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00000100:00100000:0.0:1789518617.124908:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:0.0:1789518617.124918:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617293824:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518617.124930:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.124948:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bfc lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda22 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.124950:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.124978:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.124992:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.125074:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.125083:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.125089:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.125102:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.125107:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.125111:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518617.125760:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].4, 88 off8496 00000004:00080000:2.0:1789518617.125776:0:35847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671122161007ns, next at 672122156871ns, rc = 0 00000004:00010000:2.0:1789518617.125889:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cabfeceb reply state 000000006d096e41 transno 30064771139 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.125901:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518617.125934:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785c11 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.125952:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785c11 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.125961:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785c11 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518617.125971:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789518617.126004:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.126011:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.126018:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.126025:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.126030:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.126039:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.126053:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518617.126057:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.126064:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.126071:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785c03 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518617.126086:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edfebcc6 reply state 00000000e094baf9 transno 30064771138 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.126090:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31674:x1876445617293568:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1277us (1962us total) trans 30064771139 rc 0/0 00000100:00100000:0.0:1789518617.126107:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518617.126108:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00010000:00010000:0.0:1789518617.126143:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785bfc lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda22 expref: 28 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.126159:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785c11 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda22 expref: 27 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.126166:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518617.126168:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789518617.126171:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697800, rc 0) 00000100:00100000:0.0:1789518617.126446:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31666:x1876445617293824:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1529us (1872us total) trans 30064771138 rc 0/0 00000100:00100000:0.0:1789518617.126454:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:1.0:1789518617.129090:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:2.0:1789518617.129521:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.129538:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.129595:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.129604:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.129609:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.129686:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.129707:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:2.0:1789518617.129710:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518617.129716:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.129723:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785bf5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130153:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130164:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130184:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130190:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.130193:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130200:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130211:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff99ffc2d97e00) 00010000:00010000:3.0:1789518617.130213:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.130216:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130222:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785c0a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.130243:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.130285:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617293952 00000100:00100000:3.0:1789518617.130297:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617293952 00000100:00100000:0.0:1789518617.130313:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617294208 00000100:00100000:0.0:1789518617.130321:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617294208 00000100:00100000:3.0:1789518617.130455:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:3.0:1789518617.130467:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31674:x1876445617293952:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518617.130498:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518617.130517:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda29 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130594:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda29 expref: 28 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130663:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda29 expref: 28 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.130686:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:3.0:1789518617.130688:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518617.130691:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17600, rc 0) 00000100:00100000:3.0:1789518617.130756:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31674:x1876445617293952:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 291us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.130763:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:3.0:1789518617.130784:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:3.0:1789518617.130791:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31666:x1876445617294208:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1789518617.131114:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.131131:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.131141:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518617.131365:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771140 00000004:00010000:3.0:1789518617.131404:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed37d129 reply state 00000000c3c206f0 transno 30064771141 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.131414:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518617.131483:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31666:x1876445617294208:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 692us (1241us total) trans 30064771141 rc 0/0 00000100:00100000:3.0:1789518617.131503:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00000020:00080000:3.0:1789518617.131508:0:35845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518617.133416:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.133439:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.133448:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.133517:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.133524:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.133534:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.133555:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:2.0:1789518617.133559:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.133565:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.133604:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c785c26 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.134599:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.134755:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617294336 00000100:00100000:2.0:1789518617.134768:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617294336 00000100:00100000:2.0:1789518617.134831:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1789518617.134843:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2343:x1876445617294336:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789518617.135277:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617294336:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 435us (685us total) trans 30064771080 rc 0/0 00000100:00100000:2.0:1789518617.135285:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:0.0:1789518617.137814:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.137863:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617294592 00000100:00100000:2.0:1789518617.137874:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617294592 00000100:00100000:2.0:1789518617.138125:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:2.0:1789518617.138138:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:31666:x1876445617294592:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789518617.138217:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518617.138254:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785c11 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda22 expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.138380:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:2.0:1789518617.138413:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:2.0:1789518617.138430:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.138455:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617294720 00010000:00010000:2.0:1789518617.138461:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.138462:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617294720 00010000:00010000:2.0:1789518617.138481:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.138493:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789518617.138526:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (204800->409599) req@ffff99fec1a1c000 x1876445617294720/t0(0) o4->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00010000:00010000:2.0:1789518617.138526:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.138546:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789518617.138549:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1a1c000 with x1876445617294720 ext(204800->409599) 00002000:00010000:3.0:1789518617.138557:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1a1c000 00010000:00010000:2.0:1789518617.138559:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.138589:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1789518617.138599:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2344:x1876445617294720:12345-192.168.206.51@tcp:4:ldlm_bl.0 00010000:00010000:2.0:1789518617.138733:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.138819:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.138827:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789518617.139043:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789518617.139234:0:35847:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000032e1:0xb:0x0] is inserted into orphan list, open count = 1 00000100:00100000:0.0:1789518617.139420:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:2.0:1789518617.140556:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140572:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140581:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140588:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.140594:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140648:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140666:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:2.0:1789518617.140670:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789518617.140675:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140682:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c3b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140718:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140725:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140732:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140739:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.140743:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140751:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140762:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518617.140765:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.140768:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.140784:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c2d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518617.140799:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000538dbf29 reply state 0000000035676f95 transno 30064771142 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.140809:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518617.140915:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31666:x1876445617294592:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 2776us (3109us total) trans 30064771142 rc 0/0 00000100:00100000:2.0:1789518617.140927:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:1.0:1789518617.142767:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617294976 00000100:00100000:1.0:1789518617.142784:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617294976 00000100:00100000:2.0:1789518617.143537:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1789518617.143552:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31674:x1876445617294976:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00010000:00010000:3.0:1789518617.143801:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.143816:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.143826:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.143832:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.143838:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.143869:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31674:x1876445617294976:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 320us (4449us total) trans 30064771143 rc 0/0 00000100:00100000:2.0:1789518617.143877:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00010000:00010000:3.0:1789518617.144548:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.144567:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff99ffd1b0cf00) 00010000:00010000:3.0:1789518617.144570:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.144584:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.144591:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c34 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.146191:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2344:x1876445617294720:12345-192.168.206.51@tcp:4:ldlm_bl.0 Request processed in 7570us (7789us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1789518617.146206:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00002000:00100000:3.0:1789518617.146222:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (204800->409599) req@ffff99fec1a1c000 x1876445617294720/t30064771081(0) o4->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/448 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.146233:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1a1c000 with x1876445617294720 ext(204800->409599) 00002000:00010000:3.0:1789518617.146239:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1a1c000 00000100:00100000:0.0:1789518617.146399:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.146590:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.147056:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617295104 00000100:00100000:1.0:1789518617.147068:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617295104 00000100:00100000:3.0:1789518617.147108:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617295360 00000100:00100000:3.0:1789518617.147113:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617295360 00000100:00100000:1.0:1789518617.147130:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:1.0:1789518617.147140:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31666:x1876445617295104:12345-192.168.206.51@tcp:101:mmap_sanity.0 00000100:00100000:2.0:1789518617.147161:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:2.0:1789518617.147174:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31674:x1876445617295360:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518617.147256:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518617.147280:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785c42 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda30 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.147283:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31674:x1876445617295360:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 112us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.147300:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00010000:00010000:1.0:1789518617.147381:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147398:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147412:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147428:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147458:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147466:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147527:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147536:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147544:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147549:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518617.147552:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147558:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147567:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518617.147569:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518617.147573:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147577:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785c49 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147587:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147596:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147600:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147602:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518617.147604:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147607:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147979:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff99ffc13ed200) 00010000:00010000:1.0:1789518617.147984:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518617.147989:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.147995:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785c50 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.148035:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785c42 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda30 expref: 31 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.148044:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518617.148045:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518617.148048:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785c42 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda30 expref: 31 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.148065:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:1.0:1789518617.148098:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31666:x1876445617295104:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 960us (1699us total) trans 0 rc 301/301 00000100:00100000:1.0:1789518617.148105:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:0.0:1789518617.150196:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.150238:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.150271:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617295488 00000100:00100000:3.0:1789518617.150283:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617295488 00000100:00100000:1.0:1789518617.150310:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617295616 00000100:00100000:1.0:1789518617.150316:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617295616 00000100:00100000:1.0:1789518617.150370:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:1.0:1789518617.150383:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31674:x1876445617295616:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1789518617.150388:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1789518617.150400:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31049:x1876445617295488:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518617.150404:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518617.150416:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518617.150431:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c57 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda37 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518617.150439:0:35830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1789518615 -> 1789518616 00002000:00010000:3.0:1789518617.150444:0:35830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1789518615 -> 1789518616 00010000:00010000:3.0:1789518617.150470:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c785b0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9ea expref: 10 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.150501:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785c5e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.150504:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518617.150519:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785c5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.150531:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785c5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.150568:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31049:x1876445617295488:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 170us (383us total) trans 0 rc 0/0 00000004:00200000:1.0:1789518617.150573:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518617.150596:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785c5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.150599:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00010000:00010000:1.0:1789518617.150666:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c57 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda37 expref: 32 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.150704:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785c5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda37 expref: 31 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.150712:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:1.0:1789518617.150716:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518617.150720:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:1.0:1789518617.150768:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31674:x1876445617295616:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 388us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.150775:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:0.0:1789518617.154830:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.154887:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.154918:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.154976:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617295872 00000100:00100000:2.0:1789518617.154989:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617295872 00000100:00100000:1.0:1789518617.155049:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617296000 00000100:00100000:1.0:1789518617.155056:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617296000 00000100:00100000:2.0:1789518617.155064:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:2.0:1789518617.155079:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31666:x1876445617295872:12345-192.168.206.51@tcp:101:mmap_sanity.0 00000100:00100000:3.0:1789518617.155113:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617296256 00000100:00100000:1.0:1789518617.155114:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1789518617.155122:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617296256 00010000:00010000:2.0:1789518617.155125:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789518617.155131:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617296000:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518617.155142:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518617.155152:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c65 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda3e expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.155160:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda45 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.155164:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518617.155177:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31675:x1876445617296256:12345-192.168.206.51@tcp:35:mmap_sanity.0 00002000:00010000:1.0:1789518617.155197:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e319, blocks: 0x1 00010000:00010000:1.0:1789518617.155217:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=671s v=(0 0) 00010000:00010000:1.0:1789518617.155223:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518617.155234:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda45 expref: 7 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.155256:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda45 expref: 7 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.155286:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:1.0:1789518617.155358:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617296000:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 234us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.155366:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00010000:00010000:2.0:1789518617.155480:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.155498:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.155510:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.155527:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.155534:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518617.155536:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0xb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1789518617.155543:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.155830:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.155840:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.155847:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.155856:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.155862:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.155869:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.155896:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518617.155921:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518617.155929:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.155949:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518617.155954:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.155963:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.155973:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31675:x1876445617296256:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 799us (1055us total) trans 30064771144 rc 0/0 00010000:00010000:0.0:1789518617.155977:0:35834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:0.0:1789518617.155981:0:35834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1789518617.155982:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00010000:00010000:0.0:1789518617.155996:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.156006:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c785c81 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.156025:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518617.156027:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518617.156029:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518617.156198:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156208:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156215:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518617.156224:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 0 00010000:00010000:2.0:1789518617.156258:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156266:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156272:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156278:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.156282:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156289:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156297:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518617.156300:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.156303:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156309:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785c73 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518617.156320:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007021f9ca reply state 0000000060aa78f1 transno 30064771145 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.156439:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518617.156470:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785c65 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda3e expref: 35 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156483:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda3e expref: 34 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.156498:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518617.156500:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789518617.156503:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5400, rc 0) 00000100:00100000:2.0:1789518617.157057:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31666:x1876445617295872:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1980us (2239us total) trans 30064771145 rc 0/0 00000100:00100000:2.0:1789518617.157066:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:0.0:1789518617.157250:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.157297:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617296512 00000100:00100000:1.0:1789518617.157307:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617296512 00000100:00100000:1.0:1789518617.157359:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518617.157369:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31674:x1876445617296512:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518617.157449:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31674:x1876445617296512:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 81us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.157456:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00010000:00010000:2.0:1789518617.158099:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.158111:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.158117:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.158123:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.158128:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.158135:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.158148:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff99fec3b12300) 00010000:00010000:2.0:1789518617.158151:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.158155:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.158162:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c785c7a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.159580:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.159749:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617296768 00000100:00100000:1.0:1789518617.159759:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617296768 00000100:00100000:1.0:1789518617.159820:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:1.0:1789518617.159832:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31666:x1876445617296768:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789518617.160203:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.160223:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.160236:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518617.160307:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771146 00000004:00010000:1.0:1789518617.160337:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086eafc15 reply state 00000000c63b885f transno 30064771147 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.160366:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518617.160469:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:31666:x1876445617296768:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 639us (899us total) trans 30064771147 rc 0/0 00000100:00100000:1.0:1789518617.160478:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000020:00080000:1.0:1789518617.160484:0:35846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789518617.161208:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.161270:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617296896 00000100:00100000:0.0:1789518617.161277:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617296896 00000100:00100000:0.0:1789518617.161333:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1789518617.161343:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:31674:x1876445617296896:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518617.161358:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.161373:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda4c expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.161402:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda45 expref: 8 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.161423:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518617.161428:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518617.161434:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 8 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.161473:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda45 expref: 8 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.161488:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda45 expref: 8 pid: 36532 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.161504:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:36531:1876445627643776:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518617.161602:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6c00 going to sleep for 11 seconds 00010000:00010000:3.0:1789518617.162493:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.162515:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.162594:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.162602:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.162608:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.162655:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.162677:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:3.0:1789518617.162681:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.162688:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.162695:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785c96 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.163185:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:36531:1876445627643776:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518617.163220:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 8 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.163241:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697200, rc 0) 00000100:00100000:0.0:1789518617.163302:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:31674:x1876445617296896:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1959us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.163310:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1789518617.164238:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.164442:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617297152 00000100:00100000:0.0:1789518617.164452:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617297152 00000100:00100000:0.0:1789518617.164506:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:0.0:1789518617.164529:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31666:x1876445617297152:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518617.164551:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.164574:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785ca4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda53 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.164698:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.164713:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.164724:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.164738:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.164744:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.164750:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165203:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785cb9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165213:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785cb9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165220:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785cb9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518617.165243:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00010000:00010000:0.0:1789518617.165353:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165361:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165367:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165372:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0697800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.165376:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165384:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165394:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518617.165397:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.165401:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165406:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697800/0x631fd8698c785cab lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165417:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165423:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165438:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165443:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.165445:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165451:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165456:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff99ffc2d97400) 00010000:00010000:0.0:1789518617.165458:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.165461:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165465:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785cb2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165509:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c785ca4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda53 expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165520:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785cb9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda53 expref: 12 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.165527:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:0.0:1789518617.165529:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518617.165531:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696400, rc 0) 00000100:00100000:0.0:1789518617.165600:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+12:31666:x1876445617297152:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1071us (1367us total) trans 30064771148 rc 0/0 00000100:00100000:0.0:1789518617.165651:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:2.0:1789518617.167772:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.167863:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617297280 00000100:00100000:3.0:1789518617.167875:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617297280 00010000:00010000:3.0:1789518617.167917:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda45 expref: 8 pid: 36532 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.167966:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518617.167976:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617297280:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518617.167993:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518617.168036:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda45 expref: 8 pid: 36532 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.168051:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda45 expref: 8 pid: 36532 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.168077:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c785c6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda45 expref: 8 pid: 36532 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.168096:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518617.168101:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518617.168111:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.168122:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.168168:0:35832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.168199:0:35832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:35832:1876445627643904:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518617.168302:0:35832:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4daa540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518617.170762:0:35832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:35832:1876445627643904:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518617.170794:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518617.170854:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617297280:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2878us (3107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.170866:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518617.172805:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.172904:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617297536 00000100:00100000:3.0:1789518617.172916:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617297536 00000100:00100000:3.0:1789518617.172991:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1789518617.173002:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+12:31666:x1876445617297536:12345-192.168.206.51@tcp:103:mmap_sanity.0 00010000:00010000:3.0:1789518617.173038:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518617.173066:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785cb9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda53 expref: 12 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.173087:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:3.0:1789518617.173092:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.173152:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+11:31666:x1876445617297536:12345-192.168.206.51@tcp:103:mmap_sanity.0 Request processed in 151us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.173161:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1789518617.174817:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.174893:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617297664 00000100:00100000:2.0:1789518617.174902:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617297664 00000100:00100000:2.0:1789518617.174996:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:2.0:1789518617.175007:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+11:31666:x1876445617297664:12345-192.168.206.51@tcp:58:mmap_sanity.0 00010000:00010000:2.0:1789518617.175123:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.175143:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda3e expref: 35 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.175153:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.175205:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda3e expref: 35 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.175221:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda3e expref: 35 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.175260:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627644032:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518617.175356:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc2d43600 going to sleep for 11 seconds 00000100:00100000:1.0:1789518617.178144:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.178235:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617297792 00000100:00100000:3.0:1789518617.178246:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617297792 00010000:00010000:3.0:1789518617.178290:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda3e expref: 36 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.178338:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1789518617.178349:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2342:x1876445617297792:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518617.178389:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518617.178398:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda3e expref: 36 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.178413:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda3e expref: 36 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.178438:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:3.0:1789518617.178445:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.178471:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.178480:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.178572:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.178669:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2342:x1876445617297792:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 316us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.178678:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1789518617.178703:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.178756:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617297920 00010000:00010000:2.0:1789518617.178859:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785c88 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda3e expref: 35 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.178880:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627644032:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518617.178906:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.178907:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617297920 00010000:00010000:2.0:1789518617.178915:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.178920:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789518617.178940:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff99ffc6389c00 x1876445617297920/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789518617.178951:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6389c00 with x1876445617297920 ext(0->409599) 00002000:00010000:3.0:1789518617.178956:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6389c00 00000100:00100000:3.0:1789518617.178983:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518617.178991:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617297920:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000040:00080000:2.0:1789518617.179254:0:35845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].4, 136 off8736 00000100:00100000:2.0:1789518617.179334:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+11:31666:x1876445617297664:12345-192.168.206.51@tcp:58:mmap_sanity.0 Request processed in 4329us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.179344:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:0.0:1789518617.184242:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.184305:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617298048 00000100:00100000:3.0:1789518617.184319:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617298048 00000100:00100000:3.0:1789518617.184390:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1789518617.184401:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+11:31666:x1876445617298048:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789518617.184428:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518617.184453:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785cce lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda5a expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.184544:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.184555:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785cce lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda5a expref: 12 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.184578:0:37723:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.184597:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785cce lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda5a expref: 12 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.184648:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:3.0:1789518617.184652:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518617.184657:0:37723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785cce lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda5a expref: 12 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.184665:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:3.0:1789518617.184789:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+12:31666:x1876445617298048:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 390us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.185104:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1789518617.188391:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617297920:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9384us (9674us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1789518617.188408:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00002000:00100000:3.0:1789518617.188425:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff99ffc6389c00 x1876445617297920/t30064771081(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:263/0 lens 488/448 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789518617.188456:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6389c00 with x1876445617297920 ext(0->409599) 00002000:00010000:3.0:1789518617.188465:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6389c00 00000100:00100000:0.0:1789518617.191248:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.191339:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617298176 00000100:00100000:1.0:1789518617.191353:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617298176 00000100:00100000:1.0:1789518617.191422:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:1.0:1789518617.191433:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31674:x1876445617298176:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789518617.231499:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771148 is committed 00000001:00080000:3.0:1789518617.231521:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771138 is committed 00000020:00080000:3.0:1789518617.231543:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fff7a2c6c0 refcount 2 committed 0 result 0 batchid 25769803892 00000020:00080000:3.0:1789518617.231549:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff7337900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7a2c780 00000020:00080000:3.0:1789518617.231554:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff7337500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd8153800 00000020:00080000:0.0:1789518617.231974:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803892 committed batchid 21474836520 00000020:00080000:0.0:1789518617.232223:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000001:00080000:3.0:1789518617.232482:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771147 is committed 00000004:00080000:3.0:1789518617.232594:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789518617.232641:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803891 batchid updated 00000100:00100000:1.0:1789518617.232838:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627644160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789518617.232922:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518617.233039:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627644160 00000100:00100000:3.0:1789518617.233050:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627644160 00000100:00100000:3.0:1789518617.233124:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518617.233136:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627644160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789518617.233333:0:36735:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:3.0:1789518617.233337:0:36735:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1789518617 00002000:00010000:3.0:1789518617.233340:0:36735:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789518617.233342:0:36735:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1789518617 -> 1789518617 00002000:00010000:3.0:1789518617.233345:0:36735:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789518617.233590:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627644160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 456us (667us total) trans 30064771082 rc 0/0 00000100:00100000:3.0:1789518617.233599:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789518617.233659:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518617.233791:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31674:x1876445617298176:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 42358us (42554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.233823:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:1.0:1789518617.234090:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771079 gen 2 00000004:00080000:1.0:1789518617.234102:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771078 committed transno 30064771079 00000004:00080000:1.0:1789518617.234123:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffd846ed80, transno 30064771079 00000100:00100000:1.0:1789518617.234145:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fff7388e00 x1876445627644160/t30064771082(30064771082) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518633 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789518617.234158:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff7388e00/2, rc 0, transno 30064771082 00000100:00100000:1.0:1789518617.234164:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627644160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789518617.236281:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.236364:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617298304 00000100:00100000:1.0:1789518617.236376:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617298304 00000100:00100000:1.0:1789518617.236434:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:1.0:1789518617.236442:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617298304:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789518617.268542:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771080 is committed 00000001:00080000:3.0:1789518617.268723:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771082 is committed 00000001:00080000:3.0:1789518617.268732:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771081 is committed 00000100:00100000:1.0:1789518617.268818:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617298304:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 32370us (32540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.268845:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:0.0:1789518617.272104:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.272190:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617298560 00000100:00100000:2.0:1789518617.272260:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617298560 00000100:00100000:2.0:1789518617.272316:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:2.0:1789518617.272326:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31674:x1876445617298560:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518617.272847:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518617.272873:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785c5e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda37 expref: 13 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.272907:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:2.0:1789518617.272912:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518617.272944:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.272958:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.272968:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518617.273215:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066610a07 reply state 000000005054f049 transno 30064771149 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.273226:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518617.273386:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:31674:x1876445617298560:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1060us (1290us total) trans 30064771149 rc 0/0 00000100:00100000:2.0:1789518617.273395:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:0.0:1789518617.276078:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.276240:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617298688 00000100:00100000:1.0:1789518617.276250:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617298688 00000100:00100000:1.0:1789518617.276303:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:1.0:1789518617.276314:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617298688:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789518617.276807:0:36531:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:1.0:1789518617.276812:0:36531:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 1789518617 -> 1789518613 00002000:00010000:1.0:1789518617.276814:0:36531:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb atime from disk: 0 -> 1789518613 00002000:00010000:1.0:1789518617.276816:0:36531:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1789518617 -> 1789518613 00002000:00010000:1.0:1789518617.276818:0:36531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:1.0:1789518617.277005:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617298688:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 691us (933us total) trans 30064771083 rc 0/0 00000100:00100000:1.0:1789518617.277014:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00010000:00010000:2.0:1789518617.277109:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.277121:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.277129:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.277137:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.277142:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.277166:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.277184:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:2.0:1789518617.277187:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.277194:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.277212:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785cd5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.278927:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.279153:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617298944 00000100:00100000:2.0:1789518617.279165:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617298944 00000100:00100000:2.0:1789518617.279226:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:2.0:1789518617.279239:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:31674:x1876445617298944:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789518617.279308:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.279324:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda14 expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.279335:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.279369:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda14 expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.279382:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda14 expref: 13 pid: 35847 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.279418:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627644288:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518617.279558:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518617.282057:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627644288:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518617.282084:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.282438:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.282785:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617299072 00000100:00100000:2.0:1789518617.282794:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617299072 00010000:00010000:2.0:1789518617.282836:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda14 expref: 14 pid: 35847 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.282909:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1789518617.282919:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617299072:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518617.282934:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518617.282941:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda14 expref: 14 pid: 35847 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.282952:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda14 expref: 14 pid: 35847 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.282972:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c785be0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda14 expref: 14 pid: 35847 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.283001:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:2.0:1789518617.283007:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.283035:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.283042:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.283072:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518617.283128:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617299072:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 209us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.283136:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00010000:00010000:3.0:1789518617.283198:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.283208:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.283235:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.283242:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.283249:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.283255:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.283259:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.283266:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.283275:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:3.0:1789518617.283277:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789518617.283281:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.283298:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785cdc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.283350:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:31674:x1876445617298944:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 4114us (4430us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789518617.283358:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:0.0:1789518617.286531:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.286575:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617299200 00000100:00100000:3.0:1789518617.286583:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617299200 00000100:00100000:3.0:1789518617.286659:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1789518617.286669:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617299200:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789518617.286715:0:36533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.286733:0:36533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.286742:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518617.286747:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518617.286764:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.286801:0:36533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.286814:0:36533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 7 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.286845:0:36533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:36533:1876445627644416:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518617.286952:0:36533:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc687b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518617.289371:0:36533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:36533:1876445627644416:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518617.289401:0:36533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.290496:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.290742:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617299328 00000100:00100000:3.0:1789518617.290750:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617299328 00010000:00010000:3.0:1789518617.290786:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 8 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.290832:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518617.290841:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617299328:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518617.290855:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518617.290878:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 8 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.290890:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 8 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.290914:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29e97d3/0x631fd8698c785c9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda4c expref: 8 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.290931:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518617.290952:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518617.290958:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.290968:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.291050:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.291112:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617299328:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 271us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.291120:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00010000:00010000:1.0:1789518617.291277:0:36533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.291352:0:36533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.291378:0:36533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.291387:0:36533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.291409:0:36533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.291416:0:36533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518617.291421:0:36533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.291430:0:36533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.291441:0:36533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.291448:0:36533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c785ce3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.291746:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617299200:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 5077us (5222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.291754:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:0.0:1789518617.294014:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.294398:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617299584 00000100:00100000:3.0:1789518617.294408:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617299584 00000100:00100000:3.0:1789518617.294506:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:3.0:1789518617.294517:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:31674:x1876445617299584:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518617.294593:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.294609:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.294663:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.294849:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.294861:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda29 expref: 13 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.294888:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.294919:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda29 expref: 13 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.294933:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda29 expref: 13 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.294946:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627644544:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518617.295026:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc687b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518617.297983:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627644544:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518617.298021:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.300469:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.300578:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617299712 00000100:00100000:2.0:1789518617.300588:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617299712 00010000:00010000:2.0:1789518617.301400:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda29 expref: 14 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.301492:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1789518617.301510:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617299712:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518617.301527:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518617.301535:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda29 expref: 14 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.301549:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda29 expref: 14 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.301572:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785c1f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda29 expref: 14 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.301588:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:3.0:1789518617.301593:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.301665:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.301671:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.301699:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.301762:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617299712:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 259us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.301769:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00010000:00010000:1.0:1789518617.302690:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.302721:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518617.302909:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771150 00000001:00080000:1.0:1789518617.303079:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771151 00000001:00080000:1.0:1789518617.303122:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771152 00000100:00100000:1.0:1789518617.303202:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1a1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627644672:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518617.303255:0:37723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518617.303293:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518617.304068:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627644672 00000100:00100000:2.0:1789518617.304079:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627644672 00000100:00100000:2.0:1789518617.304130:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789518617.304139:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627644672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518617.304237:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627644672:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.304246:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789518617.304341:0:37723:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771082 gen 2 00000004:00080000:3.0:1789518617.304346:0:37723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff7388e00, transno 30064771082 00000100:00100000:3.0:1789518617.304355:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1a1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627644672:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789518617.305252:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771153 00000100:00100000:3.0:1789518617.305318:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627644800:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789518617.305835:0:37723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518617.305876:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518617.305880:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627644800 00000100:00100000:2.0:1789518617.305888:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627644800 00000100:00100000:2.0:1789518617.305964:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789518617.305972:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627644800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518617.306172:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:37723:x1876445627644800:12345-0@lo:1000:mdt00_003.0 Request processed in 200us (338us total) trans 30064771084 rc 0/0 00000100:00100000:2.0:1789518617.306189:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789518617.306385:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627644800:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789518617.306419:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306429:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306436:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306442:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.306454:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306461:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306488:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:3.0:1789518617.306492:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518617.306496:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306502:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf1 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306530:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306535:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306540:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306545:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec4981400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.306548:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306553:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306560:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:3.0:1789518617.306563:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518617.306576:0:37723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f1 expref: 10 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306588:0:37723:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f1 expref: 10 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306597:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f1 expref: 10 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.306663:0:37723:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f1 expref: 10 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.306675:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627644928:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518617.306740:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518617.314172:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627644928:192.168.206.51@tcp:105: 00000100:00100000:0.0:1789518617.314182:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518617.314203:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314214:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981400/0x631fd8698c785b15 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314240:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314252:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314262:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314289:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314296:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314303:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314309:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.314313:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314322:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314333:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:3.0:1789518617.314336:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.314340:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314344:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785cf8 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314351:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314356:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314360:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314369:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.314371:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314375:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314380:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:3.0:1789518617.314381:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518617.314383:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.314386:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785cea lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.314522:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617299840 00000100:00100000:2.0:1789518617.314530:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617299840 00000100:00100000:3.0:1789518617.314722:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:31674:x1876445617299584:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 20204us (20711us total) trans 30064771154 rc 0/0 00000100:00100000:3.0:1789518617.314731:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000020:00080000:3.0:1789518617.314737:0:37723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789518617.314749:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:2.0:1789518617.314761:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+11:31672:x1876445617299840:12345-192.168.206.51@tcp:49:mmap_sanity.0 00000100:00100000:2.0:1789518617.315182:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+11:31672:x1876445617299840:12345-192.168.206.51@tcp:49:mmap_sanity.0 Request processed in 422us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.315190:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000040:00080000:0.0:1789518617.315306:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518617.315312:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518617.315361:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:0.0:1789518617.315367:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518617.315454:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627645056:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518617.315824:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518617.319786:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.319811:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffff666a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627645056:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518617.319840:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.319882:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.320011:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617300224 00000100:00100000:2.0:1789518617.320011:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617299968 00000100:00100000:3.0:1789518617.320020:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617300224 00000100:00100000:2.0:1789518617.320020:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617299968 00000100:00100000:2.0:1789518617.320080:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:3.0:1789518617.320084:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1789518617.320095:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:31672:x1876445617299968:12345-192.168.206.51@tcp:101:mmap_sanity.0 00000100:00100000:3.0:1789518617.320097:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:31674:x1876445617300224:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00010000:00010000:2.0:1789518617.320123:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518617.320144:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cf40d2/0x631fd8698c785cff lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda61 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518617.320170:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 409600, mtime: 0x6aa9e315, atime: 0x6aa9e315, ctime: 0x6aa9e315, blocks: 0x403 00010000:00010000:2.0:1789518617.320189:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=671s v=(0 0) 00010000:00010000:2.0:1789518617.320195:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518617.320205:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cf40d2/0x631fd8698c785cff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda61 expref: 6 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.320222:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024cf40d2/0x631fd8698c785cff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda61 expref: 6 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.320258:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4e00, rc 0) 00000100:00100000:2.0:1789518617.320318:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31672:x1876445617299968:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 215us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.320326:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:0.0:1789518617.320521:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617300352 00000100:00100000:0.0:1789518617.320527:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617300352 00000100:00100000:0.0:1789518617.320566:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:0.0:1789518617.320581:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31677:x1876445617300352:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518617.320597:0:35846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518617.320698:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31677:x1876445617300352:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 119us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.320705:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000004:00080000:0.0:1789518617.321378:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0xa:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789518617.321475:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771155 00010000:00010000:0.0:1789518617.321521:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.321535:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.321557:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.321566:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.321572:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.321579:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.321602:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518617.321701:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31674:x1876445617300224:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1606us (1869us total) trans 30064771156 rc 0/0 00000100:00100000:0.0:1789518617.321708:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000020:00080000:0.0:1789518617.321713:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518617.322829:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518617.322838:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.322848:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696c00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518617.322862:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.322871:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.322888:0:36743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff99ffc2d97400) 00010000:00010000:3.0:1789518617.322891:0:36743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518617.322896:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.322903:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d06 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.322922:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518617.322924:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518617.322926:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518617.323296:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.323447:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617300480 00000100:00100000:0.0:1789518617.323456:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617300480 00000100:00100000:0.0:1789518617.323562:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518617.323573:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31672:x1876445617300480:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518617.323589:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.323606:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c785d0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda68 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518617.323656:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6aa9e318, atime: 0x6aa9e315, ctime: 0x6aa9e318, blocks: 0x403 00010000:00010000:0.0:1789518617.323677:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1789518617.323682:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518617.323693:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c785d0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda68 expref: 10 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.323709:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c785d0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda68 expref: 10 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.323720:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697800, rc 0) 00000100:00100000:0.0:1789518617.323771:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31672:x1876445617300480:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 200us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.323778:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:1.0:1789518617.325287:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.325379:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617300608 00000100:00100000:2.0:1789518617.325388:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617300608 00000100:00100000:2.0:1789518617.325526:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:2.0:1789518617.325537:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31677:x1876445617300608:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789518617.325599:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325647:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325659:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325674:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325681:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325791:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325817:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325841:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325849:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518617.325884:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1789518617.325888:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518617.325901:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325911:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325918:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325924:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325930:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.325934:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325941:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325952:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:2.0:1789518617.325955:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.325960:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325978:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325991:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.325998:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326004:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326010:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.326013:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326018:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326023:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xadcadaa3 (ffff99fec3b12300) 00010000:00010000:2.0:1789518617.326074:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.326077:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326081:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d1b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326093:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326097:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326106:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326109:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.326111:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326114:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326120:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518617.326122:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.326123:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.326127:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d22 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.326226:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31677:x1876445617300608:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 690us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.326234:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:1.0:1789518617.328548:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.328681:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.328726:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617300992 00000100:00100000:0.0:1789518617.328736:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617300992 00000100:00100000:0.0:1789518617.328792:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:0.0:1789518617.328802:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31677:x1876445617300992:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518617.328823:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.328851:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785d29 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda6f expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.328946:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.328960:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.328972:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518617.328984:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000100:00100000:3.0:1789518617.329071:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617300736 00000100:00100000:3.0:1789518617.329076:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617300736 00010000:00010000:0.0:1789518617.329094:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.329103:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.329111:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.329118:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd0696400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.329123:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.329131:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.329144:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:0.0:1789518617.329148:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518617.329152:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789518617.329154:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->65535) req@ffff99fec1f89f80 x1876445617300736/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00010000:00010000:0.0:1789518617.329173:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d30 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789518617.329178:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f89f80 with x1876445617300736 ext(0->65535) 00002000:00010000:3.0:1789518617.329187:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f89f80 00010000:00010000:0.0:1789518617.329231:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785d29 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda6f expref: 20 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.329243:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518617.329246:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518617.329251:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696600/0x631fd8698c785d29 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda6f expref: 20 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.329257:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00010000:00010000:0.0:1789518617.329269:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696600, rc 0) 00000100:00100000:3.0:1789518617.329271:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617300736:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518617.329337:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31677:x1876445617300992:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 535us (655us total) trans 30064771157 rc 301/301 00000100:00100000:0.0:1789518617.329345:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:0.0:1789518617.333242:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.333273:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617301120 00000100:00100000:0.0:1789518617.333280:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617301120 00000100:00100000:0.0:1789518617.333330:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:0.0:1789518617.333342:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31677:x1876445617301120:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518617.333377:0:37723:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518617.333465:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31677:x1876445617301120:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 126us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.333473:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:0.0:1789518617.333645:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617300736:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 4346us (5075us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1789518617.333667:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00002000:00100000:0.0:1789518617.333677:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->65535) req@ffff99fec1f89f80 x1876445617300736/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518617.333697:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f89f80 with x1876445617300736 ext(0->65535) 00002000:00010000:0.0:1789518617.333704:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f89f80 00000100:00100000:0.0:1789518617.336440:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.336510:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617301376 00000100:00100000:2.0:1789518617.336680:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617301376 00000100:00100000:2.0:1789518617.336736:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:2.0:1789518617.336746:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:31677:x1876445617301376:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518617.336765:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518617.336783:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d3e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda76 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518617.337904:0:35845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc3:0x0], index 1: 0 00010000:00010000:2.0:1789518617.338089:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d45 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.338104:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.338115:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.338165:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d3e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda76 expref: 22 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.338324:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d45 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda76 expref: 21 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.338333:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:2.0:1789518617.338336:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518617.338340:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5a00, rc 0) 00000100:00100000:2.0:1789518617.338401:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:31677:x1876445617301376:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1656us (1969us total) trans 30064771158 rc 0/0 00000100:00100000:2.0:1789518617.338410:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:1.0:1789518617.339165:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.339295:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617301504 00000100:00100000:3.0:1789518617.339302:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617301504 00002000:00100000:3.0:1789518617.339339:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (65536->102399) req@ffff99fec1f8b100 x1876445617301504/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.339369:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8b100 with x1876445617301504 ext(65536->102399) 00002000:00010000:3.0:1789518617.339374:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8b100 00000100:00100000:3.0:1789518617.339589:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1789518617.339602:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2344:x1876445617301504:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518617.342519:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.342590:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617301760 00000100:00100000:3.0:1789518617.342598:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617301760 00000100:00100000:3.0:1789518617.342674:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:3.0:1789518617.342683:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:31677:x1876445617301760:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518617.342751:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518617.342774:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785d45 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda76 expref: 21 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.342793:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:3.0:1789518617.342803:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518617.342822:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.342835:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.342844:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.342856:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.342863:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.342877:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343047:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343055:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343061:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343066:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.343070:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343077:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343084:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:3.0:1789518617.343087:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.343091:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343097:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785d53 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343105:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343112:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343124:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343129:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.343132:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343138:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343145:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8326fbee (ffff99ffeaa78700) 00010000:00010000:3.0:1789518617.343147:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.343150:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.343155:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785d5a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8326fbee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.343335:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31677:x1876445617301760:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 652us (824us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518617.343343:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:3.0:1789518617.343875:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2344:x1876445617301504:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 4274us (4711us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789518617.343883:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00002000:00100000:3.0:1789518617.343893:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (65536->102399) req@ffff99fec1f8b100 x1876445617301504/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.343903:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8b100 with x1876445617301504 ext(65536->102399) 00002000:00010000:3.0:1789518617.343915:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8b100 00000100:00100000:3.0:1789518617.347810:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.347965:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617301888 00000100:00100000:0.0:1789518617.347975:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617301888 00000100:00100000:0.0:1789518617.348085:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:0.0:1789518617.348095:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31677:x1876445617301888:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518617.348115:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.348137:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d61 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda7d expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.348169:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.348194:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.348207:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.348308:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696400/0x631fd8698c785d61 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda7d expref: 22 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.348340:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda7d expref: 21 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.348348:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518617.348351:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518617.348354:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696c00, rc 0) 00000100:00100000:0.0:1789518617.348413:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:31677:x1876445617301888:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 320us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.348420:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:3.0:1789518617.349051:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.349368:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617302016 00000100:00100000:1.0:1789518617.349376:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617302016 00002000:00100000:1.0:1789518617.349412:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (102400->139263) req@ffff99fff78a9f80 x1876445617302016/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518617.349423:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78a9f80 with x1876445617302016 ext(102400->139263) 00002000:00010000:1.0:1789518617.349429:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78a9f80 00000100:00100000:1.0:1789518617.349459:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:1.0:1789518617.349468:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2342:x1876445617302016:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:1.0:1789518617.350608:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.351453:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617302272 00000100:00100000:2.0:1789518617.351462:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617302272 00000100:00100000:2.0:1789518617.351518:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:2.0:1789518617.351528:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:31677:x1876445617302272:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518617.351599:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.351653:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.351665:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518617.352032:0:35845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].3, 88 off8432 00000004:00080000:2.0:1789518617.352045:0:35845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671348430708ns, next at 672348427495ns, rc = 0 00000004:00010000:2.0:1789518617.352133:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067168a21 reply state 00000000e6df10e4 transno 30064771159 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.352143:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518617.352231:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31677:x1876445617302272:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 703us (1627us total) trans 30064771159 rc 0/0 00000100:00100000:2.0:1789518617.352239:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:0.0:1789518617.352981:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2342:x1876445617302016:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3511us (3929us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518617.352991:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00002000:00100000:0.0:1789518617.353000:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (102400->139263) req@ffff99fff78a9f80 x1876445617302016/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518617.353100:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78a9f80 with x1876445617302016 ext(102400->139263) 00002000:00010000:0.0:1789518617.353104:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78a9f80 00010000:00010000:3.0:1789518617.353400:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.353411:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.353418:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.353425:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.353429:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.353437:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.353454:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:3.0:1789518617.353457:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518617.353463:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.353469:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785d6f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.354790:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.355178:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617302400 00000100:00100000:2.0:1789518617.355187:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617302400 00000100:00100000:2.0:1789518617.355352:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:2.0:1789518617.355365:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31677:x1876445617302400:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518617.355389:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518617.355407:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda84 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.355466:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda84 expref: 23 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.355481:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda84 expref: 23 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.355535:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:2.0:1789518617.355540:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518617.355544:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4400, rc 0) 00000100:00100000:2.0:1789518617.356289:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31677:x1876445617302400:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 923us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.356298:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:1.0:1789518617.356795:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.356951:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617302528 00000100:00100000:3.0:1789518617.356958:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617302528 00002000:00100000:3.0:1789518617.356995:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (139264->176127) req@ffff99fec1f88e00 x1876445617302528/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.357232:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f88e00 with x1876445617302528 ext(139264->176127) 00002000:00010000:3.0:1789518617.357238:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f88e00 00000100:00100000:3.0:1789518617.357266:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1789518617.357287:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617302528:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:1.0:1789518617.360558:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.360741:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617302656 00000100:00100000:2.0:1789518617.360754:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617302656 00000100:00100000:2.0:1789518617.360892:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518617.360905:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617302656:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789518617.361236:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617302528:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3950us (4440us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518617.361247:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00002000:00100000:0.0:1789518617.361261:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (139264->176127) req@ffff99fec1f88e00 x1876445617302528/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518617.361272:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f88e00 with x1876445617302528 ext(139264->176127) 00002000:00010000:0.0:1789518617.361278:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f88e00 00000100:00080000:1.0:1789518617.362078:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518617.362171:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617302656:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 1265us (1622us total) trans 30064771082 rc 0/0 00000100:00100000:2.0:1789518617.362180:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:3.0:1789518617.366458:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.366568:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617302912 00000100:00100000:0.0:1789518617.366589:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617302912 00000100:00100000:0.0:1789518617.366826:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1789518617.366838:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31677:x1876445617302912:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518617.367373:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31677:x1876445617302912:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 534us (923us total) trans 30064771160 rc 0/0 00000100:00100000:0.0:1789518617.367381:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1789518617.367706:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.368855:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617303040 00000100:00100000:0.0:1789518617.368866:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617303040 00002000:00100000:0.0:1789518617.368914:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (176128->212991) req@ffff99fec1f8a300 x1876445617303040/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518617.368927:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8a300 with x1876445617303040 ext(176128->212991) 00002000:00010000:0.0:1789518617.368933:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8a300 00000100:00100000:0.0:1789518617.369004:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:0.0:1789518617.369014:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2345:x1876445617303040:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518617.369904:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.369976:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617303296 00000100:00100000:0.0:1789518617.369983:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617303296 00000100:00100000:0.0:1789518617.370027:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:0.0:1789518617.370036:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31677:x1876445617303296:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518617.370128:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31677:x1876445617303296:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.370136:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:0.0:1789518617.375479:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2345:x1876445617303040:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 6456us (7762us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518617.375493:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00002000:00100000:0.0:1789518617.375519:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (176128->212991) req@ffff99fec1f8a300 x1876445617303040/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518617.375529:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8a300 with x1876445617303040 ext(176128->212991) 00002000:00010000:0.0:1789518617.375535:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8a300 00000100:00100000:2.0:1789518617.376946:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.377027:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617303424 00000100:00100000:1.0:1789518617.377036:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617303424 00000100:00100000:1.0:1789518617.377082:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:1.0:1789518617.377089:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31677:x1876445617303424:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518617.377103:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518617.377118:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785d7d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda8b expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.377168:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785d84 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.377178:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785d84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.377186:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785d84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518617.377221:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518617.377235:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785d84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.377253:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785d7d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda8b expref: 26 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.377266:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785d84 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda8b expref: 25 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.377282:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:1.0:1789518617.377284:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518617.377286:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:1.0:1789518617.377329:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31677:x1876445617303424:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 240us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.377336:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:1.0:1789518617.380282:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.380330:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.380351:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617303552 00000100:00100000:0.0:1789518617.380362:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617303552 00002000:00100000:0.0:1789518617.380410:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (212992->249855) req@ffff99fec1f88380 x1876445617303552/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518617.380421:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f88380 with x1876445617303552 ext(212992->249855) 00002000:00010000:0.0:1789518617.380427:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f88380 00000100:00100000:0.0:1789518617.380455:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1789518617.380465:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617303552:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:3.0:1789518617.380567:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617303680 00000100:00100000:3.0:1789518617.380572:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617303680 00000100:00100000:3.0:1789518617.380652:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1789518617.380660:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617303680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518617.380680:0:36735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518617.380699:0:36735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda92 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518617.380722:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e319, blocks: 0x1 00010000:00010000:3.0:1789518617.380739:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1789518617.380743:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518617.380752:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda92 expref: 10 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.380770:0:36735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda92 expref: 10 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.380788:0:36735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16200, rc 0) 00000100:00100000:3.0:1789518617.380830:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617303680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 170us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.380851:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:0.0:1789518617.383424:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617303552:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 2952us (3210us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518617.383441:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00002000:00100000:0.0:1789518617.383454:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (212992->249855) req@ffff99fec1f88380 x1876445617303552/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518617.383464:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f88380 with x1876445617303552 ext(212992->249855) 00002000:00010000:0.0:1789518617.383470:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f88380 00000100:00100000:3.0:1789518617.383548:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.383675:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617303936 00000100:00100000:0.0:1789518617.383682:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617303936 00000100:00100000:0.0:1789518617.383954:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:0.0:1789518617.383964:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31677:x1876445617303936:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518617.384108:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31677:x1876445617303936:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 144us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.384129:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:1.0:1789518617.386248:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.387521:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.387886:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617304064 00000100:00100000:0.0:1789518617.387896:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617304064 00000100:00100000:0.0:1789518617.387994:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1789518617.388004:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:31677:x1876445617304064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1789518617.388018:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617304192 00000100:00100000:2.0:1789518617.388022:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617304192 00010000:00010000:0.0:1789518617.388022:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.388040:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfda99 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1789518617.388050:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (249856->286719) req@ffff99fec1f88000 x1876445617304192/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518617.388059:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f88000 with x1876445617304192 ext(249856->286719) 00002000:00010000:2.0:1789518617.388063:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f88000 00010000:00010000:0.0:1789518617.388068:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda92 expref: 11 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.388077:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518617.388081:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1789518617.388083:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00010000:00010000:0.0:1789518617.388086:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 11 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.388089:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2345:x1876445617304192:12345-192.168.206.51@tcp:3:kworker.0 00010000:00010000:0.0:1789518617.388115:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda92 expref: 11 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.388127:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda92 expref: 11 pid: 36735 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.388139:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627645184:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518617.388230:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518617.391010:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.391105:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627645184:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518617.391137:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 11 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.391158:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0697200, rc 0) 00000100:00100000:0.0:1789518617.391223:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:31677:x1876445617304064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3220us (4982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.391232:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1789518617.391532:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2345:x1876445617304192:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3442us (4015us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518617.391551:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00002000:00100000:0.0:1789518617.391561:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (249856->286719) req@ffff99fec1f88000 x1876445617304192/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518617.391572:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f88000 with x1876445617304192 ext(249856->286719) 00002000:00010000:0.0:1789518617.391577:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f88000 00000100:00100000:3.0:1789518617.392010:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617304320 00000100:00100000:3.0:1789518617.392018:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617304320 00010000:00010000:3.0:1789518617.392047:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda92 expref: 11 pid: 36735 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.392115:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1789518617.392124:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617304320:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518617.392137:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518617.392156:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda92 expref: 11 pid: 36735 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.392180:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda92 expref: 11 pid: 36735 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.392202:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c785d8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda92 expref: 11 pid: 36735 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.392216:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518617.392221:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518617.392229:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 10 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.392240:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 10 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.392287:0:35830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 10 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.392300:0:35830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff738ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35830:1876445627645312:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518617.392363:0:35830:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518617.394853:0:35830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff738ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35830:1876445627645312:192.168.206.51@tcp:105: 00010000:00010000:0.0:1789518617.394876:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518617.394919:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617304320:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2795us (3917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.394929:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1789518617.396293:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.396342:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.396478:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617304448 00000100:00100000:1.0:1789518617.396486:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617304448 00002000:00100000:1.0:1789518617.396538:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (286720->323583) req@ffff99fec28af480 x1876445617304448/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518617.396549:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28af480 with x1876445617304448 ext(286720->323583) 00002000:00010000:1.0:1789518617.396555:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28af480 00000100:00100000:1.0:1789518617.396581:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617304576 00000100:00100000:1.0:1789518617.396585:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617304576 00002000:00100000:1.0:1789518617.396644:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fec28af800 x1876445617304576/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:263/0 lens 4584/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789518617.396653:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28af800 with x1876445617304576 ext(0->4095) 00002000:00010000:1.0:1789518617.396657:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28af800 00000100:00100000:1.0:1789518617.396670:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518617.396679:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617304448:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:1.0:1789518617.400070:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617304448:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 3383us (3774us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789518617.400083:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00002000:00100000:1.0:1789518617.400096:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (286720->323583) req@ffff99fec28af480 x1876445617304448/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1789518617.400108:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28af480 with x1876445617304448 ext(286720->323583) 00002000:00010000:1.0:1789518617.400115:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28af480 00000100:00100000:1.0:1789518617.400156:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:1.0:1789518617.400168:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617304576:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518617.400699:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617304576:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 534us (4356us total) trans 30064771083 rc 0/0 00000100:00100000:1.0:1789518617.400707:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00002000:00100000:1.0:1789518617.400715:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fec28af800 x1876445617304576/t30064771083(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:263/0 lens 4584/448 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789518617.400724:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28af800 with x1876445617304576 ext(0->4095) 00002000:00010000:1.0:1789518617.400729:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28af800 00000100:00100000:3.0:1789518617.404261:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.404675:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.404975:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617304832 00000100:00100000:1.0:1789518617.404989:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617304832 00000100:00100000:1.0:1789518617.405064:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:1.0:1789518617.405075:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31677:x1876445617304832:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789518617.407083:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617304704 00000100:00100000:2.0:1789518617.407099:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617304704 00002000:00100000:3.0:1789518617.407264:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (323584->360447) req@ffff99fff738ad80 x1876445617304704/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.407280:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff738ad80 with x1876445617304704 ext(323584->360447) 00002000:00010000:3.0:1789518617.407289:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff738ad80 00000100:00100000:3.0:1789518617.407336:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:3.0:1789518617.407349:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617304704:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:0.0:1789518617.413934:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617304704:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 6572us (9679us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789518617.413950:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00002000:00100000:0.0:1789518617.413966:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (323584->360447) req@ffff99fff738ad80 x1876445617304704/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1789518617.413994:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff738ad80 with x1876445617304704 ext(323584->360447) 00002000:00010000:0.0:1789518617.414003:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff738ad80 00000100:00100000:2.0:1789518617.418030:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.418092:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617304960 00000100:00100000:3.0:1789518617.418109:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617304960 00002000:00100000:3.0:1789518617.418208:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (360448->397311) req@ffff99fec28ac700 x1876445617304960/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.418223:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28ac700 with x1876445617304960 ext(360448->397311) 00002000:00010000:3.0:1789518617.418231:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28ac700 00000100:00100000:3.0:1789518617.418269:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1789518617.418281:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2342:x1876445617304960:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:3.0:1789518617.420733:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2342:x1876445617304960:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 1979us (2243us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789518617.420765:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00002000:00100000:3.0:1789518617.420782:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc2:0x0] (360448->397311) req@ffff99fec28ac700 x1876445617304960/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/440 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.420794:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28ac700 with x1876445617304960 ext(360448->397311) 00002000:00010000:3.0:1789518617.420815:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec28ac700 00000100:00100000:3.0:1789518617.423648:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.423689:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617305088 00000100:00100000:3.0:1789518617.423702:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617305088 00002000:00100000:3.0:1789518617.423766:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (397312->409599) req@ffff99ffdfee8000 x1876445617305088/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.423781:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfee8000 with x1876445617305088 ext(397312->409599) 00002000:00010000:3.0:1789518617.423789:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfee8000 00000100:00100000:3.0:1789518617.423840:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:3.0:1789518617.423853:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617305088:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:3.0:1789518617.424092:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2343:x1876445617305088:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 241us (497us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1789518617.424102:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00002000:00100000:3.0:1789518617.424111:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (397312->409599) req@ffff99ffdfee8000 x1876445617305088/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/12728 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.424120:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfee8000 with x1876445617305088 ext(397312->409599) 00002000:00010000:3.0:1789518617.424124:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfee8000 00000100:00100000:3.0:1789518617.427590:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.427828:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617305344 00000100:00100000:1.0:1789518617.427842:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617305344 00000100:00100000:1.0:1789518617.427910:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518617.427931:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffe014bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+11:31672:x1876445617305344:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789518617.428844:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffe014bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+12:31672:x1876445617305344:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 908us (1261us total) trans 30064771161 rc 0/0 00000100:00100000:1.0:1789518617.428855:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1789518617.430478:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.430843:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617305600 00000100:00100000:0.0:1789518617.430854:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617305600 00000100:00100000:0.0:1789518617.430908:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:0.0:1789518617.430918:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+12:31672:x1876445617305600:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000001:00080000:0.0:1789518617.431509:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771162 00000100:00100000:0.0:1789518617.431680:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+14:31672:x1876445617305600:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 760us (1207us total) trans 30064771163 rc 0/0 00000100:00100000:0.0:1789518617.431690:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000020:00080000:0.0:1789518617.431696:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789518617.435973:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.436107:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617305856 00000100:00100000:3.0:1789518617.436124:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617305856 00000100:00100000:3.0:1789518617.436198:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518617.436222:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:31672:x1876445617305856:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000004:00080000:3.0:1789518617.437387:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789518617.437587:0:35848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].4, 64 off8496 00010000:00010000:3.0:1789518617.437712:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.437732:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.437746:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.437756:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.437763:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.437770:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.437802:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518617.437856:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518617.437866:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.437875:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518617.437880:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.437891:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.437908:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:1.0:1789518617.437911:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518617.437918:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.437923:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c785d99 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.437938:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518617.437939:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31672:x1876445617305856:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 1726us (1973us total) trans 30064771164 rc 0/0 00010000:00010000:1.0:1789518617.437941:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518617.437945:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518617.437953:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518617.439659:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.439747:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617306112 00000100:00100000:1.0:1789518617.439758:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617306112 00000100:00100000:1.0:1789518617.439801:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518617.439826:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31672:x1876445617306112:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000001:00080000:3.0:1789518617.440018:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771160 is committed 00000020:00080000:3.0:1789518617.440053:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803892 batchid updated 00000004:00080000:3.0:1789518617.440080:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789518617.440093:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803892 00000020:00080000:2.0:1789518617.440110:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803892 00000020:00080000:3.0:1789518617.440111:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffdb5b9f00 refcount 2 committed 0 result 0 batchid 25769803893 00000020:00080000:3.0:1789518617.440115:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeecdf000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc687bc00 00000020:00080000:3.0:1789518617.440118:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeecdfa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec1e86800 00000004:00080000:1.0:1789518617.440292:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1789518617.440319:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:2.0:1789518617.440321:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803893 committed batchid 25769803892 00000100:00100000:0.0:1789518617.440340:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627645440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518617.440398:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518617.440448:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627645440 00000100:00100000:3.0:1789518617.440454:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627645440 00000020:00080000:2.0:1789518617.440467:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803892 00000040:00080000:1.0:1789518617.440492:0:35848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].5, 64 off8560 00000100:00080000:0.0:1789518617.440495:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518617.440512:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789518617.440523:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627645440:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789518617.440560:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.440575:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.440585:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.440645:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.440656:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.440663:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.440684:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789518617.440707:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1789518617.440712:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1789518618 00002000:00010000:3.0:1789518617.440715:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789518617.440718:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1789518617 -> 1789518618 00010000:00010000:0.0:1789518617.440719:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1789518617.440723:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1789518617.440728:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.440738:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518617.440743:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.440754:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.440770:0:35834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00000100:00100000:3.0:1789518617.440778:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627645440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 256us (377us total) trans 30064771084 rc 0/0 00000100:00100000:1.0:1789518617.440783:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:31672:x1876445617306112:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 956us (1166us total) trans 30064771165 rc 0/0 00010000:00010000:0.0:1789518617.440786:0:35834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1789518617.440795:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789518617.440796:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.440799:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00010000:00010000:0.0:1789518617.440808:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785da0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.440824:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518617.440828:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518617.440830:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518617.440876:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:31677:x1876445617304832:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 35802us (36202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.440884:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000004:00080000:2.0:1789518617.440978:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffefff1f80/2, rc 0, transno 30064771084 00000100:00100000:2.0:1789518617.441001:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627645440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518617.442533:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.442678:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617306240 00000100:00100000:2.0:1789518617.442689:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617306240 00000100:00100000:2.0:1789518617.442750:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1789518617.442760:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2343:x1876445617306240:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789518617.459099:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789518617.470680:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771083 is committed 00000001:00080000:0.0:1789518617.470703:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771078 is committed 00000001:00080000:0.0:1789518617.470731:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771084 is committed 00000001:00080000:0.0:1789518617.470738:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771081 is committed 00000100:00100000:2.0:1789518617.471321:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617306240:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 28552us (28786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.471335:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1789518617.474976:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.475094:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617306496 00000100:00100000:0.0:1789518617.475107:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617306496 00000100:00100000:0.0:1789518617.475220:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:0.0:1789518617.475232:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:31677:x1876445617306496:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518617.475306:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518617.475340:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785d84 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda8b expref: 15 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.475364:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518617.475371:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518617.475407:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.475424:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.475436:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518617.475697:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb3391fb reply state 0000000088b0a740 transno 30064771166 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.475708:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518617.475825:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:31677:x1876445617306496:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 594us (870us total) trans 30064771166 rc 0/0 00000100:00100000:0.0:1789518617.475833:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00010000:00010000:2.0:1789518617.477897:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.477917:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.477927:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.477958:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.477964:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.477974:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.477991:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:2.0:1789518617.477995:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.478000:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.478007:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785da7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.478270:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.478782:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617306624 00000100:00100000:0.0:1789518617.478795:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617306624 00000100:00100000:0.0:1789518617.478896:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:0.0:1789518617.478913:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617306624:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789518617.479197:0:36531:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb size from disk: 4096 -> 4096 00002000:00010000:0.0:1789518617.479251:0:36531:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 1789518618 -> 1789518617 00002000:00010000:0.0:1789518617.479253:0:36531:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb atime from disk: 0 -> 1789518617 00002000:00010000:0.0:1789518617.479255:0:36531:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1789518618 -> 1789518617 00002000:00010000:0.0:1789518617.479257:0:36531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789518617.479365:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617306624:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 458us (1098us total) trans 30064771085 rc 0/0 00000100:00100000:0.0:1789518617.479374:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:3.0:1789518617.482172:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.482292:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617306880 00000100:00100000:2.0:1789518617.482308:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617306880 00000100:00100000:2.0:1789518617.482390:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:2.0:1789518617.482401:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:31677:x1876445617306880:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789518617.482771:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.482798:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda7d expref: 15 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.482808:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.482873:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda7d expref: 15 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.482885:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda7d expref: 15 pid: 35846 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.482899:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627645568:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518617.483022:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd0780e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518617.486212:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627645568:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518617.486253:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.486297:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.486370:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617307008 00000100:00100000:2.0:1789518617.486379:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617307008 00010000:00010000:2.0:1789518617.486423:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda7d expref: 16 pid: 35846 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.486855:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1789518617.486869:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617307008:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518617.486887:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518617.486895:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda7d expref: 16 pid: 35846 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.486910:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda7d expref: 16 pid: 35846 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.486956:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c785d68 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda7d expref: 16 pid: 35846 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.486976:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:2.0:1789518617.486982:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.487004:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.487020:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.487055:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518617.487110:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.487120:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617307008:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 254us (823us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518617.487121:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.487135:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00010000:00010000:3.0:1789518617.487166:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.487893:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.487904:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.487911:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.487915:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.487924:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.487942:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:3.0:1789518617.487945:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789518617.487950:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.487957:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785dae lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.488062:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:31677:x1876445617306880:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 5658us (5893us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789518617.488074:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:3.0:1789518617.490272:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.490577:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617307136 00000100:00100000:0.0:1789518617.490695:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617307136 00000100:00100000:0.0:1789518617.490776:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1789518617.490787:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2344:x1876445617307136:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789518617.490846:0:36533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.490890:0:36533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.490899:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518617.490903:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518617.490907:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.490950:0:36533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.490968:0:36533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 7 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.490985:0:36533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627645696:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518617.491092:0:36533:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518617.494034:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.494167:0:36533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627645696:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518617.494189:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617307264 00000100:00100000:3.0:1789518617.494203:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617307264 00010000:00010000:0.0:1789518617.494208:0:36533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.494303:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 8 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.494820:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518617.494955:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617307264:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518617.494972:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518617.494993:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 8 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.495008:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 8 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.495028:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29e97d3/0x631fd8698c785d92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda99 expref: 8 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.495043:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518617.495047:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518617.495053:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.495063:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.495095:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.495162:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617307264:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 278us (1141us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518617.495209:0:36533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.495220:0:36533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.495250:0:36533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.495259:0:36533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.495269:0:36533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.495277:0:36533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518617.495281:0:36533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.495290:0:36533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.495302:0:36533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.495310:0:36533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785db5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.495355:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2344:x1876445617307136:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 4570us (5090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.495372:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:3.0:1789518617.495774:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1789518617.497832:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.497910:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617307520 00000100:00100000:3.0:1789518617.497919:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617307520 00000100:00100000:3.0:1789518617.497969:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:3.0:1789518617.497979:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:31677:x1876445617307520:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518617.498046:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.498073:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.498084:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.498299:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.498310:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda84 expref: 15 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.498318:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.498348:0:35847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda84 expref: 15 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.498360:0:35847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda84 expref: 15 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.498374:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627645824:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518617.498486:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518617.500487:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627645824:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518617.500511:0:35847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.500976:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.501204:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617307648 00000100:00100000:0.0:1789518617.501211:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617307648 00010000:00010000:0.0:1789518617.501242:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda84 expref: 16 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.501325:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:0.0:1789518617.501335:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617307648:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518617.501349:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518617.501355:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda84 expref: 16 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.501366:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda84 expref: 16 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.501384:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785d76 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda84 expref: 16 pid: 35845 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.501398:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518617.501402:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.501410:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.501418:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.501468:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518617.501495:0:35847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.501505:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.501515:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617307648:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 181us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.501523:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000001:00080000:3.0:1789518617.501717:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771167 00000001:00080000:3.0:1789518617.502323:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771168 00000001:00080000:3.0:1789518617.502366:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771169 00000100:00100000:3.0:1789518617.502438:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627645952:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789518617.502483:0:35847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518617.502549:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc638ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518617.502712:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627645952 00000100:00100000:1.0:1789518617.502717:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627645952 00000100:00100000:1.0:1789518617.502904:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789518617.502913:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35847:x1876445627645952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789518617.502991:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35847:x1876445627645952:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.502999:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789518617.503060:0:35847:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771084 gen 2 00000004:00080000:3.0:1789518617.503066:0:35847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771078 committed transno 30064771084 00000004:00080000:3.0:1789518617.503081:0:35847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffefff1f80, transno 30064771084 00000100:00100000:3.0:1789518617.503100:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627645952:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789518617.503519:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771170 00000100:00100000:3.0:1789518617.503570:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627646080:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789518617.503593:0:35847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518617.503610:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518617.503644:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627646080 00000100:00100000:2.0:1789518617.503649:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627646080 00000100:00100000:2.0:1789518617.503769:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789518617.503777:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35847:x1876445627646080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789518617.503933:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35847:x1876445627646080:12345-0@lo:1000:mdt00_002.0 Request processed in 157us (337us total) trans 30064771086 rc 0/0 00000100:00100000:2.0:1789518617.503940:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789518617.504022:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627646080:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789518617.504045:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504055:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504070:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504076:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.504081:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504089:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504101:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:3.0:1789518617.504104:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518617.504109:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504113:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785dc3 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504136:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504140:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504143:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504146:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.504148:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504159:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504164:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:3.0:1789518617.504165:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518617.504171:0:35847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785cce lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda5a expref: 13 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504180:0:35847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785cce lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda5a expref: 13 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504188:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785cce lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda5a expref: 13 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.504331:0:35847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785cce lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda5a expref: 13 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.504410:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627646208:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518617.504541:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518617.507088:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.507123:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627646208:192.168.206.51@tcp:105: 00010000:00010000:3.0:1789518617.507148:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507159:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785cc7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.507178:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617307776 00010000:00010000:3.0:1789518617.507190:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.507197:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617307776 00000100:00100000:0.0:1789518617.507242:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1789518617.507252:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+14:31666:x1876445617307776:12345-192.168.206.51@tcp:49:mmap_sanity.0 00010000:00010000:3.0:1789518617.507315:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507327:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507337:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507343:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507350:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507355:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.507359:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507366:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507376:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:3.0:1789518617.507379:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.507382:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507389:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785dca lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507399:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507412:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507418:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507423:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.507467:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507474:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507483:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:3.0:1789518617.507485:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518617.507489:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.507494:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785dbc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518617.507869:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518617.507874:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518617.507917:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:2.0:1789518617.507927:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518617.508132:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31677:x1876445617307520:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 10153us (10304us total) trans 30064771171 rc 0/0 00000100:00100000:0.0:1789518617.508132:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+14:31666:x1876445617307776:12345-192.168.206.51@tcp:49:mmap_sanity.0 Request processed in 879us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.508141:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:0.0:1789518617.508141:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000020:00080000:3.0:1789518617.508145:0:35847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789518617.510844:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.511242:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617308032 00000100:00100000:2.0:1789518617.511251:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617308032 00000100:00100000:2.0:1789518617.511296:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518617.511305:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:31677:x1876445617308032:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789518617.511608:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789518617.511678:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771172 00010000:00010000:2.0:1789518617.511719:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.511733:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.511744:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.511752:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.511759:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.511765:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.511782:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789518617.511895:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31677:x1876445617308032:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 589us (1057us total) trans 30064771173 rc 0/0 00000100:00100000:2.0:1789518617.511903:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000020:00080000:2.0:1789518617.511907:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789518617.511955:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.512050:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617308160 00000100:00100000:2.0:1789518617.512066:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617308160 00010000:00010000:3.0:1789518617.512076:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518617.512085:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.512094:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc15168b0) 00000100:00100000:2.0:1789518617.512099:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00010000:00010000:3.0:1789518617.512108:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.512109:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:31666:x1876445617308160:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789518617.512124:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.512125:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518617.512139:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:2.0:1789518617.512142:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdaa0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.512143:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518617.512148:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.512165:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785dd1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518617.512175:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 4096, mtime: 0x6aa9e319, atime: 0x6aa9e319, ctime: 0x6aa9e319, blocks: 0xb 00010000:00010000:2.0:1789518617.512193:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=671s v=(0 0) 00010000:00010000:2.0:1789518617.512197:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518617.512211:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.512224:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 7 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.512234:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4800, rc 0) 00000100:00100000:2.0:1789518617.512256:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:31666:x1876445617308160:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 150us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518617.512262:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00010000:00010000:3.0:1789518617.512299:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518617.512301:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518617.512303:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518617.516772:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.516811:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617308288 00000100:00100000:3.0:1789518617.516820:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617308288 00002000:00100000:3.0:1789518617.516945:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fff78a9c00 x1876445617308288/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.516957:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78a9c00 with x1876445617308288 ext(0->4095) 00002000:00010000:3.0:1789518617.516962:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78a9c00 00000100:00100000:3.0:1789518617.516992:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1789518617.517002:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:2342:x1876445617308288:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:3.0:1789518617.517399:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:2342:x1876445617308288:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 398us (635us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789518617.517404:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00002000:00100000:3.0:1789518617.517409:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fff78a9c00 x1876445617308288/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/4536 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.517424:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78a9c00 with x1876445617308288 ext(0->4095) 00002000:00010000:3.0:1789518617.517428:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78a9c00 00000100:00100000:0.0:1789518617.521668:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.521734:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617308416 00000100:00100000:1.0:1789518617.521743:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617308416 00000100:00100000:1.0:1789518617.521792:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:1.0:1789518617.521846:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:31666:x1876445617308416:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518617.521871:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518617.521891:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785ddf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdaa7 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.521946:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785ddf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa7 expref: 21 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.521961:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785ddf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa7 expref: 21 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.521981:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:1.0:1789518617.521998:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518617.522002:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:1.0:1789518617.522110:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:31666:x1876445617308416:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 308us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518617.522118:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:1.0:1789518617.525824:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.525934:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617308544 00000100:00100000:0.0:1789518617.525941:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617308544 00000100:00100000:0.0:1789518617.525982:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:0.0:1789518617.525991:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31666:x1876445617308544:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518617.526006:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.526024:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdaae expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.526058:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.526067:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518617.526071:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518617.526087:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.526118:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.526132:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 6 pid: 37973 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.526147:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627646336:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518617.526262:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518617.528418:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627646336:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518617.528450:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.528469:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:0.0:1789518617.528519:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:31666:x1876445617308544:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 2530us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.528525:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1789518617.532200:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.532301:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617308672 00000100:00100000:3.0:1789518617.532310:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617308672 00002000:00100000:3.0:1789518617.532354:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fec1a1df80 x1876445617308672/t0(0) o4->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 4584/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.532474:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1a1df80 with x1876445617308672 ext(0->4095) 00010000:00010000:3.0:1789518617.532485:0:36537:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 7 pid: 37973 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.532572:0:36537:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 7 pid: 37973 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518617.532592:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99fec1a1df80 00000100:00100000:3.0:1789518617.532668:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1789518617.532678:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:2342:x1876445617308672:12345-192.168.206.51@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1789518617.533072:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:2342:x1876445617308672:12345-192.168.206.51@tcp:4:ldlm_bl.0 Request processed in 394us (878us total) trans 30064771087 rc 0/0 00000100:00100000:3.0:1789518617.533080:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00002000:00100000:3.0:1789518617.533088:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fec1a1df80 x1876445617308672/t30064771087(0) o4->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 4584/448 e 0 to 0 dl 1789518628 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.533098:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1a1df80 with x1876445617308672 ext(0->4095) 00010000:00010000:3.0:1789518617.533105:0:36537:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 9 pid: 37973 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.533129:0:36537:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 9 pid: 37973 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518617.533138:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99fec1a1df80 00000100:00100000:1.0:1789518617.536199:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.536265:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617308800 00000100:00100000:3.0:1789518617.536275:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617308800 00010000:00010000:3.0:1789518617.536311:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 9 pid: 37973 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.536413:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1789518617.536423:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:2342:x1876445617308800:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518617.536438:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789518617.536457:0:35830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 1789518617 -> 1789518618 00002000:00010000:3.0:1789518617.536460:0:35830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1789518617 -> 1789518618 00010000:00010000:3.0:1789518617.536467:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 9 pid: 37973 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.536481:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 9 pid: 37973 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.536503:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af49c6ab/0x631fd8698c785dd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa0 expref: 9 pid: 37973 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.536519:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518617.536537:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518617.536545:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.536556:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.536595:0:35830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518617.536609:0:35830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35830:1876445627646464:192.168.206.51@tcp:105: 00000100:00100000:3.0:1789518617.536745:0:35830:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518617.540403:0:35830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35830:1876445627646464:192.168.206.51@tcp:105: 00010000:00010000:3.0:1789518617.540426:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.540481:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617308800:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 4059us (4288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.540492:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518617.543183:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.543242:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617308928 00000100:00100000:3.0:1789518617.543252:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617308928 00002000:00100000:3.0:1789518617.543294:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fec3475c00 x1876445617308928/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.543305:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3475c00 with x1876445617308928 ext(0->4095) 00002000:00010000:3.0:1789518617.543310:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec3475c00 00000100:00100000:3.0:1789518617.543345:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1789518617.543354:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617308928:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:3.0:1789518617.543902:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617308928:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 548us (724us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789518617.543911:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00002000:00100000:3.0:1789518617.543920:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fec3475c00 x1876445617308928/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:263/0 lens 488/4536 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.543929:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3475c00 with x1876445617308928 ext(0->4095) 00002000:00010000:3.0:1789518617.543938:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec3475c00 00000100:00100000:1.0:1789518617.547459:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.548254:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617309056 00000100:00100000:0.0:1789518617.548264:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617309056 00000100:00100000:0.0:1789518617.548320:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1789518617.548330:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31666:x1876445617309056:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518617.548347:0:36533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.548365:0:36533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c785ded lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdab5 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.548479:0:36533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.548488:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518617.548493:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789518617.548498:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c785ded lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdab5 expref: 9 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.548530:0:36533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.548544:0:36533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 6 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.548558:0:36533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627646592:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518617.548713:0:36533:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518617.550702:0:36533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627646592:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518617.550737:0:36533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c785ded lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdab5 expref: 9 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.550754:0:36533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:0.0:1789518617.550803:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31666:x1876445617309056:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 2473us (3351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.550812:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1789518617.552093:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.552951:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617309184 00000100:00100000:0.0:1789518617.552960:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617309184 00010000:00010000:0.0:1789518617.552997:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 7 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.553038:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1789518617.553048:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617309184:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518617.553062:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518617.553083:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 7 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.553096:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 7 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.553117:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c785de6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaae expref: 7 pid: 36531 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.553132:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789518617.553137:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789518617.553147:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c785ded lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdab5 expref: 8 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.553157:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c785ded lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdab5 expref: 8 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.553191:0:35831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c785ded lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdab5 expref: 8 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.553223:0:35831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627646720:192.168.206.51@tcp:105: 00000100:00100000:0.0:1789518617.553289:0:35831:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffff76ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518617.556434:0:35831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627646720:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518617.556435:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:0.0:1789518617.556460:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.556490:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617309312 00000100:00100000:3.0:1789518617.556498:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617309312 00000100:00100000:0.0:1789518617.556511:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617309184:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3463us (4529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.556521:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00002000:00100000:3.0:1789518617.556539:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fec3476680 x1876445617309312/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1789518617.556552:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3476680 with x1876445617309312 ext(0->4095) 00002000:00010000:3.0:1789518617.556557:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec3476680 00000100:00100000:3.0:1789518617.556582:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:2.0:1789518617.556758:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:2342:x1876445617309312:12345-192.168.206.51@tcp:3:kworker.0 00000100:00100000:2.0:1789518617.556914:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:2342:x1876445617309312:12345-192.168.206.51@tcp:3:kworker.0 Request processed in 250us (486us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789518617.556922:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00002000:00100000:2.0:1789518617.556929:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff99fec3476680 x1876445617309312/t0(0) o3->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/4536 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1789518617.556950:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3476680 with x1876445617309312 ext(0->4095) 00002000:00010000:2.0:1789518617.556954:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec3476680 00000100:00100000:1.0:1789518617.559074:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.559268:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617309568 00000100:00100000:0.0:1789518617.559274:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617309568 00000100:00100000:0.0:1789518617.559313:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1789518617.559318:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+14:31666:x1876445617309568:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000001:00080000:0.0:1789518617.559570:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771174 00000100:00100000:0.0:1789518617.560076:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+16:31666:x1876445617309568:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 751us (1001us total) trans 30064771175 rc 0/0 00000100:00100000:0.0:1789518617.560084:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000020:00080000:0.0:1789518617.560089:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789518617.563756:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.563839:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617309824 00000100:00100000:3.0:1789518617.563847:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617309824 00000100:00100000:3.0:1789518617.563895:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1789518617.563905:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:31666:x1876445617309824:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1789518617.564159:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31666:x1876445617309824:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 254us (479us total) trans 30064771176 rc 0/0 00000100:00100000:3.0:1789518617.564167:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1789518617.566309:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.567715:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617309952 00000100:00100000:0.0:1789518617.567725:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617309952 00000100:00100000:0.0:1789518617.568505:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:0.0:1789518617.568520:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31666:x1876445617309952:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518617.568550:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.568568:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785df4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdabc expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.568682:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.568696:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.568708:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.568723:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.568729:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.568735:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.568949:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785e09 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.568958:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785e09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.568965:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785e09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518617.569061:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1789518617.569065:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518617.569117:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785e09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569140:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785e09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569149:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569155:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569162:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569168:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.569172:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569179:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569190:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518617.569194:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.569198:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569205:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785dfb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569217:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569221:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569229:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569233:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.569234:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569238:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569243:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518617.569244:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.569246:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569250:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e02 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569279:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785df4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdabc expref: 24 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569292:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785e09 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdabc expref: 23 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.569299:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:0.0:1789518617.569300:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518617.569302:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd200, rc 0) 00000100:00100000:0.0:1789518617.569388:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31666:x1876445617309952:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 873us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518617.569405:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:1.0:1789518617.572505:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.572566:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617310208 00000100:00100000:3.0:1789518617.572574:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617310208 00000100:00100000:1.0:1789518617.572705:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:1.0:1789518617.572716:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31666:x1876445617310208:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789518617.572766:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789518617.572789:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c785e09 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdabc expref: 23 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.572813:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785ddf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaa7 expref: 22 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.572823:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:1.0:1789518617.572828:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518617.572890:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.572904:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.572913:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.572926:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.572933:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.572940:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.573314:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.573322:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.573329:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518617.574225:0:37723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].5, 64 off8560 00010000:00010000:1.0:1789518617.574284:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574294:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574312:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574319:0:37723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574324:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574330:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574352:0:37723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518617.574369:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574375:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574381:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574387:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518617.574391:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574397:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574406:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:1.0:1789518617.574408:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789518617.574418:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574424:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785e1e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574440:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574446:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574451:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574456:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518617.574459:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574465:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.574473:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518617.574475:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518617.574477:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.574482:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518617.574483:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785e10 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.574488:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518617.574492:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096e51849 reply state 00000000de4b1db0 transno 30064771177 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.574494:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518617.574498:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.574504:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.574510:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518617.574512:0:35834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:0.0:1789518617.574514:0:35834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789518617.574516:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.574521:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785e25 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.574530:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518617.574531:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518617.574533:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518617.574776:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:31666:x1876445617310208:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 2056us (2269us total) trans 30064771177 rc 0/0 00000100:00100000:1.0:1789518617.574785:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:1.0:1789518617.577495:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518617.577504:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.577537:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.577545:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.577551:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.577555:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.577562:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.577574:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff99ffc13ed000) 00010000:00010000:3.0:1789518617.577577:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.577581:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.577588:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785e17 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.577940:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617310464 00000100:00100000:0.0:1789518617.577948:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617310464 00000100:00100000:0.0:1789518617.578108:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:0.0:1789518617.578120:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:31666:x1876445617310464:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789518617.578139:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518617.578154:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e2c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdac3 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.578310:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.578322:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.578332:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.578344:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.578351:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.578358:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.578983:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c785e41 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579148:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c785e41 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579156:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c785e41 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518617.579165:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789518617.579251:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579258:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579270:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579275:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.579279:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579285:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579293:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518617.579296:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.579299:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579305:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e33 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518617.579318:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1fbeab7 reply state 000000003cee0168 transno 30064771178 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.579326:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518617.579352:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e2c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdac3 expref: 25 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579365:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c785e41 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdac3 expref: 24 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.579371:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:0.0:1789518617.579379:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789518617.579381:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:0.0:1789518617.579447:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31666:x1876445617310464:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1329us (1964us total) trans 30064771178 rc 0/0 00000100:00100000:0.0:1789518617.579454:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 141 00010000:00010000:2.0:1789518617.581728:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.581742:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.581750:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.581756:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.581760:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.581767:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.581780:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff99ffc2d97d00) 00010000:00010000:2.0:1789518617.581783:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.581787:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.581794:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c785e3a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.675281:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.680256:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617310720 00000100:00100000:0.0:1789518617.680282:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617310720 00000100:00100000:1.0:1789518617.680593:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1789518617.680606:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:31666:x1876445617310720:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789518617.681316:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31666:x1876445617310720:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 712us (6043us total) trans 30064771179 rc 0/0 00000100:00100000:1.0:1789518617.681325:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:3.0:1789518617.688536:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.688652:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617310976 00000100:00100000:2.0:1789518617.688661:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617310976 00000100:00100000:2.0:1789518617.688717:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:2.0:1789518617.688728:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:31666:x1876445617310976:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518617.688761:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518617.688779:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785e4f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdaca expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.688879:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785e56 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.688893:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785e56 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.688904:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785e56 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518617.688915:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789518617.689030:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785e4f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaca expref: 28 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.689048:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785e56 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaca expref: 27 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.689055:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:2.0:1789518617.689058:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789518617.689062:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4800, rc 0) 00000100:00100000:2.0:1789518617.689122:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31666:x1876445617310976:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 396us (595us total) trans 30064771180 rc 0/0 00000100:00100000:2.0:1789518617.689130:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:0.0:1789518617.760944:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.761044:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617311232 00000100:00100000:3.0:1789518617.761057:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617311232 00000100:00100000:3.0:1789518617.761128:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518617.761139:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:31666:x1876445617311232:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1789518617.761403:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31666:x1876445617311232:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 265us (470us total) trans 30064771181 rc 0/0 00000100:00100000:3.0:1789518617.761411:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518617.764782:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518617.764896:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617311488 00000100:00100000:0.0:1789518617.764906:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617311488 00000100:00100000:0.0:1789518617.764966:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:0.0:1789518617.764977:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31666:x1876445617311488:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789518617.765065:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518617.765090:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785e56 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaca expref: 28 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765249:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c785e41 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdac3 expref: 27 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765264:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:0.0:1789518617.765276:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518617.765297:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765310:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765320:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765347:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765354:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765513:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765751:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765760:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.765768:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766151:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766160:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766169:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766176:0:35846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766182:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766195:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766325:0:35846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518617.766345:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766352:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766358:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766364:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.766368:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766376:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766385:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518617.766388:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518617.766393:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766399:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c785e72 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766416:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766422:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766435:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766440:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518617.766443:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766449:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766457:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518617.766460:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518617.766462:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518617.766468:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c785e64 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518617.766478:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001138e2cb reply state 00000000829c461e transno 30064771182 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.766487:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518617.766661:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31666:x1876445617311488:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 1685us (1886us total) trans 30064771182 rc 0/0 00000100:00100000:0.0:1789518617.766670:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00010000:00010000:3.0:1789518617.769885:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518617.769900:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.769911:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518617.769919:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.769928:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.769943:0:36743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518617.769946:0:36743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518617.769950:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.769957:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c785e79 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.769978:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518617.769980:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518617.769982:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518617.770510:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518617.770583:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617311744 00000100:00100000:2.0:1789518617.770593:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617311744 00000100:00100000:2.0:1789518617.770672:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:2.0:1789518617.770697:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:31666:x1876445617311744:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789518617.770719:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518617.770735:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785e80 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdad1 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.770838:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.770852:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.770862:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.770878:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.770885:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.770891:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771598:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785e95 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771608:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785e95 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771652:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785e95 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518617.771673:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:2.0:1789518617.771699:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771707:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771714:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771719:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.771723:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771731:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771742:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518617.771745:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.771749:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771755:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785e87 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518617.771768:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f244433f reply state 00000000ad656ffd transno 30064771183 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518617.771776:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518617.771802:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785e80 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdad1 expref: 31 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771828:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785e95 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdad1 expref: 30 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.771836:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:2.0:1789518617.771838:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789518617.771841:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4200, rc 0) 00000100:00100000:2.0:1789518617.771900:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31666:x1876445617311744:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 1205us (1395us total) trans 30064771183 rc 0/0 00000100:00100000:2.0:1789518617.771908:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00010000:00010000:3.0:1789518617.774405:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.774421:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.774429:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.774436:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.774455:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.774472:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.774486:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff99ffc2d97600) 00010000:00010000:3.0:1789518617.774489:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.774493:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.774500:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c785e6b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.775234:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.775245:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.775253:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.775259:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518617.775263:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.775270:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.775279:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff99fec3b12f00) 00010000:00010000:2.0:1789518617.775282:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518617.775285:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518617.775301:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785e8e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518617.854492:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.854579:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617312000 00000100:00100000:3.0:1789518617.854589:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617312000 00000100:00100000:3.0:1789518617.854683:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1789518617.854693:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:31666:x1876445617312000:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1789518617.855144:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31666:x1876445617312000:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 452us (659us total) trans 30064771184 rc 0/0 00000100:00100000:3.0:1789518617.855153:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518617.858916:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.859036:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617312256 00000100:00100000:3.0:1789518617.859045:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617312256 00000100:00100000:3.0:1789518617.859097:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:3.0:1789518617.859106:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31666:x1876445617312256:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789518617.859125:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518617.859144:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785ea3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdad8 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.859248:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785eaa lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.859261:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785eaa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.859271:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785eaa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518617.859281:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:3.0:1789518617.859383:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785ea3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdad8 expref: 33 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.859464:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785eaa lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdad8 expref: 32 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.859473:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:3.0:1789518617.859476:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518617.859479:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:3.0:1789518617.859570:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31666:x1876445617312256:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 465us (661us total) trans 30064771185 rc 0/0 00000100:00100000:3.0:1789518617.859577:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:2.0:1789518617.898844:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.898966:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617312512 00000100:00100000:1.0:1789518617.898978:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617312512 00000100:00100000:1.0:1789518617.899213:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518617.899225:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31666:x1876445617312512:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789518617.899540:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31666:x1876445617312512:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 316us (707us total) trans 30064771186 rc 0/0 00000100:00100000:1.0:1789518617.899548:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:0.0:1789518617.906337:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.906411:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617312768 00000100:00100000:1.0:1789518617.906425:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617312768 00000100:00100000:1.0:1789518617.906548:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:1.0:1789518617.906560:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31666:x1876445617312768:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789518617.906676:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789518617.906729:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c785eaa lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdad8 expref: 33 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.906755:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785e95 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdad1 expref: 32 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.906767:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:1.0:1789518617.906781:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518617.906811:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.906826:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.906837:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.906855:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.906861:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.906867:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.906999:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907008:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907027:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907484:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907495:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907504:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907511:0:37723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907518:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907525:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907554:0:37723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518617.907576:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907583:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907590:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907596:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518617.907608:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907689:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907701:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff99ffc13ed700) 00010000:00010000:1.0:1789518617.907704:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789518617.907708:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907715:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785ec6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907734:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907740:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907747:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907752:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518617.907754:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907760:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907767:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518617.907770:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518617.907780:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.907786:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785eb8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518617.907797:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbf0ec64 reply state 000000008a137ad7 transno 30064771187 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.907807:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518617.907905:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31666:x1876445617312768:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 1345us (1579us total) trans 30064771187 rc 0/0 00000100:00100000:1.0:1789518617.907915:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 146 00010000:00010000:3.0:1789518617.908194:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518617.908202:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.908209:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518617.908213:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.908229:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.908239:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff99ffc13ed700) 00010000:00010000:3.0:1789518617.908241:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518617.908245:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.908251:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785ecd lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.908267:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518617.908269:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518617.908271:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518617.912898:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518617.912899:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.912917:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.912929:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.912936:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518617.912942:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.912951:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.912971:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff99ffc13ed200) 00010000:00010000:3.0:1789518617.912982:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518617.912989:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.912997:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785ebf lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518617.913339:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617313024 00000100:00100000:1.0:1789518617.913351:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617313024 00000100:00100000:1.0:1789518617.913418:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:1.0:1789518617.913431:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31666:x1876445617313024:12345-192.168.206.51@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789518617.913460:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518617.913482:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785ed4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdadf expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.913611:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785edb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.913659:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785edb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.913673:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785edb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518617.913686:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789518617.913867:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785ed4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdadf expref: 35 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.913886:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785edb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdadf expref: 34 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518617.913895:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff99ffc2d97000) 00010000:00010000:1.0:1789518617.913898:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518617.913901:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:1.0:1789518617.913976:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31666:x1876445617313024:12345-192.168.206.51@tcp:101:mmap_sanity.0 Request processed in 548us (1098us total) trans 30064771188 rc 0/0 00000100:00100000:1.0:1789518617.913984:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:3.0:1789518617.916969:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518617.917562:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617313152 00000100:00100000:1.0:1789518617.917575:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617313152 00002000:00100000:1.0:1789518617.917671:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff99ffdfeead80 x1876445617313152/t0(0) o4->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/0 e 0 to 0 dl 1789518628 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789518617.917684:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfeead80 with x1876445617313152 ext(0->409599) 00002000:00010000:1.0:1789518617.917690:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffdfeead80 00000100:00100000:1.0:1789518617.917727:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1789518617.917739:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+6:2342:x1876445617313152:12345-192.168.206.51@tcp:4:mmap_sanity.0 00000100:00100000:1.0:1789518617.928033:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:2342:x1876445617313152:12345-192.168.206.51@tcp:4:mmap_sanity.0 Request processed in 10280us (11062us total) trans 30064771085 rc 0/0 00000100:00100000:1.0:1789518617.928052:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00002000:00100000:1.0:1789518617.928070:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff99ffdfeead80 x1876445617313152/t30064771085(0) o4->4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0@192.168.206.51@tcp:263/0 lens 488/448 e 0 to 0 dl 1789518628 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789518617.928101:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfeead80 with x1876445617313152 ext(0->409599) 00002000:00010000:1.0:1789518617.928110:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffdfeead80 00000100:00100000:0.0:1789518617.930502:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.930566:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617313280 00000100:00100000:3.0:1789518617.930580:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617313280 00000100:00100000:3.0:1789518617.930752:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:3.0:1789518617.930763:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+8:31050:x1876445617313280:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518617.930779:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789518617.930798:0:35830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 1789518613 -> 1789518618 00002000:00010000:3.0:1789518617.930802:0:35830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1789518613 -> 1789518618 00010000:00010000:3.0:1789518617.930826:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cf40d2/0x631fd8698c785cff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda61 expref: 8 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.930864:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.930924:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:31050:x1876445617313280:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 163us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.930934:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1789518617.939502:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518617.939579:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617313408 00000100:00100000:3.0:1789518617.939589:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617313408 00000100:00100000:3.0:1789518617.939695:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1789518617.939705:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+9:31568:x1876445617313408:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518617.939721:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789518617.939757:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ae8672b/0x631fd8698c785d0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda68 expref: 9 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.939803:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a4ca4e/0x631fd8698c785ded lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdab5 expref: 8 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518617.939815:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518617.939857:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:31568:x1876445617313408:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 154us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518617.939864:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00010000:00010000:0.0:1789518618.483410:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518618.927019:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518618.927703:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617313664 00000100:00100000:3.0:1789518618.927712:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617313664 00000100:00100000:3.0:1789518618.927826:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1789518618.927836:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31666:x1876445617313664:12345-192.168.206.51@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1789518618.928141:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31666:x1876445617313664:12345-192.168.206.51@tcp:35:mmap_sanity.0 Request processed in 305us (1132us total) trans 30064771189 rc 0/0 00000100:00100000:3.0:1789518618.928148:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1789518618.931059:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518618.931725:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617313920 00000100:00100000:2.0:1789518618.931735:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617313920 00000100:00100000:2.0:1789518618.931795:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:2.0:1789518618.931805:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31666:x1876445617313920:12345-192.168.206.51@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789518618.931862:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789518618.931891:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785edb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdadf expref: 35 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.931914:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697000/0x631fd8698c7856ae lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8cb expref: 34 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.931925:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff99ffc2d97000) 00010000:00010000:2.0:1789518618.931936:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518618.931957:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.931985:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.931995:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.932010:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.932037:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.932044:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.932143:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.932151:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.932157:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.932998:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933015:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933025:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933034:0:35845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933041:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933048:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933083:0:35845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518618.933102:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933110:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933117:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933124:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518618.933128:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933137:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933147:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff99fec3b12100) 00010000:00010000:2.0:1789518618.933150:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789518618.933154:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933161:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c785ef7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933178:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933184:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933322:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933328:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518618.933332:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933339:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933348:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518618.933351:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518618.933354:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.933360:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c785ee9 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518618.933372:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddacd20f reply state 00000000d80b4772 transno 30064771190 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518618.933386:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518618.933536:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518618.933542:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518618.933548:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518618.933552:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518618.933558:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518618.933567:0:36743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff99fec3b12100) 00010000:00010000:3.0:1789518618.933576:0:36743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518618.933580:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518618.933586:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785efe lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518618.933600:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518618.933602:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518618.933604:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518618.933718:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:31666:x1876445617313920:12345-192.168.206.51@tcp:36:mmap_sanity.0 Request processed in 1911us (2662us total) trans 30064771190 rc 0/0 00000100:00100000:2.0:1789518618.933727:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00010000:00010000:2.0:1789518618.937742:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.937759:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.937788:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.937795:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518618.937800:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.937808:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.937824:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff99fec3b12f00) 00010000:00010000:2.0:1789518618.937827:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518618.937832:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518618.937838:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785ef0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518619.507602:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518619.763432:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627646848:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789518619.763490:0:35868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 673759875157ns, next at 674759872626ns, rc = 0 00000100:00100000:3.0:1789518619.763501:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518619.765746:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627646848 00000100:00100000:2.0:1789518619.765759:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627646848 00000100:00100000:2.0:1789518619.765954:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518619.765966:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627646848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518619.766003:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789518619.766096:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627646848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518619.766104:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789518619.766267:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627646848:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518619.766483:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518620.005688:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518620.005805:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617314048 00000100:00100000:3.0:1789518620.005814:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617314048 00000100:00100000:3.0:1789518620.005956:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1789518620.005967:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31568:x1876445617314048:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518620.005982:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789518620.006006:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697600/0x631fd8698c78561b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8a1 expref: 34 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.006025:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:3.0:1789518620.006035:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697400/0x631fd8698c7856d1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd8d2 expref: 33 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.006045:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:3.0:1789518620.006053:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696800/0x631fd8698c7855f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd89a expref: 32 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.006082:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:3.0:1789518620.006098:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c7855dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd893 expref: 31 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.006107:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffc13edd00) 00010000:00010000:3.0:1789518620.006113:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518620.006169:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31568:x1876445617314048:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 204us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518620.006177:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00080000:0.0:1789518620.006223:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518620.011293:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518620.014282:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617314176 00000100:00100000:2.0:1789518620.014311:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617314176 00000100:00080000:1.0:1789518620.014442:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518620.014853:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1789518620.014865:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+16:31049:x1876445617314176:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518620.014881:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00010000:00010000:2.0:1789518620.014905:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7857e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd90a expref: 16 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518620.014923:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:2.0:1789518620.014939:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0697c00/0x631fd8698c785836 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd91f expref: 15 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518620.014950:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:2.0:1789518620.014960:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c785cce lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfda5a expref: 14 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518620.014969:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518620.014979:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c785b1c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd9f1 expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518620.014988:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff99ffd1b0c400) 00010000:00010000:2.0:1789518620.014999:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785a35 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd99d expref: 12 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518620.015008:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518620.015017:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c785805 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfd911 expref: 11 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518620.015040:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518620.015046:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518620.015144:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:31049:x1876445617314176:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 280us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518620.015152:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1789518620.033135:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518620.033568:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617314304 00000100:00100000:3.0:1789518620.033577:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617314304 00000100:00100000:3.0:1789518620.033784:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:3.0:1789518620.033795:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:31705:x1876445617314304:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1789518620.033821:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518620.033842:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdae6 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.033902:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.033915:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.033926:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518620.033956:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518620.033972:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518620.034010:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.034033:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdae6 expref: 32 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.034050:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdae6 expref: 31 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.034057:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:3.0:1789518620.034059:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518620.034062:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17600, rc 0) 00000100:00100000:3.0:1789518620.034106:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31705:x1876445617314304:12345-192.168.206.51@tcp:101:rm.0 Request processed in 314us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518620.034112:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:0.0:1789518620.038149:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518620.038252:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617314432 00000100:00100000:1.0:1789518620.038262:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617314432 00000100:00100000:1.0:1789518620.038316:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:1.0:1789518620.038324:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:31705:x1876445617314432:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1789518620.038339:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518620.038354:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785f13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdaed expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038412:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038426:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038437:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038450:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038457:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038463:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038883:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785f28 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038893:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785f28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038901:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785f28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518620.038931:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518620.038935:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518620.038954:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785f28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038966:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038973:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038981:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038987:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518620.038991:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.038998:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039010:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:1.0:1789518620.039019:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518620.039025:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039031:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c785f1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039044:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039049:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039056:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039061:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518620.039064:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039070:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039078:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff99ffc13ed300) 00010000:00010000:1.0:1789518620.039081:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518620.039085:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039096:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c785f21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039127:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c785f13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaed expref: 33 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039158:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785f28 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaed expref: 32 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.039165:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:1.0:1789518620.039167:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518620.039170:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:1.0:1789518620.039279:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31705:x1876445617314432:12345-192.168.206.51@tcp:101:rm.0 Request processed in 954us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518620.039291:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:0.0:1789518620.042239:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518620.042339:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617314688 00000100:00100000:1.0:1789518620.042348:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617314688 00000100:00100000:1.0:1789518620.042402:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:1.0:1789518620.042412:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:31705:x1876445617314688:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1789518620.042430:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518620.042448:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785f2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdaf4 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518620.042527:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789518620.042876:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785f2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaf4 expref: 34 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.042891:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:1.0:1789518620.042894:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518620.042898:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c785f2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaf4 expref: 34 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518620.042928:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6400, rc 0) 00000100:00100000:1.0:1789518620.043017:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31705:x1876445617314688:12345-192.168.206.51@tcp:101:rm.0 Request processed in 607us (786us total) trans 30064771191 rc 301/301 00000100:00100000:1.0:1789518620.043024:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:2.0:1789518620.046031:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518620.046155:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617314816 00000100:00100000:1.0:1789518620.046174:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617314816 00000100:00100000:1.0:1789518620.046263:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1789518620.046274:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31705:x1876445617314816:12345-192.168.206.51@tcp:37:rm.0 00000100:00100000:1.0:1789518620.050392:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31705:x1876445617314816:12345-192.168.206.51@tcp:37:rm.0 Request processed in 4102us (4357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518620.050409:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1789518620.054176:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518620.054999:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617315072 00000100:00100000:3.0:1789518620.055012:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617315072 00000100:00100000:3.0:1789518620.055138:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518620.055150:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:31705:x1876445617315072:12345-192.168.206.51@tcp:35:rm.0 00000100:00100000:3.0:1789518620.055472:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31705:x1876445617315072:12345-192.168.206.51@tcp:35:rm.0 Request processed in 324us (1309us total) trans 30064771192 rc 0/0 00000100:00100000:3.0:1789518620.055489:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1789518620.058697:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518620.058974:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617315328 00000100:00100000:3.0:1789518620.058987:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617315328 00000100:00100000:3.0:1789518620.059112:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:3.0:1789518620.059124:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31705:x1876445617315328:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:3.0:1789518620.059359:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789518620.059393:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785f28 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdaed expref: 34 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.059517:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:3.0:1789518620.059544:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdae6 expref: 33 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.059555:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:3.0:1789518620.059564:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518620.059598:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.059712:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.059724:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.059739:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.059746:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.059753:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.060126:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.060147:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.060356:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518620.062095:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789518620.062121:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062132:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062140:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062154:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518620.062355:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062368:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062384:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff99ffeaa78400) 00010000:00010000:3.0:1789518620.062388:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789518620.062394:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062402:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f4b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062507:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062526:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062533:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062539:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518620.062542:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062548:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062558:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:3.0:1789518620.062560:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518620.062564:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.062571:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c785f3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518620.062585:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f866d1c4 reply state 00000000ee7ce0cc transno 30064771193 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518620.062596:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518620.062966:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:31705:x1876445617315328:12345-192.168.206.51@tcp:36:rm.0 Request processed in 3837us (4277us total) trans 30064771193 rc 0/0 00000100:00100000:3.0:1789518620.062977:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 152 00010000:00010000:3.0:1789518620.065740:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.065843:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.065852:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.065858:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518620.065864:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.065872:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.065890:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff99ffeaa78800) 00010000:00010000:3.0:1789518620.065894:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518620.065899:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518620.065905:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f44 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518620.274911:0:35870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674271293787ns, next at 675271290777ns, rc = 0 00000100:00100000:2.0:1789518620.274954:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627647104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518620.275058:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518620.275141:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627647104 00000100:00100000:2.0:1789518620.275150:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627647104 00000100:00100000:2.0:1789518620.275216:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518620.275227:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627647104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518620.275268:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789518620.275315:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627647104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518620.275323:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789518620.275352:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518620.275459:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627647232:0@lo:400:kworker.0 00000100:00100000:0.0:1789518620.275499:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518620.275525:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789518620.275531:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627646976:0@lo:400:kworker.0 00000100:00100000:0.0:1789518620.275559:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518620.275583:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627647616:0@lo:400:kworker.0 00000100:00100000:0.0:1789518620.275643:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518620.275731:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627647488:0@lo:400:kworker.0 00000100:00100000:2.0:1789518620.275764:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627647360:0@lo:400:kworker.0 00000100:00100000:2.0:1789518620.276077:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627647232 00000100:00100000:2.0:1789518620.276083:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627647232 00000100:00100000:2.0:1789518620.276130:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518620.276137:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627647232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518620.276178:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627647232:12345-0@lo:400:kworker.0 Request processed in 41us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518620.276185:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518620.276228:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627646976 00000100:00100000:2.0:1789518620.276232:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627646976 00000100:00100000:2.0:1789518620.276257:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789518620.276279:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627646976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518620.276309:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627646976:12345-0@lo:400:kworker.0 Request processed in 31us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518620.276315:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789518620.276424:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627647232:0@lo:400:kworker.0 00000100:00100000:0.0:1789518620.276444:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627646976:0@lo:400:kworker.0 00000100:00100000:0.0:1789518620.276463:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518620.280766:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627647616 00000100:00100000:2.0:1789518620.280785:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627647616 00000100:00080000:2.0:1789518620.280861:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518620.280917:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627647360 00000100:00100000:2.0:1789518620.280921:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627647360 00000100:00100000:2.0:1789518620.280950:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518620.280971:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627647616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518620.281084:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627647616:12345-0@lo:400:kworker.0 Request processed in 124us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518620.281092:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789518620.281112:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518620.281118:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627647360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518620.281149:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627647360:12345-0@lo:400:kworker.0 Request processed in 31us (4685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518620.281155:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789518620.281259:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627647616:0@lo:400:kworker.0 00000100:00100000:0.0:1789518620.285054:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627647360:0@lo:400:kworker.0 00000100:00100000:0.0:1789518620.285106:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518620.285398:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627647104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518620.285436:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627647488 00000100:00100000:0.0:1789518620.285445:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627647488 00000100:00080000:0.0:1789518620.285480:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518620.285524:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518620.285535:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627647488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518620.285662:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627647488:12345-0@lo:400:kworker.0 Request processed in 129us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518620.285670:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518620.285725:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627647488:0@lo:400:kworker.0 00010000:00010000:0.0:1789518620.530822:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518621.554813:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518621.582124:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518621.582184:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518621.582222:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518621.582248:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518621.582277:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518621.582301:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518621.582327:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518621.582359:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617315840 00000100:00100000:3.0:1789518621.582379:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617315840 00000100:00100000:3.0:1789518621.582454:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617315712 00000100:00100000:3.0:1789518621.582458:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617315712 00000100:00100000:3.0:1789518621.582474:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617316096 00000100:00100000:3.0:1789518621.582476:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617316096 00000100:00100000:3.0:1789518621.582493:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617316224 00000100:00100000:3.0:1789518621.582495:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617316224 00000100:00100000:3.0:1789518621.582515:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1789518621.582527:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2345:x1876445617315840:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518621.582706:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2345:x1876445617315840:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 179us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518621.582716:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518621.582787:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617315456 00000100:00100000:0.0:1789518621.582794:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617315456 00000100:00100000:0.0:1789518621.582846:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:0.0:1789518621.582855:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617315456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518621.582888:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617315456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518621.582895:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:0.0:1789518621.582936:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:0.0:1789518621.582943:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2344:x1876445617315712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518621.582971:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2344:x1876445617315712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518621.582978:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518621.583056:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617315584 00000100:00100000:1.0:1789518621.583061:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617315584 00000100:00100000:1.0:1789518621.583100:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617315968 00000100:00100000:1.0:1789518621.583103:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617315968 00000100:00100000:1.0:1789518621.583138:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1789518621.583147:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2345:x1876445617315584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518621.583186:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2345:x1876445617315584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 41us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518621.583194:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1789518621.583211:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518621.583218:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2344:x1876445617315968:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518621.583252:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+10:2344:x1876445617315968:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518621.583272:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00080000:1.0:1789518621.583324:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518621.583329:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518621.583358:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1789518621.583367:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:2345:x1876445617316096:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518621.583406:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:2345:x1876445617316096:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 40us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518621.583419:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1789518621.583460:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1789518621.583472:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:2344:x1876445617316224:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518621.583504:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+7:2344:x1876445617316224:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518621.583511:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000001:00080000:1.0:1789518622.344653:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771085 is committed 00000001:00080000:1.0:1789518622.344682:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771083 is committed 00000001:00080000:1.0:1789518622.344690:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771084 is committed 00010000:00010000:2.0:1789518622.579702:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789518622.874974:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771085 is committed 00000001:00080000:2.0:1789518622.874989:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771086 is committed 00000001:00080000:2.0:1789518622.874996:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771087 is committed 00000001:00080000:3.0:1789518622.877353:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771182 is committed 00000001:00080000:3.0:1789518622.877366:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771175 is committed 00000001:00080000:3.0:1789518622.877380:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771191 is committed 00000004:00080000:3.0:1789518622.877398:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1789518622.877415:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789518622.877440:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803893 batchid updated 00000001:00080000:3.0:1789518622.877452:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771193 is committed 00000020:00080000:3.0:1789518622.877472:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffd84d6480 refcount 2 committed 0 result 0 batchid 25769803894 00000020:00080000:3.0:1789518622.877477:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeecdf500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd84d6600 00000020:00080000:3.0:1789518622.877480:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeecdf700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec1e86800 00000020:00080000:3.0:1789518622.877512:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803894 committed batchid 25769803893 00000020:00080000:3.0:1789518622.877702:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803893 00000100:00100000:2.0:1789518622.877892:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518622.877909:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627647744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518622.877964:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518622.878186:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627647744 00000100:00100000:0.0:1789518622.878192:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627647744 00000100:00100000:0.0:1789518622.878237:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789518622.878245:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627647744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789518622.878267:0:36531:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:195 count 1 00002000:00010000:0.0:1789518622.878296:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 409600, mtime: 0x6aa9e31a, atime: 0x6aa9e315, ctime: 0x6aa9e31a, blocks: 0x403 00010000:00010000:0.0:1789518622.878303:0:36531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518622.878317:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1789518622.878322:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518622.878328:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518622.878342:0:36531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518622.878352:0:36531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518622.878359:0:36531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518622.878380:0:36531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518622.878946:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627647872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789518622.878977:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518622.878987:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518622.879021:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518622.879027:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627648000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789518622.879049:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518622.879095:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627647872 00000100:00100000:3.0:1789518622.879100:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627647872 00000100:00100000:1.0:1789518622.879105:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627648000 00000100:00100000:1.0:1789518622.879112:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627648000 00000100:00100000:3.0:1789518622.879131:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789518622.879150:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789518622.879159:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627648000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789518622.879175:0:36532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:195 count 1 00000100:00100000:2.0:1789518622.879180:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617316352 00000100:00100000:2.0:1789518622.879186:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617316352 00002000:00010000:1.0:1789518622.879198:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 4096, mtime: 0x6aa9e31a, atime: 0x6aa9e319, ctime: 0x6aa9e31a, blocks: 0xb 00010000:00010000:1.0:1789518622.879206:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518622.879218:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 153 00010000:00010000:1.0:1789518622.879218:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1789518622.879225:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1789518622.879232:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:32128:x1876445617316352:12345-192.168.206.51@tcp:101:lctl.0 00010000:00010000:1.0:1789518622.879234:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.879247:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518622.879263:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785f60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdafb expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518622.879266:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.879316:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785f67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.879326:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.879336:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518622.879351:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518622.879360:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518622.879363:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518622.879370:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00010000:00010000:1.0:1789518622.879383:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00010000:2.0:1789518622.879406:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.879436:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c785f60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdafb expref: 7 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.879451:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785f67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdafb expref: 6 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.879459:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12c00) 00010000:00010000:2.0:1789518622.879462:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518622.879466:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5a00, rc 0) 00000100:00100000:2.0:1789518622.879504:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:32128:x1876445617316352:12345-192.168.206.51@tcp:101:lctl.0 Request processed in 275us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518622.879510:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:3.0:1789518622.879799:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627647872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789518622.879813:0:36735:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:194 count 1 00002000:00010000:3.0:1789518622.879832:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6aa9e318, atime: 0x6aa9e315, ctime: 0x6aa9e318, blocks: 0x403 00010000:00010000:3.0:1789518622.879839:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518622.879848:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789518622.879851:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518622.879854:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518622.879863:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518622.879871:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518622.879888:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518622.879906:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789518622.880117:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789518622.880124:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880132:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518622.880138:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518622.880156:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627648000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 996us (1103us total) trans 30064771088 rc 0/0 00010000:00010000:2.0:1789518622.880162:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518622.880167:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:2.0:1789518622.880183:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518622.880196:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789518622.880204:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880205:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009796cba0/0x631fd8698c785f52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518622.880224:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518622.880230:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880237:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518622.880241:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880243:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880261:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518622.880266:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880267:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880274:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880286:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880293:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c785f6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518622.880305:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518622.880307:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518622.880308:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518622.880583:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627647744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2337us (2617us total) trans 30064771086 rc 0/0 00000100:00100000:0.0:1789518622.880601:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1789518622.880716:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000919be93c/0x631fd8698c785f59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518622.880734:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518622.880737:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518622.880739:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518622.880778:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771086 gen 2 00000004:00080000:1.0:1789518622.880784:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771086 committed transno 30064771086 00000100:00100000:1.0:1789518622.880806:0:3282:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fff79af800 x1876445627648000/t30064771088(30064771088) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518638 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789518622.880817:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff79af800/2, rc 0, transno 30064771088 00000100:00100000:1.0:1789518622.880823:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627648000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789518622.880898:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627647872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1760us (1911us total) trans 30064771089 rc 0/0 00000100:00100000:3.0:1789518622.880905:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000004:00080000:1.0:1789518622.881159:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff79af100/2, rc 0, transno 30064771089 00000100:00080000:0.0:1789518622.881161:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518622.881167:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627647872:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789518622.881169:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518622.881174:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789518622.881189:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518622.881318:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771084 gen 2 00000004:00080000:2.0:1789518622.881323:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771084 committed transno 30064771084 00000100:00100000:2.0:1789518622.881343:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fff4b1fb80 x1876445627647744/t30064771086(30064771086) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518638 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789518622.881352:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff4b1fb80/2, rc 0, transno 30064771086 00000100:00100000:2.0:1789518622.881357:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627647744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789518622.936420:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518622.936492:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617316480 00000100:00100000:1.0:1789518622.936502:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617316480 00000100:00100000:1.0:1789518622.936557:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:1.0:1789518622.936567:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31655:x1876445617316480:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789518622.936696:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31655:x1876445617316480:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 130us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518622.936703:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:3.0:1789518622.940940:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518622.941332:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617316736 00000100:00100000:1.0:1789518622.941342:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617316736 00000100:00100000:1.0:1789518622.941403:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:1.0:1789518622.941427:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:31655:x1876445617316736:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518622.942097:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:31655:x1876445617316736:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 670us (1162us total) trans 30064771194 rc 0/0 00000100:00100000:1.0:1789518622.942207:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00010000:00010000:3.0:1789518623.606044:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518624.029844:0:38190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 5: Mmap 00010000:00010000:1.0:1789518624.626777:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518624.752704:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518624.756256:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617316864 00000100:00100000:2.0:1789518624.756271:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617316864 00000100:00100000:2.0:1789518624.756420:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:2.0:1789518624.756431:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:32398:x1876445617316864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518624.756455:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518624.756474:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785f75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb02 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756538:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756553:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756565:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756579:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756599:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756606:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756874:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785f8a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756884:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785f8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756891:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785f8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518624.756918:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518624.756922:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518624.756938:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785f8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756949:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756956:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756962:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756968:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518624.756972:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.756979:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757003:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12c00) 00010000:00010000:2.0:1789518624.757014:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518624.757020:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757028:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785f7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757039:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757044:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757049:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757055:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518624.757057:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757063:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757076:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99fec3b12700) 00010000:00010000:2.0:1789518624.757079:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518624.757082:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757088:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c785f83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757120:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c785f75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb02 expref: 9 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757281:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4400/0x631fd8698c785f8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb02 expref: 8 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.757291:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:2.0:1789518624.757293:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518624.757295:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4400, rc 0) 00000100:00100000:2.0:1789518624.757350:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:32398:x1876445617316864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 922us (4741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518624.757358:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00080000:0.0:1789518624.758422:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518624.762719:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518624.762845:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617317120 00000100:00100000:3.0:1789518624.762855:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617317120 00000100:00100000:3.0:1789518624.762912:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:3.0:1789518624.762922:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:32398:x1876445617317120:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518624.762940:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518624.762958:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb09 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763142:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763156:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763298:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763330:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763338:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763345:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763660:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c785fa6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763670:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c785fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763677:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c785fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518624.763687:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789518624.763765:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763772:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763780:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763785:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518624.763790:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763806:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763818:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:3.0:1789518624.763820:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518624.763826:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763831:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c785f98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763842:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763848:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763854:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763859:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518624.763862:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763868:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763875:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffeaa78400) 00010000:00010000:3.0:1789518624.763878:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518624.763880:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.763896:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785f9f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.765110:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785f91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb09 expref: 11 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.765143:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17a00/0x631fd8698c785fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb09 expref: 10 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.765152:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:3.0:1789518624.765155:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518624.765166:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17a00, rc 0) 00000100:00100000:3.0:1789518624.765235:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:32398:x1876445617317120:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2314us (2523us total) trans 30064771195 rc 0/0 00000100:00100000:3.0:1789518624.765244:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:3.0:1789518624.767823:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518624.767906:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617317248 00000100:00100000:1.0:1789518624.767915:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617317248 00000100:00100000:1.0:1789518624.767971:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:1.0:1789518624.767981:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:32398:x1876445617317248:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789518624.768091:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:32398:x1876445617317248:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 111us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518624.768098:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:0.0:1789518624.839087:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518624.839297:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617317504 00000100:00100000:1.0:1789518624.839306:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617317504 00000100:00100000:1.0:1789518624.839405:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:1.0:1789518624.839416:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:32412:x1876445617317504:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518624.839437:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518624.839441:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518624.839464:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c785f67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdafb expref: 10 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.839483:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12c00) 00010000:00010000:1.0:1789518624.839494:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518624.839508:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785fb4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb10 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.839843:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.839858:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.839869:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.839883:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.839890:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.839896:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518624.840536:0:35845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc4:0x0], index 0: 0 00010000:00010000:1.0:1789518624.840839:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.840850:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.840857:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.840889:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.840906:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.840912:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.840919:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518624.840923:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.840931:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.840940:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc13ed700) 00010000:00010000:1.0:1789518624.840943:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518624.840948:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.840953:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c785fbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518624.840966:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000052510b2 reply state 00000000ed00e5cf transno 30064771196 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518624.840974:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518624.841004:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c785fb4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb10 expref: 12 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.841028:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb10 expref: 11 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.841047:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc13ed300) 00010000:00010000:1.0:1789518624.841049:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518624.841053:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:1.0:1789518624.841126:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:32412:x1876445617317504:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1711us (2046us total) trans 30064771196 rc 0/0 00000100:00100000:1.0:1789518624.841134:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 158 00010000:00010000:2.0:1789518624.844528:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.844543:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.844548:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.844552:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518624.844555:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.844561:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.844573:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff99ffc13ed000) 00010000:00010000:2.0:1789518624.844575:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518624.844579:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.844630:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c785fc2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518624.845769:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518624.845844:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617317632 00000100:00100000:1.0:1789518624.845852:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617317632 00000100:00100000:1.0:1789518624.845916:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:1.0:1789518624.845926:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2342:x1876445617317632:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518624.845941:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518624.845961:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb17 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518624.845986:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518624.846004:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=678s v=(0 0) 00010000:00010000:1.0:1789518624.846008:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518624.846016:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb17 expref: 6 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.846035:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb17 expref: 6 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.846047:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6400, rc 0) 00000100:00100000:1.0:1789518624.846111:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617317632:12345-192.168.206.51@tcp:101:bash.0 Request processed in 187us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518624.846119:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00080000:0.0:1789518624.846228:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518624.848751:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518624.849141:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617317760 00000100:00100000:2.0:1789518624.849151:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617317760 00000100:00100000:2.0:1789518624.849206:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:2.0:1789518624.849217:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:32412:x1876445617317760:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518624.849232:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518624.849249:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb1e expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.849278:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb17 expref: 7 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.849288:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518624.849292:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518624.849297:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.849325:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb17 expref: 7 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.849338:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb17 expref: 7 pid: 36532 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518624.849352:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:36531:1876445627648128:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518624.849767:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518624.853202:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518624.853293:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617317888 00000100:00100000:0.0:1789518624.853302:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617317888 00010000:00010000:0.0:1789518624.853339:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb17 expref: 8 pid: 36532 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518624.853379:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:0.0:1789518624.853388:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617317888:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518624.853401:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518624.853423:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb17 expref: 8 pid: 36532 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.853442:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb17 expref: 8 pid: 36532 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.853464:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c785fd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb17 expref: 8 pid: 36532 timeout: 778 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518624.853465:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:36531:1876445627648128:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518624.853481:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518624.853486:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518624.853542:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.853560:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.853607:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.853643:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5400, rc 0) 00000100:00100000:2.0:1789518624.853703:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:32412:x1876445617317760:12345-192.168.206.51@tcp:101:bash.0 Request processed in 4488us (4960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518624.853712:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00010000:00010000:0.0:1789518624.853951:0:35830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518624.853965:0:35830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35830:1876445627648256:192.168.206.51@tcp:105: 00000100:00100000:0.0:1789518624.854033:0:35830:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518624.855866:0:35830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35830:1876445627648256:192.168.206.51@tcp:105: 00010000:00010000:0.0:1789518624.855883:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518624.855920:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617317888:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2533us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518624.855929:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1789518624.858835:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518624.859445:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617318144 00000100:00100000:3.0:1789518624.859455:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617318144 00000100:00100000:3.0:1789518624.859519:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1789518624.859529:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:32412:x1876445617318144:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:3.0:1789518624.860635:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:32412:x1876445617318144:12345-192.168.206.51@tcp:35:bash.0 Request processed in 1104us (1805us total) trans 30064771197 rc 0/0 00000100:00100000:3.0:1789518624.860645:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:0.0:1789518624.882861:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627648384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518624.882929:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518624.883288:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627648384 00000100:00100000:3.0:1789518624.883296:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627648384 00000100:00080000:1.0:1789518624.883431:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518624.883472:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789518624.883481:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627648384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518624.883511:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789518624.885783:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627648384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2297us (2847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518624.885795:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518624.886081:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627648384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518624.909751:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518624.909857:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617318272 00000100:00100000:2.0:1789518624.909866:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617318272 00000100:00100000:2.0:1789518624.909923:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:2.0:1789518624.909933:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:32418:x1876445617318272:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518624.909955:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518624.909981:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785fe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb25 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.910043:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785fec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.910057:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.910069:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518624.910108:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518624.910123:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518624.912290:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.912335:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c785fe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb25 expref: 14 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.912356:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785fec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb25 expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.912364:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518624.912367:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518624.912370:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4800, rc 0) 00000100:00100000:2.0:1789518624.912449:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:32418:x1876445617318272:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2516us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518624.912457:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:0.0:1789518624.917867:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518624.918148:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617318528 00000100:00100000:3.0:1789518624.918157:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617318528 00000100:00100000:3.0:1789518624.918214:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:3.0:1789518624.918225:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:32418:x1876445617318528:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518624.918242:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518624.918261:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785ff3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb2c expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.918366:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.918380:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb10 expref: 14 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.918388:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.918418:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb10 expref: 14 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.918437:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb10 expref: 14 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518624.918469:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627648512:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518624.918564:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfffb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518624.924532:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518624.924645:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617318656 00000100:00100000:2.0:1789518624.924653:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617318656 00010000:00010000:2.0:1789518624.924691:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb10 expref: 15 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518624.924738:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1789518624.924747:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617318656:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518624.924760:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518624.924767:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb10 expref: 15 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.924780:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb10 expref: 15 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.924816:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc13ed300) 00010000:00010000:2.0:1789518624.924822:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.924830:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.924837:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.924856:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518624.924921:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617318656:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 174us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518624.924928:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00010000:00010000:3.0:1789518624.925921:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c785fc9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb10 expref: 14 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518624.925946:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627648512:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518624.925973:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.925983:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.925990:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518624.926011:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:3.0:1789518624.926320:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c785ff3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb2c expref: 15 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.926336:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb2c expref: 14 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.926344:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc13ed300) 00010000:00010000:3.0:1789518624.926347:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518624.926349:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17600, rc 0) 00000100:00100000:3.0:1789518624.926403:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:32418:x1876445617318528:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 8180us (8544us total) trans 30064771198 rc 0/0 00000100:00100000:3.0:1789518624.926421:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:0.0:1789518624.929269:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518624.929370:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617318912 00000100:00100000:1.0:1789518624.929380:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617318912 00000100:00100000:1.0:1789518624.929440:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:1.0:1789518624.929449:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:32418:x1876445617318912:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518624.929471:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518624.929474:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518624.929496:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c785ffa lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb2c expref: 14 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.929513:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc13ed300) 00010000:00010000:1.0:1789518624.929523:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518624.929537:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786008 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb33 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.929709:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78600f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.929722:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78600f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.929732:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78600f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518624.929742:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:1.0:1789518624.930011:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786008 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb33 expref: 16 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.930027:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78600f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb33 expref: 15 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.930034:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:1.0:1789518624.930037:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518624.930039:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7000, rc 0) 00000100:00100000:1.0:1789518624.930136:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:32418:x1876445617318912:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 688us (876us total) trans 30064771199 rc 0/0 00000100:00100000:1.0:1789518624.930145:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:0.0:1789518624.936572:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518624.936714:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617319040 00000100:00100000:1.0:1789518624.936724:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617319040 00000100:00100000:1.0:1789518624.936787:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:1.0:1789518624.936798:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:32418:x1876445617319040:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518624.936820:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518624.936839:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb3a expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.936909:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb3a expref: 16 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.936926:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb3a expref: 16 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.936946:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:1.0:1789518624.936962:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518624.936967:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:1.0:1789518624.937029:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:32418:x1876445617319040:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 232us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518624.937036:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:0.0:1789518624.943401:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518624.944085:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617319168 00000100:00100000:3.0:1789518624.944095:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617319168 00000100:00100000:3.0:1789518624.944327:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:3.0:1789518624.944334:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617319168:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:3.0:1789518624.944373:0:37973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.944393:0:37973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.944402:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518624.944406:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518624.944411:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.944663:0:37973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 6 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.944678:0:37973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 6 pid: 36531 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518624.944708:0:37973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:37973:1876445627648640:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518624.944801:0:37973:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4d43180 going to sleep for 11 seconds 00000100:00100000:3.0:1789518624.947543:0:37973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:37973:1876445627648640:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518624.947600:0:37973:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518624.948080:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518624.948321:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617319296 00000100:00100000:3.0:1789518624.948329:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617319296 00002000:00100000:3.0:1789518624.948371:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc4:0x0] (0->15) req@ffff99fec25cf480 x1876445617319296/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:270/0 lens 504/0 e 0 to 0 dl 1789518635 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518624.948381:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cf480 with x1876445617319296 ext(0->15) 00010000:00010000:3.0:1789518624.948388:0:36539:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 7 pid: 36531 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.948403:0:36539:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 7 pid: 36531 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518624.948410:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99fec25cf480 00000100:00100000:3.0:1789518624.948503:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1789518624.948513:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617319296:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:3.0:1789518624.948995:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617319296:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 483us (915us total) trans 30064771087 rc 0/0 00000100:00100000:3.0:1789518624.949004:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00002000:00100000:3.0:1789518624.949011:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc4:0x0] (0->15) req@ffff99fec25cf480 x1876445617319296/t30064771087(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:270/0 lens 504/448 e 0 to 0 dl 1789518635 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518624.949020:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cf480 with x1876445617319296 ext(0->15) 00010000:00010000:3.0:1789518624.949025:0:36539:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 9 pid: 36531 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.949048:0:36539:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 9 pid: 36531 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518624.949056:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99fec25cf480 00000100:00100000:0.0:1789518624.951133:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518624.951271:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617319424 00000100:00100000:3.0:1789518624.951280:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617319424 00010000:00010000:3.0:1789518624.951314:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 9 pid: 36531 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518624.951357:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:3.0:1789518624.951367:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617319424:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518624.951380:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789518624.951396:0:35830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb size from disk: 0 -> 16 00002000:00010000:3.0:1789518624.951399:0:35830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb mtime from disk: 0 -> 1789518625 00002000:00010000:3.0:1789518624.951402:0:35830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb atime from disk: 0 -> 1789518625 00002000:00010000:3.0:1789518624.951404:0:35830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb ctime from disk: 0 -> 1789518625 00010000:00010000:3.0:1789518624.951410:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 9 pid: 36531 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.951423:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 9 pid: 36531 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.951444:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029ee7d40/0x631fd8698c785fde lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb1e expref: 9 pid: 36531 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.951477:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518624.951482:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518624.951487:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.951497:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.951694:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518624.951754:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617319424:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 388us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518624.951763:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00010000:00010000:0.0:1789518624.952461:0:37973:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.952473:0:37973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.952498:0:37973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.952507:0:37973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.952515:0:37973:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.952521:0:37973:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518624.952526:0:37973:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.952534:0:37973:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.952547:0:37973:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518624.952554:0:37973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c786024 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518624.953056:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617319168:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 8717us (9659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518624.953066:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:0.0:1789518624.958070:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518624.958129:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617319680 00000100:00100000:1.0:1789518624.958265:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617319680 00000100:00100000:1.0:1789518624.958312:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518624.958326:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:32418:x1876445617319680:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:1.0:1789518624.958381:0:35849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x10:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78600f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb33 expref: 16 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518624.958742:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771200 00000001:00080000:1.0:1789518624.958792:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771201 00000001:00080000:1.0:1789518624.959400:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771202 00010000:00010000:1.0:1789518624.959457:0:35849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.959473:0:35849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb3a expref: 20 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.959481:0:35849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.959607:0:35849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb3a expref: 20 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518624.959703:0:35849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb3a expref: 20 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518624.959729:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3474380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35849:1876445627648768:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518624.959936:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc67cb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518624.964361:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518624.965730:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617319808 00000100:00100000:2.0:1789518624.965742:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617319808 00010000:00010000:2.0:1789518624.965788:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb3a expref: 21 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518624.965883:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1789518624.965894:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617319808:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518624.965909:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518624.965916:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb3a expref: 21 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.965930:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb3a expref: 21 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.965970:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:2.0:1789518624.965975:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.965985:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.965992:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.966010:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518624.966070:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617319808:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 177us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518624.966077:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00010000:00010000:3.0:1789518624.966961:0:35849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78601d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb3a expref: 20 pid: 35845 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518624.966980:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3474380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35849:1876445627648768:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518624.967001:0:35849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.967010:0:35849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.967016:0:35849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518624.967201:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771203 00000001:00080000:3.0:1789518624.967396:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771204 00000100:00100000:3.0:1789518624.967576:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627648896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518624.967743:0:35849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518624.967940:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd807a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518624.967979:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627648896 00000100:00100000:1.0:1789518624.967985:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627648896 00000100:00100000:1.0:1789518624.968069:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789518624.968078:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35849:x1876445627648896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789518624.968159:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35849:x1876445627648896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518624.968166:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789518624.968217:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627648896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789518624.968653:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771205 00000100:00100000:3.0:1789518624.968707:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda69500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627649024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518624.968747:0:35849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518624.970979:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd807a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518624.971013:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627649024 00000100:00100000:2.0:1789518624.971022:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627649024 00000100:00100000:2.0:1789518624.971063:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789518624.971071:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35849:x1876445627649024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518624.971346:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:35849:x1876445627649024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 275us (2597us total) trans 30064771088 rc 0/0 00000100:00100000:2.0:1789518624.971354:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789518624.971434:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda69500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627649024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789518624.971494:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771206 00010000:00010000:3.0:1789518624.971689:0:35849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.971699:0:35849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.971706:0:35849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.971711:0:35849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518624.971715:0:35849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.971722:0:35849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.971736:0:35849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:3.0:1789518624.971739:0:35849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789518624.971756:0:35849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518624.971762:0:35849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78602b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518624.972312:0:35849:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x11:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789518624.972411:0:35849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].6, 64 off8624 00000004:00080000:3.0:1789518624.972422:0:35849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678968807411ns, next at 679968805353ns, rc = 0 00000001:00080000:3.0:1789518624.972429:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771207 00010000:00010000:3.0:1789518624.972463:0:35849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:3.0:1789518624.972467:0:35849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518624.972473:0:35849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78600f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb33 expref: 24 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518624.972763:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:32418:x1876445617319680:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 14437us (14698us total) trans 30064771208 rc 0/0 00000100:00100000:3.0:1789518624.972772:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000020:00080000:3.0:1789518624.972777:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518624.979112:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518624.979260:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617319936 00000100:00100000:2.0:1789518624.979270:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617319936 00000100:00100000:2.0:1789518624.979359:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:2.0:1789518624.979370:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:32418:x1876445617319936:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518624.979398:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518624.979420:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786032 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb41 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.979546:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786032 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb41 expref: 24 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.979561:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786032 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb41 expref: 24 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518624.979591:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:2.0:1789518624.979595:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518624.979599:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4200, rc 0) 00000100:00100000:2.0:1789518624.980062:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:32418:x1876445617319936:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 692us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518624.980069:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:2.0:1789518624.982774:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518624.982947:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617320192 00000100:00100000:3.0:1789518624.982956:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617320192 00000100:00100000:3.0:1789518624.983071:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:3.0:1789518624.983082:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:32418:x1876445617320192:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518624.983307:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:32418:x1876445617320192:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 227us (540us total) trans 30064771209 rc 0/0 00000100:00100000:3.0:1789518624.983315:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518625.047114:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.047406:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617320320 00000100:00100000:1.0:1789518625.047415:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617320320 00000100:00100000:1.0:1789518625.047515:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:1.0:1789518625.047527:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:32428:x1876445617320320:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1789518625.048108:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048126:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048239:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048258:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048282:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048289:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048373:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048383:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048390:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518625.048436:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048448:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048455:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048462:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048468:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518625.048472:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048480:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048499:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:1.0:1789518625.048502:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518625.048507:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048514:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048528:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048535:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048541:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048547:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518625.048550:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048557:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048565:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff99ffc6733a00) 00010000:00010000:1.0:1789518625.048567:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518625.048570:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048575:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786040 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048705:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048713:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048720:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048725:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518625.048728:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048735:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048743:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:1.0:1789518625.048746:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518625.048750:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.048755:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786047 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518625.048831:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:32428:x1876445617320320:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1306us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.048840:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:0.0:1789518625.074754:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.074890:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617320448 00000100:00100000:1.0:1789518625.074904:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617320448 00000100:00100000:1.0:1789518625.075073:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:1.0:1789518625.075101:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:32429:x1876445617320448:12345-192.168.206.51@tcp:101:mmap_cat.0 00010000:00010000:1.0:1789518625.075126:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518625.075161:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78604e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb48 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075236:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075252:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075264:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075280:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075288:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075296:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075400:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786063 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075408:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786063 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075415:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786063 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518625.075466:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:1.0:1789518625.075471:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518625.075527:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786063 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075541:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786063 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075549:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075556:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075564:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075570:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518625.075574:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075593:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075606:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:1.0:1789518625.075609:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518625.075655:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075662:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786055 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075687:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075692:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075698:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075703:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518625.075705:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075712:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075719:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff99ffc6733a00) 00010000:00010000:1.0:1789518625.075721:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518625.075724:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075729:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78605c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075762:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78604e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb48 expref: 27 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075777:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786063 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb48 expref: 26 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.075794:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:1.0:1789518625.075797:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518625.075799:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:1.0:1789518625.075860:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:32429:x1876445617320448:12345-192.168.206.51@tcp:101:mmap_cat.0 Request processed in 762us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.075867:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:0.0:1789518625.078316:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.078570:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617320704 00000100:00100000:1.0:1789518625.078594:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617320704 00000100:00100000:0.0:1789518625.078919:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:0.0:1789518625.078932:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:32429:x1876445617320704:12345-192.168.206.51@tcp:101:mmap_cat.0 00010000:00010000:0.0:1789518625.078958:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518625.078984:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78606a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb4f expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.079104:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786071 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.079122:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786071 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.079137:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786071 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518625.079150:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1789518625.079326:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78606a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb4f expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.079349:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786071 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb4f expref: 28 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.079359:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:0.0:1789518625.079362:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789518625.079366:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:0.0:1789518625.079449:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:32429:x1876445617320704:12345-192.168.206.51@tcp:101:mmap_cat.0 Request processed in 519us (1143us total) trans 30064771210 rc 0/0 00000100:00100000:0.0:1789518625.079457:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:0.0:1789518625.092053:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.092591:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617321088 00000100:00100000:1.0:1789518625.092607:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617321088 00000100:00100000:1.0:1789518625.092738:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1789518625.092752:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:32430:x1876445617321088:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518625.093076:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:32430:x1876445617321088:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 326us (1029us total) trans 30064771211 rc 0/0 00000100:00100000:1.0:1789518625.093084:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1789518625.095495:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518625.095697:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617321216 00000100:00100000:3.0:1789518625.095706:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617321216 00000100:00100000:3.0:1789518625.095770:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1789518625.095794:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:32430:x1876445617321216:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:3.0:1789518625.095811:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789518625.095834:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786063 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb48 expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.095855:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786071 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb4f expref: 28 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.095868:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786032 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb41 expref: 27 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.095877:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:3.0:1789518625.095886:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518625.095936:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:32430:x1876445617321216:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 144us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518625.095943:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1789518625.098598:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518625.098728:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617321344 00000100:00100000:2.0:1789518625.098734:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617321344 00000100:00100000:2.0:1789518625.098793:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:2.0:1789518625.098800:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:32430:x1876445617321344:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:2.0:1789518625.098875:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.098887:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.098895:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518625.099129:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].5, 136 off8872 00000100:00100000:2.0:1789518625.099193:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:32430:x1876445617321344:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 394us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518625.099199:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:0.0:1789518625.118441:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.118530:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617321472 00000100:00100000:1.0:1789518625.118540:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617321472 00000100:00100000:1.0:1789518625.118662:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:1.0:1789518625.118672:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:32432:x1876445617321472:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518625.118691:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518625.118710:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb56 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118763:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118792:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118802:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118817:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118824:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118831:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118916:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118925:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118932:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518625.118966:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:1.0:1789518625.118969:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518625.118985:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.118996:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119015:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119021:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119028:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119034:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518625.119038:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119046:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119058:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:1.0:1789518625.119061:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518625.119065:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119071:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78608d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119083:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119089:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119094:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119105:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518625.119108:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119114:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119122:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff99ffc6733a00) 00010000:00010000:1.0:1789518625.119124:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518625.119127:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119133:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119161:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c786086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb56 expref: 28 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119714:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb56 expref: 27 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.119722:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:1.0:1789518625.119725:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518625.119727:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:1.0:1789518625.120019:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:32432:x1876445617321472:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1347us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.120027:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:0.0:1789518625.395103:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627649152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518625.395254:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518625.396360:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627649152 00000100:00100000:0.0:1789518625.396373:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627649152 00000100:00100000:0.0:1789518625.396441:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789518625.396454:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627649152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518625.396512:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789518625.396630:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627649152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.396638:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789518625.396837:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518625.396860:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627649280:0@lo:400:kworker.0 00000100:00100000:1.0:1789518625.396905:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518625.396933:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627649792:0@lo:400:kworker.0 00000100:00100000:1.0:1789518625.396959:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518625.396986:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518625.396992:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627649408:0@lo:400:kworker.0 00000100:00100000:1.0:1789518625.397017:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518625.397045:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627649536:0@lo:400:kworker.0 00000100:00100000:1.0:1789518625.397068:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518625.397962:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627649664:0@lo:400:kworker.0 00000100:00100000:0.0:1789518625.398076:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627649280 00000100:00100000:0.0:1789518625.398083:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627649280 00000100:00100000:0.0:1789518625.398162:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789518625.398171:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627649280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518625.398248:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627649280:12345-0@lo:400:kworker.0 Request processed in 79us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.398256:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789518625.398314:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627649408 00000100:00100000:0.0:1789518625.398319:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627649408 00000100:00100000:0.0:1789518625.398348:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518625.398354:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627649408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518625.398397:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627649408:12345-0@lo:400:kworker.0 Request processed in 42us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.398404:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518625.398462:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627649408:0@lo:400:kworker.0 00000100:00100000:0.0:1789518625.398476:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627649280:0@lo:400:kworker.0 00000100:00100000:1.0:1789518625.401860:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518625.403401:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627649152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518625.403531:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627649664 00000100:00100000:1.0:1789518625.403541:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627649664 00000100:00100000:1.0:1789518625.403640:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789518625.403652:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627649664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518625.403744:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627649664:12345-0@lo:400:kworker.0 Request processed in 95us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.403752:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789518625.403778:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518625.403803:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627649664:0@lo:400:kworker.0 00000100:00100000:3.0:1789518625.406640:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627649792 00000100:00100000:3.0:1789518625.406660:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627649792 00000100:00100000:3.0:1789518625.406934:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518625.406948:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627649792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518625.407080:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627649792:12345-0@lo:400:kworker.0 Request processed in 135us (10118us total) trans 0 rc 0/0 00000100:00080000:2.0:1789518625.407151:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518625.407194:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789518625.407486:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627649536 00000100:00100000:0.0:1789518625.407493:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627649536 00000100:00100000:0.0:1789518625.407540:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627649792:0@lo:400:kworker.0 00000100:00100000:0.0:1789518625.407823:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518625.407832:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627649536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518625.407887:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627649536:12345-0@lo:400:kworker.0 Request processed in 57us (10818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.407893:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518625.407928:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627649536:0@lo:400:kworker.0 00000040:00080000:1.0:1789518625.617347:0:38240:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518625.617354:0:38240:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518625.617410:0:38240:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:1.0:1789518625.617416:0:38240:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789518625.651827:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518625.714940:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518625.714947:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518625.714981:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:0.0:1789518625.714987:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518625.715125:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25cf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627649920:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518625.715221:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789518625.719515:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25cf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627649920:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518625.719515:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518625.719862:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617321600 00000100:00100000:3.0:1789518625.719869:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617321600 00000100:00100000:3.0:1789518625.719923:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:3.0:1789518625.719940:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:32444:x1876445617321600:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518625.719978:0:37723:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518625.720064:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:32444:x1876445617321600:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 130us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518625.720072:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:3.0:1789518625.722739:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.723349:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617321728 00000100:00100000:0.0:1789518625.723362:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617321728 00000100:00100000:0.0:1789518625.723433:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:0.0:1789518625.723444:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:32444:x1876445617321728:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789518625.723507:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723524:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723535:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723550:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723557:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723563:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723602:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723631:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723646:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518625.723680:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:0.0:1789518625.723685:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518625.723696:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723706:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723717:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723724:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723730:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518625.723734:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723742:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723753:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:0.0:1789518625.723756:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518625.723760:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723766:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723783:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723789:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723795:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723800:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518625.723803:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723808:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723816:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x743283ca (ffff99ffc2d97900) 00010000:00010000:0.0:1789518625.723818:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518625.723821:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723827:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723844:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723850:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723855:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723861:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518625.723864:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723870:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723877:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:0.0:1789518625.723879:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518625.723882:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.723888:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7860b0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.723971:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:32444:x1876445617321728:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 529us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.723979:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:0.0:1789518625.728552:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.728682:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617321984 00000100:00100000:1.0:1789518625.728692:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617321984 00000100:00100000:1.0:1789518625.728760:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:1.0:1789518625.728770:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:32444:x1876445617321984:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518625.728789:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518625.728810:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7860b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb5d expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.728897:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.728912:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.728923:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518625.728933:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:1.0:1789518625.729015:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.729023:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.729030:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.729036:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518625.729040:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.729046:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.729200:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:1.0:1789518625.729203:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518625.729208:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.729215:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860be lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.729256:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7860b7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb5d expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.729266:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518625.729269:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518625.729272:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7860b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb5d expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.729282:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6400, rc 0) 00000100:00100000:1.0:1789518625.729342:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:32444:x1876445617321984:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 573us (799us total) trans 30064771212 rc 301/301 00000100:00100000:1.0:1789518625.729350:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:1.0:1789518625.732343:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518625.732543:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617322112 00000100:00100000:2.0:1789518625.732553:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617322112 00000100:00100000:2.0:1789518625.732632:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:2.0:1789518625.732643:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:32444:x1876445617322112:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518625.732673:0:35847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518625.732757:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:32444:x1876445617322112:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 116us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518625.732765:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:3.0:1789518625.735565:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.735871:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617322368 00000100:00100000:0.0:1789518625.735881:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617322368 00000100:00100000:0.0:1789518625.735974:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:0.0:1789518625.735984:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:32444:x1876445617322368:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518625.736003:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518625.736006:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518625.736029:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c785fec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb25 expref: 28 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.736050:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:0.0:1789518625.736060:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518625.736074:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb64 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518625.736455:0:37723:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc4:0x0], index 1: 0 00010000:00010000:0.0:1789518625.736666:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860d3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.736680:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.736690:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.736741:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7860cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb64 expref: 30 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.736773:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860d3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb64 expref: 29 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.736780:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:0.0:1789518625.736783:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518625.736786:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd200, rc 0) 00000100:00100000:0.0:1789518625.736851:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:32444:x1876445617322368:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 867us (1292us total) trans 30064771213 rc 0/0 00000100:00100000:0.0:1789518625.736859:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:0.0:1789518625.738780:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.738882:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617322496 00000100:00100000:1.0:1789518625.738891:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617322496 00000100:00100000:1.0:1789518625.738947:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:1.0:1789518625.738957:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:32444:x1876445617322496:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518625.738977:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518625.738996:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7860e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb6b expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.739069:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.739081:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.739092:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518625.739121:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518625.739125:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518625.739140:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.739161:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7860e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb6b expref: 31 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.739178:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb6b expref: 30 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.739186:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:1.0:1789518625.739189:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518625.739192:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:1.0:1789518625.739278:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:32444:x1876445617322496:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 322us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.739285:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:2.0:1789518625.742012:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.742095:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617322752 00000100:00100000:1.0:1789518625.742104:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617322752 00000100:00100000:0.0:1789518625.742240:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:0.0:1789518625.742252:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:32444:x1876445617322752:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518625.742298:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518625.742322:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c7860d3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb64 expref: 30 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742342:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc2d97300) 00010000:00010000:0.0:1789518625.742357:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7860e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb6b expref: 29 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742366:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:0.0:1789518625.742372:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518625.742392:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742403:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742412:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742423:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742429:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742435:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742655:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742664:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742670:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742676:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518625.742681:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742688:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742696:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518625.742699:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518625.742703:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742709:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7860ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742721:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742727:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742733:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742738:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518625.742741:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742747:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742754:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x33f68ac0 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518625.742757:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518625.742760:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.742765:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7860f6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x33f68ac0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.742841:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:32444:x1876445617322752:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 591us (836us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518625.742848:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:3.0:1789518625.744468:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.744608:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617322880 00000100:00100000:1.0:1789518625.744645:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617322880 00000100:00100000:1.0:1789518625.744696:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:1.0:1789518625.744715:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:32444:x1876445617322880:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518625.744732:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518625.744760:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7860fd lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb72 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.744790:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.744802:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.744811:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.744887:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7860fd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb72 expref: 30 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.744900:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb72 expref: 29 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.744905:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518625.744907:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518625.744909:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:1.0:1789518625.744950:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:32444:x1876445617322880:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 247us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.744957:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:2.0:1789518625.746512:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.746556:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617323136 00000100:00100000:1.0:1789518625.746564:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617323136 00000100:00100000:1.0:1789518625.746649:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 177 00000100:00100000:1.0:1789518625.746659:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:32444:x1876445617323136:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518625.746738:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.747001:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.747014:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518625.747388:0:35846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].6, 88 off8648 00000004:00080000:1.0:1789518625.747398:0:35846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679743783746ns, next at 680743781551ns, rc = 0 00000004:00010000:1.0:1789518625.747484:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fdbc6ab reply state 00000000669cb15f transno 30064771214 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518625.747490:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518625.747572:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:32444:x1876445617323136:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 914us (1066us total) trans 30064771214 rc 0/0 00000100:00100000:1.0:1789518625.747591:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 177 00000100:00100000:2.0:1789518625.750816:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.750925:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617323264 00000100:00100000:0.0:1789518625.751016:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617323264 00010000:00010000:3.0:1789518625.751027:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.751038:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.751046:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.751052:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518625.751057:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.751066:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.751067:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:0.0:1789518625.751082:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:32444:x1876445617323264:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518625.751087:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518625.751091:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518625.751096:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.751102:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c78610b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.751104:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518625.751122:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb79 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.751175:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb79 expref: 31 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.751194:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb79 expref: 31 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.751211:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:0.0:1789518625.751214:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518625.751217:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:0.0:1789518625.751374:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:32444:x1876445617323264:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 293us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.751382:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:3.0:1789518625.754993:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518625.755038:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617323392 00000100:00100000:2.0:1789518625.755046:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617323392 00000100:00100000:2.0:1789518625.755113:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:2.0:1789518625.755124:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2343:x1876445617323392:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789518625.755565:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617323392:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 443us (578us total) trans 30064771090 rc 0/0 00000100:00100000:2.0:1789518625.755571:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00080000:1.0:1789518625.755638:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518625.758703:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518625.758803:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617323648 00000100:00100000:3.0:1789518625.758813:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617323648 00000100:00100000:3.0:1789518625.758869:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1789518625.758879:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:32444:x1876445617323648:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518625.759092:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:32444:x1876445617323648:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 214us (397us total) trans 30064771215 rc 0/0 00000100:00100000:3.0:1789518625.759099:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1789518625.762205:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.762305:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617323904 00000100:00100000:0.0:1789518625.762315:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617323904 00000100:00100000:0.0:1789518625.762373:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:0.0:1789518625.762382:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:32444:x1876445617323904:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518625.762543:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:32444:x1876445617323904:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 160us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.762551:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:0.0:1789518625.765256:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.765433:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617324032 00000100:00100000:1.0:1789518625.765442:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617324032 00000100:00100000:1.0:1789518625.765487:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:1.0:1789518625.765497:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:32444:x1876445617324032:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518625.765514:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518625.765533:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786119 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb80 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.765654:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786120 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.765668:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786120 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.765679:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786120 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518625.765710:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518625.765727:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786120 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.765751:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786119 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb80 expref: 34 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.765768:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786120 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb80 expref: 33 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.765775:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518625.765783:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518625.765787:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6400, rc 0) 00000100:00100000:1.0:1789518625.765848:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:32444:x1876445617324032:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 353us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.765855:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:2.0:1789518625.768870:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.769022:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617324160 00000100:00100000:0.0:1789518625.769030:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617324160 00000100:00100000:0.0:1789518625.769087:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:0.0:1789518625.769096:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617324160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518625.769112:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518625.769132:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb87 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518625.769176:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e322, blocks: 0x1 00010000:00010000:0.0:1789518625.769195:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=679s v=(0 0) 00010000:00010000:0.0:1789518625.769209:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518625.769219:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb87 expref: 7 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.769238:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb87 expref: 7 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.769251:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:0.0:1789518625.769370:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617324160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 275us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.769378:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:3.0:1789518625.771683:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.771787:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617324416 00000100:00100000:0.0:1789518625.771796:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617324416 00000100:00100000:0.0:1789518625.771850:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:0.0:1789518625.771859:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:32444:x1876445617324416:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518625.772050:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:32444:x1876445617324416:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 191us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.772057:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:3.0:1789518625.774687:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.774784:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617324544 00000100:00100000:0.0:1789518625.774792:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617324544 00000100:00100000:0.0:1789518625.774843:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1789518625.774853:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:32444:x1876445617324544:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518625.774869:0:36735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518625.774887:0:36735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb8e expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.774916:0:36735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb87 expref: 8 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.774924:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518625.774929:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518625.774934:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 8 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.774964:0:36735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb87 expref: 8 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.774979:0:36735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb87 expref: 8 pid: 37973 timeout: 779 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.774998:0:36735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36735:1876445627650048:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518625.775103:0:36735:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518625.778609:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518625.778986:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617324672 00000100:00100000:2.0:1789518625.778994:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617324672 00010000:00010000:2.0:1789518625.779030:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb87 expref: 9 pid: 37973 timeout: 779 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.779033:0:36735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36735:1876445627650048:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518625.779064:0:36735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 9 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518625.779079:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00010000:00010000:0.0:1789518625.779079:0:36735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd200, rc 0) 00000100:00100000:2.0:1789518625.779088:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617324672:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518625.779101:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518625.779121:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb87 expref: 9 pid: 37973 timeout: 779 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.779133:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb87 expref: 9 pid: 37973 timeout: 779 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.779136:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:32444:x1876445617324544:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 4285us (4456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518625.779143:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00010000:00010000:2.0:1789518625.779153:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009796cba0/0x631fd8698c786127 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb87 expref: 9 pid: 37973 timeout: 779 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.779168:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518625.779172:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518625.779180:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 7 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.779190:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 7 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.779259:0:35831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 7 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518625.779272:0:35831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627650176:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518625.779322:0:35831:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc924c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518625.782700:0:35831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627650176:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518625.782725:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518625.782822:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617324672:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3733us (4220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.782833:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1789518625.783397:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518625.783988:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617324800 00000100:00100000:2.0:1789518625.783996:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617324800 00002000:00100000:2.0:1789518625.784038:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc4:0x0] (0->15) req@ffff99fec3474000 x1876445617324800/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:271/0 lens 504/0 e 0 to 0 dl 1789518636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518625.784048:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3474000 with x1876445617324800 ext(0->15) 00002000:00010000:2.0:1789518625.784054:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec3474000 00000100:00100000:2.0:1789518625.784076:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1789518625.784086:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617324800:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518625.784480:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617324800:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 394us (1083us total) trans 30064771091 rc 0/0 00000100:00100000:2.0:1789518625.784488:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00002000:00100000:2.0:1789518625.784496:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc4:0x0] (0->15) req@ffff99fec3474000 x1876445617324800/t30064771091(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:271/0 lens 504/448 e 0 to 0 dl 1789518636 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518625.784505:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3474000 with x1876445617324800 ext(0->15) 00002000:00010000:2.0:1789518625.784509:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec3474000 00000100:00100000:3.0:1789518625.786514:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.786662:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617324928 00000100:00100000:0.0:1789518625.786671:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617324928 00000100:00100000:0.0:1789518625.786731:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 182 00000100:00100000:0.0:1789518625.786740:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:32444:x1876445617324928:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789518625.812213:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:32444:x1876445617324928:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 25464us (25707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518625.812227:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 182 00000001:00080000:3.0:1789518625.812264:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771213 is committed 00000001:00080000:3.0:1789518625.812278:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771214 is committed 00000004:00080000:3.0:1789518625.812282:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1789518625.812322:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771215 is committed 00000004:00080000:3.0:1789518625.812330:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789518625.812346:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffd807a3c0 refcount 2 committed 0 result 0 batchid 25769803895 00000020:00080000:3.0:1789518625.812350:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeecdf200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd807a000 00000020:00080000:3.0:1789518625.812353:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeecdfc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec828d400 00000020:00080000:3.0:1789518625.812377:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803894 batchid updated 00000100:00100000:0.0:1789518625.812462:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627650432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518625.812509:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518625.812551:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627650304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789518625.812572:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518625.812633:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627650432 00000100:00100000:0.0:1789518625.812640:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627650432 00000100:00100000:0.0:1789518625.812671:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627650304 00000100:00100000:0.0:1789518625.812674:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627650304 00000100:00100000:0.0:1789518625.812691:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789518625.812743:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789518625.812753:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627650304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789518625.812777:0:36531:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:196 count 1 00000020:00080000:1.0:1789518625.812787:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803895 committed batchid 25769803894 00002000:00010000:3.0:1789518625.812806:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc4:0x0] initial LVB size: 16, mtime: 0x6aa9e321, atime: 0x6aa9e321, ctime: 0x6aa9e321, blocks: 0x1 00010000:00010000:3.0:1789518625.812813:0:36531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.812828:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=679s v=(0 0) 00010000:00010000:3.0:1789518625.812832:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518625.812837:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.812852:0:36531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.812861:0:36531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.812868:0:36531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.812888:0:36531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518625.812915:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518625.812924:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.812944:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16600 already unused, calling callback (ffffffffc15168b0) 00000020:00080000:1.0:1789518625.812945:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803894 00010000:00010000:2.0:1789518625.812948:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.812960:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.812977:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.812986:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070a5f349/0x631fd8698c786135 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.812987:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627650432:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789518625.813012:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518625.813014:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518625.813016:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789518625.813091:0:37973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb size from disk: 0 -> 16 00002000:00010000:0.0:1789518625.813095:0:37973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb mtime from disk: 0 -> 1789518626 00002000:00010000:0.0:1789518625.813097:0:37973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518625.813099:0:37973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb ctime from disk: 1789518626 -> 1789518626 00002000:00010000:0.0:1789518625.813101:0:37973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518625.813194:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3283:x1876445627650432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (684us total) trans 30064771092 rc 0/0 00000100:00100000:0.0:1789518625.813202:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789518625.813327:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3283:x1876445627650304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 576us (752us total) trans 30064771089 rc 0/0 00000100:00100000:3.0:1789518625.813333:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:1.0:1789518625.813401:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec25cd500/2, rc 0, transno 30064771092 00000100:00100000:1.0:1789518625.813407:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627650432:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1789518625.813418:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffeda68e00/2, rc 0, transno 30064771089 00000100:00100000:1.0:1789518625.813422:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627650304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789518625.814911:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518625.814957:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617325056 00000100:00100000:3.0:1789518625.814965:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617325056 00000100:00100000:3.0:1789518625.815018:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:3.0:1789518625.815025:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617325056:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789518625.841270:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617325056:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 26235us (26353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.841284:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000001:00080000:2.0:1789518625.841464:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771092 is committed 00000001:00080000:2.0:1789518625.841479:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771091 is committed 00000100:00100000:1.0:1789518625.847377:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518625.847594:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617325312 00000100:00100000:3.0:1789518625.847604:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617325312 00000100:00100000:3.0:1789518625.847684:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 183 00000100:00100000:3.0:1789518625.847694:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:32444:x1876445617325312:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518625.847742:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518625.847893:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786120 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb80 expref: 11 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.847911:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518625.847916:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518625.847994:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.848004:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.848010:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518625.848300:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6606fb1 reply state 0000000078384bbf transno 30064771216 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518625.848310:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518625.848459:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:32444:x1876445617325312:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 765us (1088us total) trans 30064771216 rc 0/0 00000100:00100000:3.0:1789518625.848466:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 183 00010000:00010000:2.0:1789518625.851358:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.851374:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.851382:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.851409:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518625.851415:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.851423:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.851438:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:2.0:1789518625.851441:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518625.851446:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.851453:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78613c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518625.851907:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.852335:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617325440 00000100:00100000:0.0:1789518625.852344:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617325440 00000100:00100000:0.0:1789518625.852391:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:0.0:1789518625.852405:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617325440:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789518625.852695:0:36532:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb size from disk: 16 -> 16 00002000:00010000:0.0:1789518625.852699:0:36532:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb mtime from disk: 1789518626 -> 1789518625 00002000:00010000:0.0:1789518625.852702:0:36532:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb atime from disk: 0 -> 1789518625 00002000:00010000:0.0:1789518625.852704:0:36532:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb ctime from disk: 1789518626 -> 1789518625 00002000:00010000:0.0:1789518625.852706:0:36532:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789518625.852757:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617325440:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 353us (853us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1789518625.852765:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1789518625.854759:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.854969:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617325696 00000100:00100000:1.0:1789518625.854981:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617325696 00000100:00100000:1.0:1789518625.855077:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00100000:1.0:1789518625.855090:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:32444:x1876445617325696:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789518625.855192:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.855211:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb72 expref: 11 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.855221:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.855287:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb72 expref: 11 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.855306:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb72 expref: 11 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518625.855322:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627650560:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518625.855437:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518625.859041:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627650560:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518625.859082:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518625.859384:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.859449:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617325824 00000100:00100000:0.0:1789518625.859460:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617325824 00010000:00010000:0.0:1789518625.859517:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb72 expref: 12 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518625.859749:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:3.0:1789518625.859766:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2343:x1876445617325824:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518625.859785:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518625.859797:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb72 expref: 12 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.859815:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb72 expref: 12 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.859837:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786104 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb72 expref: 12 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.859850:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518625.859854:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.859861:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.859868:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.859963:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518625.860023:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617325824:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 264us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518625.860032:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00010000:00010000:1.0:1789518625.860072:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.860081:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.860122:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.860130:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.860138:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.860144:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518625.860158:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.860166:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.860177:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518625.860180:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789518625.860189:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.860196:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786143 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518625.860246:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:32444:x1876445617325696:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 5158us (5497us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789518625.860254:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00100000:3.0:1789518625.863287:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518625.863406:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617325952 00000100:00100000:0.0:1789518625.863414:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617325952 00000100:00100000:0.0:1789518625.863468:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1789518625.863478:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617325952:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789518625.863519:0:36533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.863541:0:36533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 7 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.863555:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518625.863560:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518625.863565:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.863678:0:36533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 7 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.863693:0:36533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 7 pid: 36735 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.863709:0:36533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627650688:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518625.863778:0:36533:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518625.867200:0:36533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627650688:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518625.867304:0:36533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518625.868155:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518625.868295:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617326080 00000100:00100000:1.0:1789518625.868304:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617326080 00010000:00010000:1.0:1789518625.868339:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 8 pid: 36735 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518625.868390:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1789518625.868400:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617326080:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518625.868418:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518625.868440:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 8 pid: 36735 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.868453:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 8 pid: 36735 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.868484:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c78612e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb8e expref: 8 pid: 36735 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.868503:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518625.868507:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518625.868513:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.868523:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.868548:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518625.868641:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617326080:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 242us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518625.868650:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00010000:00010000:3.0:1789518625.868758:0:36533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.868769:0:36533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.868795:0:36533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.868804:0:36533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.868813:0:36533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.868821:0:36533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518625.868826:0:36533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.868835:0:36533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.868860:0:36533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.868867:0:36533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001484ded8/0x631fd8698c78614a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518625.868916:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617325952:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 5439us (5636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518625.868924:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:0.0:1789518625.871331:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518625.871372:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617326336 00000100:00100000:3.0:1789518625.871381:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617326336 00000100:00100000:3.0:1789518625.871435:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 185 00000100:00100000:3.0:1789518625.871445:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:32444:x1876445617326336:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518625.871547:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.871564:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.871591:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.871957:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.871970:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb79 expref: 11 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.871978:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.872009:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb79 expref: 11 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.872022:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb79 expref: 11 pid: 35847 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518625.872054:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627650816:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518625.872137:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdaf94480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518625.877271:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518625.877318:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617326464 00000100:00100000:3.0:1789518625.877327:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617326464 00000100:00100000:0.0:1789518625.877349:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627650816:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518625.877364:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb79 expref: 12 pid: 35847 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.877374:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518625.877434:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1789518625.877446:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2343:x1876445617326464:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518625.877471:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518625.877477:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb79 expref: 12 pid: 35847 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.877486:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb79 expref: 12 pid: 35847 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.877501:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786112 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb79 expref: 12 pid: 35847 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.877513:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518625.877517:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.877523:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.877529:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518625.877560:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518625.877706:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617326464:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 262us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518625.877715:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00010000:00010000:0.0:1789518625.878043:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.878053:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518625.878216:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771217 00000001:00080000:0.0:1789518625.878471:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771218 00000001:00080000:0.0:1789518625.878516:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771219 00000100:00100000:0.0:1789518625.878637:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627650944:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789518625.878685:0:37723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518625.878717:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd84d6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518625.878801:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627650944 00000100:00100000:2.0:1789518625.878808:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627650944 00000100:00100000:2.0:1789518625.878854:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789518625.878874:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627650944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518625.878943:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627650944:12345-0@lo:1000:mdt00_003.0 Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518625.878950:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789518625.879095:0:37723:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771092 gen 2 00000004:00080000:0.0:1789518625.879099:0:37723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff79af800, transno 30064771088 00000004:00080000:0.0:1789518625.879109:0:37723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff79af100, transno 30064771089 00000004:00080000:0.0:1789518625.879113:0:37723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec25cd500, transno 30064771092 00000100:00100000:0.0:1789518625.879118:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627650944:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789518625.879880:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771220 00000100:00100000:0.0:1789518625.879937:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627651072:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789518625.879971:0:37723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518625.879998:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518625.880191:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627651072 00000100:00100000:2.0:1789518625.880197:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627651072 00000100:00100000:2.0:1789518625.880274:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789518625.880284:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627651072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518625.880473:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:37723:x1876445627651072:12345-0@lo:1000:mdt00_003.0 Request processed in 190us (500us total) trans 30064771094 rc 0/0 00000100:00100000:2.0:1789518625.880480:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789518625.881443:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627651072:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789518625.881547:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771221 00010000:00010000:0.0:1789518625.881606:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881628:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881635:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881640:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518625.881644:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881652:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881666:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:0.0:1789518625.881669:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518625.881674:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881680:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786158 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881710:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881717:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881722:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881726:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518625.881729:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881734:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881742:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:0.0:1789518625.881744:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518625.881747:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881753:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78607f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881775:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881787:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb56 expref: 15 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881796:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518625.881800:0:35869:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00010000:00010000:0.0:1789518625.881838:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb56 expref: 15 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.881851:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb56 expref: 15 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.881863:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627651200:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518625.881933:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518625.884916:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627651200:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518625.884941:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:0.0:1789518625.884942:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518625.885006:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617326592 00000100:00100000:1.0:1789518625.885013:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617326592 00010000:00010000:1.0:1789518625.885051:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb56 expref: 16 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518625.885086:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:1.0:1789518625.885095:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617326592:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518625.885108:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518625.885114:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb56 expref: 16 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.885139:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb56 expref: 16 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.885160:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c78609b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb56 expref: 16 pid: 35845 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.885174:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:1.0:1789518625.885179:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.885188:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.885196:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.885225:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518625.885244:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885251:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885262:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885269:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518625.885274:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617326592:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 181us (334us total) trans 0 rc 0/0 00010000:00010000:0.0:1789518625.885275:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885281:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00000100:00100000:1.0:1789518625.885282:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00010000:00010000:0.0:1789518625.885285:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885292:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885445:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:0.0:1789518625.885448:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518625.885451:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885457:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c78615f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885467:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885472:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885477:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885482:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518625.885486:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885491:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885497:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:0.0:1789518625.885500:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518625.885502:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518625.885507:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c786151 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518625.885775:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:32444:x1876445617326336:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 14331us (14450us total) trans 30064771222 rc 0/0 00000100:00100000:0.0:1789518625.885784:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 185 00000020:00080000:0.0:1789518625.885788:0:37723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1789518625.885839:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518625.885844:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518625.885890:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:2.0:1789518625.885898:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518625.889957:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518625.890003:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617326848 00000100:00100000:3.0:1789518625.890030:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617326848 00000100:00100000:3.0:1789518625.890085:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:3.0:1789518625.890096:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:32444:x1876445617326848:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789518625.890947:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x12:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789518625.891033:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771223 00010000:00010000:2.0:1789518625.891079:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.891094:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.891103:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.891111:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.891116:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.891120:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518625.891140:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789518625.891212:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:32444:x1876445617326848:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1118us (1263us total) trans 30064771224 rc 0/0 00000100:00100000:2.0:1789518625.891220:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000020:00080000:2.0:1789518625.891225:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518625.891263:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518625.891269:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.891276:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518625.891279:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.891285:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.891307:0:36743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff99fec3b12400) 00010000:00010000:1.0:1789518625.891310:0:36743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789518625.891313:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.891317:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c786166 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518625.891330:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518625.891331:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518625.891332:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518626.674814:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518626.701869:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518626.701917:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518626.701958:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518626.701989:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617327488 00000100:00100000:3.0:1789518626.701999:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617327488 00000100:00100000:0.0:1789518626.702270:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617326976 00000100:00100000:0.0:1789518626.702275:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617326976 00000100:00100000:0.0:1789518626.702320:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:0.0:1789518626.702330:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617326976:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518626.702397:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617326976:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518626.702404:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:1.0:1789518626.702645:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617327232 00000100:00100000:1.0:1789518626.702650:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617327232 00000100:00100000:3.0:1789518626.702923:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518626.702931:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617327488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518626.703032:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617327488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 85us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518626.703040:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1789518626.703086:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518626.703184:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518626.703206:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617327104 00000100:00100000:3.0:1789518626.703210:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617327104 00000100:00080000:0.0:1789518626.705850:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518626.705859:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518626.705863:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518626.705889:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617327360 00000100:00100000:0.0:1789518626.705898:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617327360 00000100:00100000:0.0:1789518626.705969:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1789518626.705979:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617327360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518626.706046:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617327360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 68us (2862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518626.706053:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00080000:0.0:1789518626.706120:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518626.707128:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:3.0:1789518626.707137:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617327104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518626.707190:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617327104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 54us (4104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518626.707197:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518626.711180:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1789518626.711197:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617327232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518626.711291:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617327232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 100us (9372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518626.711299:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000040:00080000:1.0:1789518626.933834:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518626.933844:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518626.933884:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:1.0:1789518626.933892:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1789518627.156119:0:38293:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518627.156124:0:38293:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518627.156162:0:38293:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:1.0:1789518627.156167:0:38293:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518627.231374:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518627.233936:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617327616 00000100:00100000:1.0:1789518627.233946:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617327616 00000100:00100000:1.0:1789518627.234072:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00100000:1.0:1789518627.234083:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:32461:x1876445617327616:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518627.234104:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518627.234125:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78616d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb95 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518627.234188:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786174 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518627.234202:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518627.234216:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518627.234248:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518627.234251:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518627.234268:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518627.234292:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c78616d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb95 expref: 18 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518627.234308:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786174 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb95 expref: 17 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518627.234317:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518627.234320:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518627.234323:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:1.0:1789518627.234386:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:32461:x1876445617327616:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 305us (3021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518627.234400:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00080000:0.0:1789518627.235437:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518627.238691:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518627.238728:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617327744 00000100:00100000:0.0:1789518627.238737:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617327744 00000100:00100000:0.0:1789518627.238786:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:0.0:1789518627.238797:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:32461:x1876445617327744:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518627.238862:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.238878:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.238890:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.238906:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.238913:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.238919:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239142:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239152:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239161:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518627.239202:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239216:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239223:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239230:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239237:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518627.239241:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239249:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239262:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518627.239266:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518627.239271:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239278:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78617b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239290:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239297:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239302:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239307:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518627.239310:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239316:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239324:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff99ffc2d97300) 00010000:00010000:0.0:1789518627.239327:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518627.239331:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239337:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786182 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239356:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239363:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239370:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239375:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518627.239378:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239384:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239392:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffc2d97000) 00010000:00010000:0.0:1789518627.239394:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518627.239398:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.239404:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd200/0x631fd8698c786189 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518627.239478:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:32461:x1876445617327744:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 682us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518627.239488:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:0.0:1789518627.261514:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518627.261601:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617327872 00000100:00100000:3.0:1789518627.261650:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617327872 00000100:00100000:3.0:1789518627.261707:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 188 00000100:00100000:3.0:1789518627.261718:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:32462:x1876445617327872:12345-192.168.206.51@tcp:101:mmap_cat.0 00010000:00010000:3.0:1789518627.261754:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518627.261773:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786190 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdb9c expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.261831:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.261851:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.261863:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.261877:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.261885:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.261892:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262099:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7861a5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262109:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7861a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262116:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7861a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518627.262577:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:3.0:1789518627.262589:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518627.262715:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7861a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262728:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7861a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262737:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262750:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262757:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262763:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518627.262767:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262775:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262786:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:3.0:1789518627.262789:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518627.262794:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262800:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262811:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262826:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262832:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262837:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518627.262841:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262847:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262854:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff99ffeaa78900) 00010000:00010000:3.0:1789518627.262857:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518627.262860:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262865:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78619e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.262899:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786190 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb9c expref: 19 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.263027:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17c00/0x631fd8698c7861a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb9c expref: 18 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.263035:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffeaa78b00) 00010000:00010000:3.0:1789518627.263038:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518627.263045:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17c00, rc 0) 00000100:00100000:3.0:1789518627.263121:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:32462:x1876445617327872:12345-192.168.206.51@tcp:101:mmap_cat.0 Request processed in 1405us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518627.263129:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 188 00000100:00100000:2.0:1789518627.267819:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518627.267858:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617328000 00000100:00100000:0.0:1789518627.267869:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617328000 00000100:00080000:2.0:1789518627.267918:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518627.267936:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:0.0:1789518627.267947:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617328000:12345-192.168.206.51@tcp:101:mmap_cat.0 00010000:00010000:0.0:1789518627.267962:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518627.267981:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7861ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdba3 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518627.268011:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc4:0x0] initial LVB size: 16, mtime: 0x6aa9e321, atime: 0x6aa9e321, ctime: 0x6aa9e321, blocks: 0xb 00010000:00010000:0.0:1789518627.268196:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1789518627.268201:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518627.268210:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7861ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdba3 expref: 7 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.268226:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000baeabe1/0x631fd8698c7861ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdba3 expref: 7 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518627.268238:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd200, rc 0) 00000100:00100000:0.0:1789518627.268455:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617328000:12345-192.168.206.51@tcp:101:mmap_cat.0 Request processed in 509us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518627.268463:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1789518627.272969:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518627.273073:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617328256 00000100:00100000:3.0:1789518627.273093:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617328256 00000100:00100000:3.0:1789518627.273236:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:3.0:1789518627.273249:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:32462:x1876445617328256:12345-192.168.206.51@tcp:101:mmap_cat.0 00010000:00010000:3.0:1789518627.273278:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518627.273304:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7861b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbaa expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.273446:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7861ba lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.273463:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7861ba lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.273476:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7861ba lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518627.273488:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:3.0:1789518627.273701:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7861b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbaa expref: 21 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.273727:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16600/0x631fd8698c7861ba lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbaa expref: 20 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518627.273737:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff99ffeaa78b00) 00010000:00010000:3.0:1789518627.273758:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789518627.273764:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16600, rc 0) 00000100:00100000:3.0:1789518627.273842:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:32462:x1876445617328256:12345-192.168.206.51@tcp:101:mmap_cat.0 Request processed in 596us (882us total) trans 30064771225 rc 0/0 00000100:00100000:3.0:1789518627.273850:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:1.0:1789518627.277366:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518627.277437:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617328384 00000100:00100000:3.0:1789518627.277454:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617328384 00002000:00100000:3.0:1789518627.277586:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc4:0x0] (0->4095) req@ffff99ffdfeeb800 x1876445617328384/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:273/0 lens 488/0 e 0 to 0 dl 1789518638 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518627.277600:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfeeb800 with x1876445617328384 ext(0->4095) 00002000:00010000:3.0:1789518627.277607:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfeeb800 00000100:00100000:3.0:1789518627.277786:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1789518627.277799:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617328384:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518627.278056:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617328384:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 259us (698us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789518627.278065:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00002000:00100000:3.0:1789518627.278073:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc4:0x0] (0->4095) req@ffff99ffdfeeb800 x1876445617328384/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:273/0 lens 488/4536 e 0 to 0 dl 1789518638 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518627.278082:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfeeb800 with x1876445617328384 ext(0->4095) 00002000:00010000:3.0:1789518627.278086:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfeeb800 00000001:00080000:1.0:1789518627.472719:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771086 is committed 00000001:00080000:1.0:1789518627.472736:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771088 is committed 00000001:00080000:1.0:1789518627.472744:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771089 is committed 00000001:00080000:1.0:1789518627.472749:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771087 is committed 00010000:00010000:3.0:1789518627.698740:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518628.723101:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518629.746965:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518630.005411:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627651328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518630.005491:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518630.006268:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627651328 00000100:00100000:0.0:1789518630.006278:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627651328 00000100:00100000:0.0:1789518630.006334:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518630.006344:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627651328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518630.006380:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518630.006436:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627651328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518630.006443:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789518630.006465:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518630.006494:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771089 gen 2 00000004:00080000:0.0:1789518630.006500:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff4b1fb80, transno 30064771086 00000004:00080000:0.0:1789518630.006509:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771088 committed transno 30064771089 00000004:00080000:0.0:1789518630.006528:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffeda68e00, transno 30064771089 00000100:00100000:0.0:1789518630.006540:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627651328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518630.128381:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518630.128504:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617328512 00000100:00100000:0.0:1789518630.128513:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617328512 00000100:00080000:2.0:1789518630.128589:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518630.128756:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:0.0:1789518630.128768:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:32398:x1876445617328512:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789518630.128958:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:32398:x1876445617328512:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 192us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518630.128967:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:1.0:1789518630.132498:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518630.132683:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617328768 00000100:00100000:3.0:1789518630.132692:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617328768 00000100:00100000:3.0:1789518630.132767:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1789518630.132776:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:32398:x1876445617328768:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518630.132986:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:32398:x1876445617328768:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 210us (495us total) trans 30064771226 rc 0/0 00000100:00100000:3.0:1789518630.132995:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1789518630.514838:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627651456:0@lo:400:kworker.0 00000100:00100000:0.0:1789518630.514918:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518630.514922:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627651584:0@lo:400:kworker.0 00000100:00100000:1.0:1789518630.514968:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518630.514993:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627651968:0@lo:400:kworker.0 00000100:00100000:1.0:1789518630.514995:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518630.515006:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627651712:0@lo:400:kworker.0 00000100:00100000:1.0:1789518630.515041:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518630.515055:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627651456 00000100:00100000:0.0:1789518630.515063:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627651456 00000100:00100000:1.0:1789518630.515099:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627651712 00000100:00100000:1.0:1789518630.515105:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627651712 00000100:00100000:0.0:1789518630.515111:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789518630.515122:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627651456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518630.515140:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789518630.515151:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627651712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518630.515173:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627651456:12345-0@lo:400:kworker.0 Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518630.515181:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789518630.515208:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627651712:12345-0@lo:400:kworker.0 Request processed in 58us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518630.515215:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518630.515222:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518630.515266:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627651456:0@lo:400:kworker.0 00000100:00100000:0.0:1789518630.515283:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518630.515289:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627651840:0@lo:400:kworker.0 00000100:00100000:0.0:1789518630.515310:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518630.515336:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627651968 00000100:00100000:0.0:1789518630.515340:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627651968 00000100:00100000:0.0:1789518630.515366:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627651840 00000100:00100000:0.0:1789518630.515369:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627651840 00000100:00100000:0.0:1789518630.515384:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789518630.515390:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627651968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518630.515446:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627651968:12345-0@lo:400:kworker.0 Request processed in 56us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518630.515453:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789518630.515466:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789518630.515471:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627651840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518630.515504:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627651840:12345-0@lo:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518630.515512:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789518630.515530:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518630.515570:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627651840:0@lo:400:kworker.0 00000100:00100000:2.0:1789518630.515584:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627651584 00000100:00100000:0.0:1789518630.515584:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627651968:0@lo:400:kworker.0 00000100:00100000:2.0:1789518630.515591:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627651584 00000100:00100000:0.0:1789518630.515644:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627652096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518630.515659:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518630.515669:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627651584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518630.515675:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518630.515706:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627651712:0@lo:400:kworker.0 00000100:00100000:2.0:1789518630.515716:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627651584:12345-0@lo:400:kworker.0 Request processed in 49us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518630.515721:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627651584:0@lo:400:kworker.0 00000100:00080000:0.0:1789518630.515740:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518630.515751:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627652096 00000100:00100000:0.0:1789518630.515754:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627652096 00000100:00100000:0.0:1789518630.515784:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518630.515791:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627652096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518630.515817:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789518630.515858:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627652096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518630.515865:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789518630.516010:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627652096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518630.516575:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1789518630.771012:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789518631.063875:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771222 is committed 00000020:00080000:3.0:1789518631.063888:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffd84d6480 refcount 2 committed 0 result 0 batchid 25769803896 00000020:00080000:3.0:1789518631.063893:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffee48b200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd84d6c00 00000020:00080000:3.0:1789518631.063896:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffee48be00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec8508000 00000020:00080000:0.0:1789518631.063936:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803896 committed batchid 25769803894 00000020:00080000:0.0:1789518631.064115:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803894 00000020:00080000:3.0:1789518631.064161:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803895 batchid updated 00000001:00080000:3.0:1789518631.064167:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771226 is committed 00000001:00080000:2.0:1789518631.068310:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771093 is committed 00000001:00080000:2.0:1789518631.068391:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771094 is committed 00000001:02000400:1.0:1789518631.256307:0:38494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_6 skipping ALWAYS excluded test 6 00010000:00010000:1.0:1789518631.794783:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518631.822973:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518631.823011:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518631.823054:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518631.823090:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617329152 00000100:00100000:1.0:1789518631.823097:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518631.823102:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617329152 00000100:00100000:1.0:1789518631.823122:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518631.823144:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518631.823191:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617329664 00000100:00100000:3.0:1789518631.823194:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617329664 00000100:00100000:0.0:1789518631.823208:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617328896 00000100:00100000:0.0:1789518631.823214:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617328896 00000100:00100000:3.0:1789518631.823216:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617329280 00000100:00100000:3.0:1789518631.823220:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617329280 00000100:00100000:3.0:1789518631.823242:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518631.823250:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2343:x1876445617329152:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518631.823259:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:0.0:1789518631.823269:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617328896:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518631.823305:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2343:x1876445617329152:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 56us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518631.823309:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617328896:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 41us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518631.823315:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1789518631.823323:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1789518631.823342:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1789518631.823352:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617329664:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:0.0:1789518631.823353:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518631.823360:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518631.823372:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617329408 00000100:00100000:0.0:1789518631.823376:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617329408 00000100:00100000:0.0:1789518631.823407:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617329024 00000100:00100000:0.0:1789518631.823409:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617329024 00000100:00100000:0.0:1789518631.823427:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1789518631.823434:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617329408:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518631.823452:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617329664:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 100us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518631.823469:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617329408:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518631.823473:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1789518631.823482:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518631.823497:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1789518631.823504:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518631.823509:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617329280:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518631.823518:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617329024:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518631.823541:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617329280:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518631.823561:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1789518631.823574:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617329024:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 58us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518631.823582:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00080000:0.0:1789518631.823604:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518631.824450:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518631.825031:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617329536 00000100:00100000:2.0:1789518631.825039:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617329536 00000100:00100000:2.0:1789518631.825093:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1789518631.825264:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617329536:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518631.825319:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617329536:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 219us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518631.825326:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00080000:1.0:1789518631.825414:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789518632.099322:0:38543:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7a skipping ALWAYS excluded test 7a 00010000:00010000:0.0:1789518632.819948:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789518633.071161:0:38591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7b skipping ALWAYS excluded test 7b 00010000:00010000:2.0:1789518633.842865:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518634.156003:0:38639:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 8: Test fake -ENOSPC tolerance for RW-PCC ========================================================== 20:30:33 (1789518633) 00010000:00010000:1.0:1789518634.866777:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518634.885640:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518634.885743:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617329920 00000100:00100000:2.0:1789518634.885753:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617329920 00000100:00100000:2.0:1789518634.885831:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00100000:2.0:1789518634.885841:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:33569:x1876445617329920:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518634.885859:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518634.885879:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7861c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbb1 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.885947:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.885962:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.885990:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886006:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886014:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886021:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789518634.886216:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789518634.886810:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c7861dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886820:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c7861dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886828:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c7861dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518634.886837:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789518634.886940:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886948:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886955:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886961:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518634.886972:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886980:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.886991:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:2.0:1789518634.886995:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518634.886999:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887006:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7861cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887020:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887026:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887032:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887037:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518634.887039:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887045:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887053:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99fec3b12200) 00010000:00010000:2.0:1789518634.887055:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518634.887065:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887077:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7861d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887441:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7861c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb1 expref: 13 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887457:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c7861dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb1 expref: 12 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518634.887470:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:2.0:1789518634.887472:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518634.887475:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5e00, rc 0) 00000100:00100000:2.0:1789518634.887657:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:33569:x1876445617329920:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1816us (2052us total) trans 30064771227 rc 0/0 00000100:00100000:2.0:1789518634.887666:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00100000:2.0:1789518634.891018:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518634.891157:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518634.891369:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617330176 00000100:00100000:3.0:1789518634.891378:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617330176 00000100:00100000:3.0:1789518634.891443:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 192 00000100:00100000:3.0:1789518634.891457:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:33569:x1876445617330176:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789518634.891573:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:33569:x1876445617330176:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 121us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518634.891581:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 192 00000100:00100000:0.0:1789518634.892331:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617330048 00000100:00100000:0.0:1789518634.892338:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617330048 00000100:00100000:0.0:1789518634.892390:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:0.0:1789518634.892399:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed7c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617330048:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518634.892410:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518634.892442:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c7861dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb1 expref: 12 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.892464:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:0.0:1789518634.892469:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518634.892510:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed7c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617330048:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 112us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518634.892517:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1789518634.942544:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518634.943488:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617330432 00000100:00100000:0.0:1789518634.943499:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617330432 00000100:00100000:0.0:1789518634.943634:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:0.0:1789518634.943645:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:33341:x1876445617330432:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518634.943664:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518634.943667:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518634.943690:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786174 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdb95 expref: 11 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.943774:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518634.943786:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518634.943801:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7861eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbb8 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.944061:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.944074:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.944085:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.944098:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.944105:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.944111:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518634.944878:0:35845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc5:0x0], index 0: 0 00010000:00010000:0.0:1789518634.945082:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945092:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945104:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945132:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945140:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945146:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945152:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518634.945156:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945164:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945173:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:0.0:1789518634.945176:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518634.945179:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945185:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7861f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518634.945195:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030c52525 reply state 0000000011ae0a14 transno 30064771228 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518634.945203:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518634.945229:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7861eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb8 expref: 13 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945248:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb8 expref: 12 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.945254:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518634.945257:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518634.945259:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:0.0:1789518634.945331:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:33341:x1876445617330432:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1688us (2807us total) trans 30064771228 rc 0/0 00000100:00100000:0.0:1789518634.945339:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 193 00010000:00010000:3.0:1789518634.948639:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518634.948658:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518634.948667:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518634.948674:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518634.948678:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518634.948687:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518634.948715:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff99ffc2d97900) 00010000:00010000:3.0:1789518634.948718:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518634.948723:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518634.948730:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c7861f9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518634.949823:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518634.950297:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617330560 00000100:00100000:0.0:1789518634.950305:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617330560 00000100:00100000:0.0:1789518634.950385:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:0.0:1789518634.950395:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:33341:x1876445617330560:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1789518634.950411:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518634.950449:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbbf expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518634.950558:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:1.0:1789518634.950572:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789518634.950584:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=688s v=(0 0) 00010000:00010000:0.0:1789518634.950590:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518634.950600:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.950634:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518634.950646:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:0.0:1789518634.950706:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:33341:x1876445617330560:12345-192.168.206.51@tcp:101:bash.0 Request processed in 313us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518634.950764:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1789518634.954127:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518634.956108:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617330816 00000100:00100000:0.0:1789518634.956131:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617330816 00000100:00100000:0.0:1789518634.956289:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:0.0:1789518634.956300:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:33341:x1876445617330816:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:0.0:1789518634.956675:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:33341:x1876445617330816:12345-192.168.206.51@tcp:35:bash.0 Request processed in 375us (2554us total) trans 30064771229 rc 0/0 00000100:00100000:0.0:1789518634.956684:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1789518635.005277:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518635.005375:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617330944 00000100:00100000:3.0:1789518635.005388:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617330944 00000100:00100000:3.0:1789518635.005449:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:3.0:1789518635.005459:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:33583:x1876445617330944:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518635.005480:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518635.005513:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbc6 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.005590:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78621c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.005650:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78621c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.005665:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78621c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518635.005701:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518635.005705:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518635.005722:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78621c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.005775:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbc6 expref: 15 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.005794:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78621c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbc6 expref: 14 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.005803:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:3.0:1789518635.005868:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518635.005876:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16e00, rc 0) 00000100:00100000:3.0:1789518635.005943:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:33583:x1876445617330944:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 486us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518635.005950:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:2.0:1789518635.011545:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518635.011588:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617331200 00000100:00100000:0.0:1789518635.011599:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617331200 00000100:00100000:0.0:1789518635.011682:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:0.0:1789518635.011693:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:33583:x1876445617331200:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518635.011712:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518635.011731:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbcd expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.011829:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.011843:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb8 expref: 15 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.011857:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.011889:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb8 expref: 15 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.011902:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb8 expref: 15 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518635.011914:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627652224:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518635.012001:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43300 going to sleep for 11 seconds 00000100:00100000:0.0:1789518635.015255:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627652224:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518635.015285:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518635.015437:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518635.015506:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617331328 00000100:00100000:3.0:1789518635.015513:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617331328 00010000:00010000:3.0:1789518635.015559:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb8 expref: 16 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518635.015689:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1789518635.015701:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2345:x1876445617331328:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518635.015716:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518635.015729:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb8 expref: 16 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.015742:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb8 expref: 16 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.015783:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786200 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbb8 expref: 16 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.015797:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:3.0:1789518635.015802:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.015810:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.015818:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.015851:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518635.015901:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2345:x1876445617331328:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 202us (465us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518635.016421:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.016429:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518635.016455:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:2.0:1789518635.016629:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbcd expref: 17 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.016646:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbcd expref: 16 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.016653:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:2.0:1789518635.016656:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518635.016659:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:2.0:1789518635.016704:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:33583:x1876445617331200:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 5013us (5178us total) trans 30064771230 rc 0/0 00000100:00100000:2.0:1789518635.016712:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:3.0:1789518635.018892:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1789518635.022222:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518635.022324:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617331584 00000100:00100000:3.0:1789518635.022334:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617331584 00000100:00100000:3.0:1789518635.022418:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 196 00000100:00100000:3.0:1789518635.022430:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:33583:x1876445617331584:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518635.022453:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518635.022456:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518635.022481:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78622a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbcd expref: 15 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.022499:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:3.0:1789518635.022519:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518635.022550:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786238 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbd4 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.022682:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78623f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.022694:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78623f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.022703:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78623f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518635.022714:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:3.0:1789518635.022850:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786238 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbd4 expref: 17 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.022866:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78623f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbd4 expref: 16 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.022874:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:3.0:1789518635.022876:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518635.022879:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:3.0:1789518635.022944:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:33583:x1876445617331584:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 517us (733us total) trans 30064771231 rc 0/0 00000100:00100000:3.0:1789518635.022950:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 196 00000100:00100000:1.0:1789518635.031765:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518635.032296:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617331712 00000100:00100000:2.0:1789518635.032306:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617331712 00000100:00100000:2.0:1789518635.032363:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:2.0:1789518635.032373:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:33583:x1876445617331712:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518635.032396:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518635.032415:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbdb expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.032472:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbdb expref: 17 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.032487:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbdb expref: 17 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.032519:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:2.0:1789518635.032522:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518635.032526:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5400, rc 0) 00000100:00100000:2.0:1789518635.032599:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:33583:x1876445617331712:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 227us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518635.032606:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:1.0:1789518635.037797:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518635.037916:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617331840 00000100:00100000:2.0:1789518635.037925:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617331840 00000100:00100000:2.0:1789518635.038015:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:2.0:1789518635.038026:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617331840:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:2.0:1789518635.038066:0:36531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.038099:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.038107:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789518635.038112:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518635.038116:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.038149:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.038164:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 6 pid: 37973 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518635.038192:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:36531:1876445627652352:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518635.038266:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a6be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789518635.042867:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518635.043001:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:36531:1876445627652352:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518635.043117:0:36531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518635.043215:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617331968 00000100:00100000:0.0:1789518635.043223:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617331968 00002000:00100000:0.0:1789518635.043269:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc5:0x0] (0->5) req@ffff99fec1ec7100 x1876445617331968/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:281/0 lens 496/0 e 0 to 0 dl 1789518646 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518635.043279:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec7100 with x1876445617331968 ext(0->5) 00010000:00010000:0.0:1789518635.043287:0:36537:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 7 pid: 37973 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.043303:0:36537:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 7 pid: 37973 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518635.043316:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99fec1ec7100 00000100:00100000:0.0:1789518635.043349:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1789518635.043359:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617331968:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:0.0:1789518635.043893:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617331968:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 534us (1033us total) trans 30064771090 rc 0/0 00000100:00100000:0.0:1789518635.043902:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00002000:00100000:0.0:1789518635.043910:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc5:0x0] (0->5) req@ffff99fec1ec7100 x1876445617331968/t30064771090(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:281/0 lens 496/448 e 0 to 0 dl 1789518646 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518635.043919:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec7100 with x1876445617331968 ext(0->5) 00010000:00010000:0.0:1789518635.043926:0:36537:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 9 pid: 37973 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.043940:0:36537:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 9 pid: 37973 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518635.043947:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99fec1ec7100 00000100:00100000:1.0:1789518635.045875:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518635.046043:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617332096 00000100:00100000:2.0:1789518635.046052:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617332096 00010000:00010000:2.0:1789518635.046140:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 9 pid: 37973 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518635.046184:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:2.0:1789518635.046194:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2345:x1876445617332096:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518635.046208:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789518635.046225:0:35831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:2.0:1789518635.046229:0:35831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 1789518635 00002000:00010000:2.0:1789518635.046231:0:35831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb atime from disk: 0 -> 1789518635 00002000:00010000:2.0:1789518635.046234:0:35831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb ctime from disk: 0 -> 1789518635 00010000:00010000:2.0:1789518635.046239:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 9 pid: 37973 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.046252:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 9 pid: 37973 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.046293:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001484ded8/0x631fd8698c78620e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbbf expref: 9 pid: 37973 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.046309:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518635.046313:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518635.046319:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.046329:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.046366:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518635.046450:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2345:x1876445617332096:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 257us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518635.046458:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00010000:00010000:3.0:1789518635.046574:0:36531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.046595:0:36531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.046647:0:36531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.046655:0:36531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.046662:0:36531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.046669:0:36531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518635.046673:0:36531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.046681:0:36531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.046693:0:36531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.046701:0:36531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c786254 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518635.046754:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617331840:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 8730us (8966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518635.046762:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:1.0:1789518635.050419:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518635.050828:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617332352 00000100:00100000:3.0:1789518635.050838:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617332352 00000100:00100000:3.0:1789518635.050936:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:3.0:1789518635.050946:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:33583:x1876445617332352:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:3.0:1789518635.051014:0:35849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x13:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78623f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbd4 expref: 17 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518635.051252:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771232 00000001:00080000:3.0:1789518635.051299:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771233 00000001:00080000:3.0:1789518635.052266:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771234 00010000:00010000:3.0:1789518635.052343:0:35849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.052361:0:35849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbdb expref: 21 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.052369:0:35849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.052404:0:35849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbdb expref: 21 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.052418:0:35849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbdb expref: 21 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518635.052445:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35849:1876445627652480:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518635.053182:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1eb3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518635.055968:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518635.056733:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35849:1876445627652480:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518635.056759:0:35849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518635.056837:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617332480 00000100:00100000:3.0:1789518635.056845:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617332480 00010000:00010000:3.0:1789518635.056881:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbdb expref: 22 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518635.056959:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:3.0:1789518635.056968:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2343:x1876445617332480:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518635.056994:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518635.057001:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbdb expref: 22 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.057012:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbdb expref: 22 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.057032:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78624d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbdb expref: 22 pid: 35845 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.057047:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:3.0:1789518635.057052:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.057061:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.057069:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.057117:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518635.057172:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617332480:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 205us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518635.057179:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00010000:00010000:1.0:1789518635.057482:0:35849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518635.057489:0:35849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518635.057631:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771235 00000001:00080000:1.0:1789518635.057827:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771236 00000100:00100000:1.0:1789518635.057930:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1ec5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627652608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789518635.057985:0:35849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518635.058025:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc3387c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789518635.058161:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627652608 00000100:00100000:0.0:1789518635.058167:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627652608 00000100:00100000:0.0:1789518635.058220:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789518635.058229:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35849:x1876445627652608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789518635.058306:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35849:x1876445627652608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518635.058313:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789518635.058822:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1ec5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627652608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518635.059246:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771237 00000100:00100000:2.0:1789518635.059307:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627652736:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1789518635.059526:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518635.059600:0:35849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518635.059655:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4c41480 going to sleep for 11 seconds 00000100:00100000:3.0:1789518635.060195:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627652736 00000100:00100000:3.0:1789518635.060203:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627652736 00000100:00100000:3.0:1789518635.060240:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789518635.060249:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35849:x1876445627652736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518635.060458:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35849:x1876445627652736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 209us (857us total) trans 30064771091 rc 0/0 00000100:00100000:3.0:1789518635.060466:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789518635.060566:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627652736:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518635.061011:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771238 00010000:00010000:2.0:1789518635.061062:0:35849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.061073:0:35849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.061080:0:35849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.061086:0:35849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518635.061090:0:35849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.061098:0:35849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.061112:0:35849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:2.0:1789518635.061115:0:35849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789518635.061119:0:35849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.061125:0:35849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c78625b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518635.061705:0:35849:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x14:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789518635.061879:0:35849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].7, 64 off8688 00000004:00080000:2.0:1789518635.061889:0:35849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689058274826ns, next at 690058272830ns, rc = 0 00000001:00080000:2.0:1789518635.061897:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771239 00010000:00010000:2.0:1789518635.061942:0:35849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:2.0:1789518635.061946:0:35849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518635.061953:0:35849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78623f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbd4 expref: 25 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518635.062608:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:33583:x1876445617332352:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 11660us (12195us total) trans 30064771240 rc 0/0 00000100:00100000:2.0:1789518635.062946:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000020:00080000:2.0:1789518635.062951:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789518635.065076:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518635.065329:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617332608 00000100:00100000:2.0:1789518635.065339:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617332608 00000100:00100000:2.0:1789518635.065425:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 198 00000100:00100000:2.0:1789518635.065436:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:33583:x1876445617332608:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518635.065458:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518635.065480:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c786262 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbe2 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.065547:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c786262 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe2 expref: 25 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.065562:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c786262 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe2 expref: 25 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.065582:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:2.0:1789518635.065585:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518635.065588:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5000, rc 0) 00000100:00100000:2.0:1789518635.065678:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:33583:x1876445617332608:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 244us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518635.065700:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 198 00000100:00100000:1.0:1789518635.069800:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518635.070067:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617332864 00000100:00100000:0.0:1789518635.070077:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617332864 00000100:00100000:0.0:1789518635.070170:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1789518635.070180:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:33583:x1876445617332864:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518635.070402:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:33583:x1876445617332864:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 223us (611us total) trans 30064771241 rc 0/0 00000100:00100000:0.0:1789518635.070410:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000040:00080000:3.0:1789518635.123291:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518635.123297:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518635.123360:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:3.0:1789518635.123366:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789518635.123459:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627652864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518635.123546:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518635.124081:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627652864 00000100:00100000:0.0:1789518635.124089:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627652864 00000100:00100000:0.0:1789518635.124138:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518635.124147:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627652864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518635.124167:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56164352 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518635.124222:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627652864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518635.124229:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789518635.124351:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627652864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518635.124490:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518635.124561:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617332992 00000100:00100000:2.0:1789518635.124565:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617332992 00000100:00100000:2.0:1789518635.124604:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:2.0:1789518635.124632:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:33593:x1876445617332992:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518635.124755:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.124771:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.124782:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.124795:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.124803:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.124809:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125176:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125185:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125193:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518635.125247:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125259:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125266:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125272:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125277:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518635.125281:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125288:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125299:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:2.0:1789518635.125302:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518635.125550:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125559:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125573:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125579:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125591:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125596:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518635.125599:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125604:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125839:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff99fec3b12100) 00010000:00010000:2.0:1789518635.125843:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518635.125847:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125853:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786270 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125871:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125877:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125882:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125899:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518635.125902:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125918:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125926:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:2.0:1789518635.125928:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518635.125931:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.125937:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786277 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518635.126016:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:33593:x1876445617332992:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1403us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518635.126025:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:1.0:1789518635.174834:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518635.174910:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617333248 00000100:00100000:3.0:1789518635.174919:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617333248 00000100:00100000:3.0:1789518635.175022:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:3.0:1789518635.175033:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:33600:x1876445617333248:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:3.0:1789518635.175051:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518635.175068:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c78627e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbe9 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175129:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175154:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175169:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175184:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175191:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175198:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175301:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175310:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175317:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518635.175326:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:3.0:1789518635.175419:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175428:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175434:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175447:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518635.175451:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175459:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175471:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:3.0:1789518635.175474:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518635.175479:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175485:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786285 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175498:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175504:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175511:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175516:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518635.175519:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175525:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175552:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff99ffeaa78800) 00010000:00010000:3.0:1789518635.175555:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518635.175558:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175564:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c78628c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175766:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c78627e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe9 expref: 29 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175781:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe9 expref: 28 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.175789:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:3.0:1789518635.175791:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518635.175794:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:3.0:1789518635.175848:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:33600:x1876445617333248:12345-192.168.206.51@tcp:101:cat.0 Request processed in 817us (1023us total) trans 30064771242 rc 0/0 00000100:00100000:3.0:1789518635.175856:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:2.0:1789518635.178891:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518635.178993:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617333504 00000100:00100000:1.0:1789518635.179007:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617333504 00000100:00100000:1.0:1789518635.179218:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518635.179232:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:33600:x1876445617333504:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:1.0:1789518635.179583:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:33600:x1876445617333504:12345-192.168.206.51@tcp:35:cat.0 Request processed in 353us (703us total) trans 30064771243 rc 0/0 00000100:00100000:1.0:1789518635.179591:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:1.0:1789518635.253228:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518635.253557:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617333760 00000100:00100000:3.0:1789518635.253571:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617333760 00000100:00100000:3.0:1789518635.253798:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:3.0:1789518635.253811:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:33612:x1876445617333760:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518635.253844:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518635.253847:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518635.253881:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c78621c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbc6 expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.253921:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:3.0:1789518635.253936:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518635.253954:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbf0 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.254074:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.254271:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe9 expref: 29 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.254282:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.254335:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe9 expref: 29 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.254350:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe9 expref: 29 pid: 35847 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518635.254366:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627652992:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518635.254500:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1eb3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518635.262687:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627652992:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518635.262727:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518635.263090:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518635.263200:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617333888 00000100:00100000:0.0:1789518635.263209:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617333888 00010000:00010000:0.0:1789518635.263253:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe9 expref: 30 pid: 35847 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518635.263300:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1789518635.263311:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2343:x1876445617333888:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518635.263328:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518635.263336:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe9 expref: 30 pid: 35847 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.263349:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe9 expref: 30 pid: 35847 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.263375:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786293 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe9 expref: 30 pid: 35847 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.263392:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:0.0:1789518635.263398:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.263408:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.263416:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518635.263444:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518635.263522:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2343:x1876445617333888:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 213us (433us total) trans 0 rc 0/0 00010000:00010000:3.0:1789518635.263541:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518635.263542:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00010000:00010000:3.0:1789518635.263567:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518635.263602:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:3.0:1789518635.264558:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf0 expref: 30 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.264593:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf0 expref: 29 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.264602:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:3.0:1789518635.264605:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518635.264608:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17600, rc 0) 00000100:00100000:3.0:1789518635.264697:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:33612:x1876445617333760:12345-192.168.206.51@tcp:101:bash.0 Request processed in 10888us (11481us total) trans 30064771244 rc 0/0 00000100:00100000:3.0:1789518635.264705:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:1.0:1789518635.268122:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518635.268274:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617334144 00000100:00100000:2.0:1789518635.268287:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617334144 00000100:00100000:2.0:1789518635.269604:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 202 00000100:00100000:2.0:1789518635.269642:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:33612:x1876445617334144:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:2.0:1789518635.270115:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.270136:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.270149:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518635.270220:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771245 00000004:00010000:2.0:1789518635.270267:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000621337aa reply state 000000007c9be301 transno 30064771246 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518635.270278:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518635.270562:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:33612:x1876445617334144:12345-192.168.206.51@tcp:36:bash.0 Request processed in 926us (2451us total) trans 30064771246 rc 0/0 00000100:00100000:2.0:1789518635.270570:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 202 00000020:00080000:2.0:1789518635.270577:0:35846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518635.274820:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518635.274842:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518635.274850:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518635.274862:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518635.274868:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518635.274899:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518635.274919:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:1.0:1789518635.274922:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518635.274928:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518635.274933:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7862b6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518635.278657:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518635.278775:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617334272 00000100:00100000:2.0:1789518635.278791:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617334272 00000100:00100000:2.0:1789518635.278862:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:2.0:1789518635.278875:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:33612:x1876445617334272:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518635.278906:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518635.278931:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7862bd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbf7 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.279051:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.279069:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf0 expref: 32 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.279079:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.279121:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf0 expref: 32 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.279137:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf0 expref: 32 pid: 37723 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518635.279179:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627653120:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518635.279286:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8a996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518635.282368:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627653120:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518635.282405:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518635.283843:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518635.284008:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617334400 00000100:00100000:3.0:1789518635.284020:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617334400 00010000:00010000:3.0:1789518635.284071:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf0 expref: 33 pid: 37723 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518635.284223:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:3.0:1789518635.284235:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2343:x1876445617334400:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518635.284272:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518635.284280:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf0 expref: 33 pid: 37723 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.284296:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf0 expref: 33 pid: 37723 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.284322:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862a8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf0 expref: 33 pid: 37723 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.284339:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:3.0:1789518635.284344:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.284355:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.284363:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.284400:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518635.284476:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2343:x1876445617334400:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 243us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518635.284485:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00010000:00010000:2.0:1789518635.284561:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.284570:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518635.284648:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:2.0:1789518635.284654:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518635.284678:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.284727:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7862bd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf7 expref: 32 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.284744:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf7 expref: 31 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518635.284752:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:2.0:1789518635.284755:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518635.284757:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4a00, rc 0) 00000100:00100000:2.0:1789518635.284787:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:33612:x1876445617334272:12345-192.168.206.51@tcp:101:bash.0 Request processed in 5915us (6145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518635.284795:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:2.0:1789518635.291403:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518635.291506:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617334656 00000100:00100000:1.0:1789518635.291518:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617334656 00000100:00100000:1.0:1789518635.291651:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518635.291664:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:33612:x1876445617334656:12345-192.168.206.51@tcp:103:bash.0 00010000:00010000:1.0:1789518635.291685:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789518635.291718:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7862c4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbf7 expref: 31 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518635.291746:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c786262 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbe2 expref: 30 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518635.291758:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:1.0:1789518635.291771:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518635.291831:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:33612:x1876445617334656:12345-192.168.206.51@tcp:103:bash.0 Request processed in 170us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518635.291859:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1789518635.293388:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518635.293460:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617334784 00000100:00100000:3.0:1789518635.293472:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617334784 00000100:00100000:3.0:1789518635.293539:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:3.0:1789518635.293550:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:33612:x1876445617334784:12345-192.168.206.51@tcp:58:bash.0 00010000:00010000:3.0:1789518635.293734:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.293753:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.293766:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518635.294829:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].6, 136 off9008 00000100:00100000:0.0:1789518635.294980:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:33612:x1876445617334784:12345-192.168.206.51@tcp:58:bash.0 Request processed in 1426us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518635.294991:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:2.0:1789518635.302206:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518635.302397:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617334912 00000100:00100000:3.0:1789518635.302409:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617334912 00000100:00100000:3.0:1789518635.302481:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:3.0:1789518635.302493:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:33612:x1876445617334912:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518635.302517:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518635.302552:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862d2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdbfe expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.302666:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.302677:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862d2 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbfe expref: 30 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.302698:0:37723:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.302712:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862d2 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbfe expref: 30 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.302741:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78800) 00010000:00010000:3.0:1789518635.302744:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518635.302749:0:37723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862d2 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbfe expref: 30 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518635.302757:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17600, rc 0) 00000100:00100000:3.0:1789518635.302833:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:33612:x1876445617334912:12345-192.168.206.51@tcp:101:bash.0 Request processed in 342us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518635.302841:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:1.0:1789518635.634882:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518635.634911:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627653248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518635.634999:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518635.635136:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627653248 00000100:00100000:2.0:1789518635.635148:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627653248 00000100:00100000:2.0:1789518635.635227:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518635.635243:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627653248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518635.635261:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627653504:0@lo:400:kworker.0 00002000:00000024:2.0:1789518635.635292:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789518635.635320:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518635.635349:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518635.635355:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627653248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518635.635358:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627653632:0@lo:400:kworker.0 00000100:00100000:2.0:1789518635.635368:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789518635.635391:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518635.635408:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627653504 00000100:00100000:2.0:1789518635.635414:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627653504 00000100:00100000:2.0:1789518635.635441:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627653632 00000100:00100000:2.0:1789518635.635445:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627653632 00000100:00100000:3.0:1789518635.635462:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789518635.635474:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627653504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518635.635478:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789518635.635489:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627653632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518635.635561:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627653632:12345-0@lo:400:kworker.0 Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518635.635570:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789518635.635682:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518635.635688:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518635.635704:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627653376:0@lo:400:kworker.0 00000100:00100000:0.0:1789518635.635737:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627653760:0@lo:400:kworker.0 00000100:00100000:1.0:1789518635.635741:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518635.635783:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518635.635786:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771094 gen 2 00000004:00080000:1.0:1789518635.635793:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771094 committed transno 30064771094 00000100:00100000:0.0:1789518635.635820:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627653760 00000100:00100000:0.0:1789518635.635825:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627653760 00000100:00100000:1.0:1789518635.635828:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627653248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518635.635858:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627653376 00000100:00100000:1.0:1789518635.635862:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627653376 00000100:00100000:0.0:1789518635.635866:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789518635.635876:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627653760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518635.635898:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789518635.635908:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627653376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518635.635924:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627653760:12345-0@lo:400:kworker.0 Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518635.635932:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518635.635953:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627653376:12345-0@lo:400:kworker.0 Request processed in 46us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518635.635960:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789518635.635968:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627653760:0@lo:400:kworker.0 00000100:00080000:1.0:1789518635.635999:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518635.636019:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627653376:0@lo:400:kworker.0 00000100:00100000:3.0:1789518635.637153:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627653504:12345-0@lo:400:kworker.0 Request processed in 1675us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518635.637166:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789518635.638585:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627653632:0@lo:400:kworker.0 00000100:00100000:2.0:1789518635.638633:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627653504:0@lo:400:kworker.0 00010000:00010000:0.0:1789518635.896902:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518636.146900:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518636.146909:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518636.146992:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:3.0:1789518636.147004:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518636.147179:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1a1dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627653888:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518636.148101:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1eb39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518636.150274:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1a1dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627653888:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789518636.152013:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.152093:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617335040 00000100:00100000:0.0:1789518636.152106:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617335040 00000100:00080000:3.0:1789518636.152179:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518636.152199:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:0.0:1789518636.152212:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:33613:x1876445617335040:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518636.152250:0:35846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518636.152375:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:33613:x1876445617335040:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 165us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518636.152384:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:2.0:1789518636.158450:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.158493:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617335168 00000100:00100000:0.0:1789518636.158507:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617335168 00000100:00100000:0.0:1789518636.158589:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:0.0:1789518636.158601:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:33613:x1876445617335168:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789518636.158723:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158748:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158767:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158784:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158791:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158795:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158818:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158824:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158828:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518636.158866:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:0.0:1789518636.158870:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518636.158882:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158894:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158900:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158907:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158914:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518636.158920:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158930:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158944:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:0.0:1789518636.158948:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518636.158954:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158960:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7862d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158973:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158980:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158985:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.158990:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518636.158993:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159000:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159007:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb4468db5 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518636.159010:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518636.159013:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159025:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7862e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159105:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159112:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159168:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159173:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518636.159176:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159183:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159190:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78800) 00010000:00010000:0.0:1789518636.159193:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518636.159196:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.159202:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c7862e7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518636.159290:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:33613:x1876445617335168:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 691us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518636.159299:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:3.0:1789518636.163172:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.163550:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617335424 00000100:00100000:0.0:1789518636.163564:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617335424 00000100:00100000:0.0:1789518636.163679:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 208 00000100:00100000:1.0:1789518636.163770:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:33613:x1876445617335424:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518636.163801:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518636.163828:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7862ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc05 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164033:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164052:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164066:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518636.164079:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00010000:00010000:1.0:1789518636.164240:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164249:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164257:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164263:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518636.164269:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164278:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164293:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78800) 00010000:00010000:1.0:1789518636.164297:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518636.164308:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164327:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c7862f5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164377:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7862ee lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc05 expref: 32 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164388:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518636.164391:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518636.164395:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7862ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc05 expref: 32 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.164407:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:1.0:1789518636.164549:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:33613:x1876445617335424:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 859us (1389us total) trans 30064771247 rc 301/301 00000100:00100000:1.0:1789518636.164558:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 208 00000100:00100000:3.0:1789518636.168118:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.168304:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617335552 00000100:00100000:2.0:1789518636.168315:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617335552 00000100:00100000:2.0:1789518636.168428:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:2.0:1789518636.168441:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:33613:x1876445617335552:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518636.168484:0:37723:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518636.168645:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:33613:x1876445617335552:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 206us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.168668:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:3.0:1789518636.171848:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518636.171914:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617335680 00000100:00100000:1.0:1789518636.171927:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617335680 00000100:00100000:1.0:1789518636.171992:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:1.0:1789518636.172004:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:33613:x1876445617335680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518636.172030:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518636.172058:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786303 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc0c expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.172270:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78630a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.172288:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78630a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.172316:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78630a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518636.172362:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518636.172544:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518636.172575:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78630a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.173074:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786303 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc0c expref: 33 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.173109:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78630a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc0c expref: 32 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.173119:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:1.0:1789518636.173122:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518636.173127:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:1.0:1789518636.173387:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:33613:x1876445617335680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1382us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518636.173396:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:2.0:1789518636.177078:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518636.177372:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617335936 00000100:00100000:3.0:1789518636.177386:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617335936 00000100:00100000:3.0:1789518636.177455:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:3.0:1789518636.177467:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:33613:x1876445617335936:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518636.177492:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518636.177496:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518636.177712:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78630a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc0c expref: 32 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.177735:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:3.0:1789518636.177750:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518636.177769:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786311 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc13 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518636.180132:0:35845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc5:0x0], index 1: 0 00010000:00010000:3.0:1789518636.180464:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786318 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.180485:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786318 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.180510:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786318 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.180602:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786311 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc13 expref: 34 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.180656:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786318 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc13 expref: 33 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.180666:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:3.0:1789518636.180670:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518636.180674:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:3.0:1789518636.180756:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:33613:x1876445617335936:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 3289us (3691us total) trans 30064771248 rc 0/0 00000100:00100000:3.0:1789518636.180766:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:2.0:1789518636.184024:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518636.184105:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617336064 00000100:00100000:3.0:1789518636.184117:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617336064 00000100:00100000:3.0:1789518636.184196:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:3.0:1789518636.184208:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:33613:x1876445617336064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518636.184235:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518636.184263:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c786326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc1a expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.184347:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78632d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.184365:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78632d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.184395:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78632d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518636.184439:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518636.184444:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518636.184466:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78632d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.184496:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c786326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc1a expref: 35 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.184517:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78632d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc1a expref: 34 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.184539:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518636.184542:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518636.184546:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:3.0:1789518636.184640:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:33613:x1876445617336064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 407us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518636.184649:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:3.0:1789518636.187701:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.188734:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617336320 00000100:00100000:2.0:1789518636.188755:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617336320 00000100:00100000:2.0:1789518636.188830:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:2.0:1789518636.188842:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:33613:x1876445617336320:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518636.188913:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789518636.189008:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786318 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc13 expref: 34 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189031:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:2.0:1789518636.189050:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78632d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc1a expref: 33 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189058:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518636.189063:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518636.189100:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189116:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189128:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189142:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189164:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189171:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189390:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189399:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189405:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189411:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518636.189417:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189425:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189434:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12100) 00010000:00010000:2.0:1789518636.189437:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518636.189441:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189447:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786334 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189461:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189474:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189481:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189486:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518636.189489:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189496:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189504:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4fb7bd29 (ffff99fec3b12e00) 00010000:00010000:2.0:1789518636.189507:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518636.189510:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.189516:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78633b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4fb7bd29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518636.189705:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:33613:x1876445617336320:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 863us (2016us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518636.189714:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 213 00000001:00080000:1.0:1789518636.193588:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771241 is committed 00000020:00080000:1.0:1789518636.193798:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803896 batchid updated 00000001:00080000:1.0:1789518636.193819:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771243 is committed 00000001:00080000:1.0:1789518636.193829:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771246 is committed 00000004:00080000:1.0:1789518636.193839:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789518636.193856:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc33873c0 refcount 2 committed 0 result 0 batchid 25769803897 00000020:00080000:1.0:1789518636.193861:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fff7a6be40 00000020:00080000:1.0:1789518636.193881:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc5521400 00000020:00080000:0.0:1789518636.194178:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803897 committed batchid 25769803896 00000100:00100000:3.0:1789518636.194366:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518636.194373:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518636.194393:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627654016:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1789518636.194423:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803896 00000100:00100000:3.0:1789518636.194458:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518636.194562:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627654016 00000100:00100000:2.0:1789518636.194572:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627654016 00000100:00100000:2.0:1789518636.194655:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789518636.194666:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627654016:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789518636.194713:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617336448 00002000:00080000:2.0:1789518636.194716:0:36533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:197 count 1 00000100:00100000:3.0:1789518636.194719:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617336448 00002000:00010000:2.0:1789518636.194758:0:36533:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc5:0x0] initial LVB size: 6, mtime: 0x6aa9e32b, atime: 0x6aa9e32b, ctime: 0x6aa9e32b, blocks: 0x1 00000100:00100000:3.0:1789518636.194760:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 214 00010000:00010000:2.0:1789518636.194770:0:36533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518636.194773:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:33613:x1876445617336448:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518636.194792:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=690s v=(0 0) 00010000:00010000:2.0:1789518636.194799:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518636.194800:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518636.194809:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.194822:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786349 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc21 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.194827:0:36533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.194840:0:36533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.194849:0:36533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.194868:0:36533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518636.194882:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518636.194892:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.194902:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518636.194908:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.194921:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.194942:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.194951:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f0d8f30/0x631fd8698c786342 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.194974:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518636.194977:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518636.194979:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518636.195028:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c786350 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.195044:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c786350 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.195055:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c786350 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.195160:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786349 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc21 expref: 14 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.195179:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17800/0x631fd8698c786350 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc21 expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.195187:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:3.0:1789518636.195191:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518636.195195:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17800, rc 0) 00000100:00100000:3.0:1789518636.195272:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:33613:x1876445617336448:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 501us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518636.195282:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 214 00000004:00080000:3.0:1789518636.195987:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffefff2300/2, rc 0, transno 30064771092 00000100:00100000:3.0:1789518636.195995:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627654016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518636.196798:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627654016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 812us (1016us total) trans 30064771092 rc 0/0 00000100:00100000:2.0:1789518636.196816:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789518636.200786:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.200879:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617336704 00000100:00100000:0.0:1789518636.200892:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617336704 00000100:00100000:0.0:1789518636.200963:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:0.0:1789518636.200974:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:33613:x1876445617336704:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518636.201078:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.201707:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.201726:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518636.203057:0:35845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].7, 88 off8736 00000004:00080000:1.0:1789518636.203072:0:35845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690199457602ns, next at 691199454112ns, rc = 0 00000004:00010000:1.0:1789518636.203323:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c56ffb4 reply state 00000000d98ed409 transno 30064771249 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518636.203337:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518636.203657:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:33613:x1876445617336704:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 2637us (2837us total) trans 30064771249 rc 0/0 00000100:00100000:1.0:1789518636.203668:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:0.0:1789518636.206884:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518636.207009:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617336832 00000100:00100000:1.0:1789518636.207022:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617336832 00010000:00010000:3.0:1789518636.207093:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.207108:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518636.207109:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 216 00010000:00010000:3.0:1789518636.207120:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.207129:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bda00 already unused, calling callback (ffffffffc1f3e4f0) 00000100:00100000:1.0:1789518636.207135:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:33613:x1876445617336832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518636.207137:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.207150:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.207168:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:1.0:1789518636.207169:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518636.207174:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518636.207181:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.207190:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786357 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.207200:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc28 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.207281:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc28 expref: 15 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.207298:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc28 expref: 15 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.207319:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:1.0:1789518636.207322:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518636.207325:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:1.0:1789518636.207406:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:33613:x1876445617336832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 280us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518636.207414:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 216 00000100:00100000:2.0:1789518636.211050:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.211249:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617336960 00000100:00100000:0.0:1789518636.211262:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617336960 00000100:00080000:3.0:1789518636.211388:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518636.211430:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:0.0:1789518636.211451:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617336960:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789518636.211924:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617336960:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 483us (887us total) trans 30064771095 rc 0/0 00000100:00100000:0.0:1789518636.211932:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1789518636.213864:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.213946:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617337216 00000100:00100000:0.0:1789518636.213956:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617337216 00000100:00100000:0.0:1789518636.214016:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:0.0:1789518636.214026:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:33613:x1876445617337216:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518636.214314:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:33613:x1876445617337216:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 288us (460us total) trans 30064771250 rc 0/0 00000100:00100000:0.0:1789518636.214322:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1789518636.216078:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.216666:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617337472 00000100:00100000:2.0:1789518636.216678:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617337472 00000100:00100000:2.0:1789518636.216748:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:2.0:1789518636.216781:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:33613:x1876445617337472:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518636.216912:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:33613:x1876445617337472:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 135us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.216920:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:2.0:1789518636.218839:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518636.219228:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617337600 00000100:00100000:1.0:1789518636.219240:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617337600 00000100:00100000:1.0:1789518636.219306:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 218 00000100:00100000:1.0:1789518636.219319:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:33613:x1876445617337600:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518636.219362:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518636.219390:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786365 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc2f expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.219477:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78636c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.219493:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78636c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.219506:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78636c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518636.219564:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518636.219597:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78636c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.220247:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786365 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc2f expref: 18 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.220273:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78636c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc2f expref: 17 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.220284:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:1.0:1789518636.220288:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518636.220292:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6000, rc 0) 00000100:00100000:1.0:1789518636.220375:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:33613:x1876445617337600:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1058us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518636.220383:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 218 00000100:00100000:3.0:1789518636.223310:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.223423:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617337728 00000100:00100000:2.0:1789518636.223435:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617337728 00000100:00100000:2.0:1789518636.223508:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:2.0:1789518636.223520:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617337728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518636.223555:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518636.223583:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc36 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518636.223652:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e32c, blocks: 0x1 00010000:00010000:2.0:1789518636.223677:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=690s v=(0 0) 00010000:00010000:2.0:1789518636.223683:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518636.223694:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc36 expref: 8 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.223718:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc36 expref: 8 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.223733:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4e00, rc 0) 00000100:00100000:2.0:1789518636.223819:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617337728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 300us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.223846:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1789518636.225857:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.225961:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617337984 00000100:00100000:2.0:1789518636.225974:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617337984 00000100:00100000:2.0:1789518636.226031:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:2.0:1789518636.226040:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:33613:x1876445617337984:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518636.226311:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:33613:x1876445617337984:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 270us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.226318:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:0.0:1789518636.228545:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.228644:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617338112 00000100:00100000:2.0:1789518636.228657:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617338112 00000100:00100000:2.0:1789518636.228764:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:2.0:1789518636.228776:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:33613:x1876445617338112:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789518636.258937:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771250 is committed 00000020:00080000:2.0:1789518636.258960:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803897 batchid updated 00000004:00080000:2.0:1789518636.258986:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789518636.259018:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803897 00000020:00080000:0.0:1789518636.259039:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803897 00000100:00100000:0.0:1789518636.259354:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518636.259380:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627654144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518636.259467:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518636.259604:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627654144 00000100:00100000:3.0:1789518636.259645:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627654144 00000100:00100000:3.0:1789518636.259704:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789518636.259729:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627654144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789518636.259928:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789518636.259933:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789518636.259936:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789518636.259938:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb ctime from disk: 1789518636 -> 1789518636 00002000:00010000:3.0:1789518636.259941:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789518636.260028:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:33613:x1876445617338112:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 31251us (31500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518636.260040:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 220 00000004:00080000:0.0:1789518636.260053:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec3477b80/2, rc 0, transno 30064771096 00000100:00100000:0.0:1789518636.260063:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627654144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518636.260557:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627654144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 828us (1088us total) trans 30064771096 rc 0/0 00000100:00100000:3.0:1789518636.260565:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789518636.262761:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.262948:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617338240 00000100:00100000:0.0:1789518636.262960:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617338240 00000100:00100000:0.0:1789518636.263035:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1789518636.263047:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617338240:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789518636.263352:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617338240:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 307us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518636.263362:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1789518636.267098:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.268134:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617338496 00000100:00100000:2.0:1789518636.268148:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617338496 00000100:00100000:2.0:1789518636.268233:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:2.0:1789518636.268255:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:33613:x1876445617338496:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518636.268334:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518636.268372:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c78636c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc2f expref: 13 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.268396:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:2.0:1789518636.268403:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518636.268457:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.268476:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.268489:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518636.268824:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3f169a0 reply state 00000000eb12350c transno 30064771251 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518636.268835:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518636.268981:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:33613:x1876445617338496:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 737us (1895us total) trans 30064771251 rc 0/0 00000100:00100000:2.0:1789518636.268989:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 221 00010000:00010000:2.0:1789518636.270948:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.270967:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.270977:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.270984:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518636.270990:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.271000:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.271016:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:2.0:1789518636.271034:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518636.271052:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.271060:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5e00/0x631fd8698c78637a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518636.271235:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.271293:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617338624 00000100:00100000:2.0:1789518636.271304:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617338624 00000100:00100000:2.0:1789518636.271366:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1789518636.271378:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617338624:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518636.271647:0:36531:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789518636.271652:0:36531:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 1789518635 00002000:00010000:2.0:1789518636.271654:0:36531:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb atime from disk: 0 -> 1789518635 00002000:00010000:2.0:1789518636.271657:0:36531:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb ctime from disk: 1789518636 -> 1789518635 00002000:00010000:2.0:1789518636.271659:0:36531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518636.271725:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617338624:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 348us (493us total) trans 30064771097 rc 0/0 00000100:00100000:2.0:1789518636.271737:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518636.274471:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518636.274582:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617338752 00000100:00100000:3.0:1789518636.274595:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617338752 00000100:00100000:3.0:1789518636.274787:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1789518636.274799:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617338752:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789518636.274853:0:36533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.274874:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518636.274879:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518636.274885:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.274903:0:36533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.274938:0:36533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.274971:0:36533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.274981:0:36533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.274988:0:36533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518636.274993:0:36533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.275003:0:36533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.275020:0:36533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.275028:0:36533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8f0426e/0x631fd8698c786381 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518636.275129:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617338752:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 331us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518636.275141:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:2.0:1789518636.277308:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518636.277368:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617339008 00000100:00100000:1.0:1789518636.277377:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617339008 00000100:00100000:1.0:1789518636.277427:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 222 00000100:00100000:1.0:1789518636.277435:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:33613:x1876445617339008:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518636.277522:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.277551:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.277566:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.277845:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.277863:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc28 expref: 14 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.277872:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.277913:0:35847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc28 expref: 14 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.277940:0:35847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc28 expref: 14 pid: 35847 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518636.278001:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627654272:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518636.278125:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518636.279986:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.280166:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617339136 00000100:00100000:2.0:1789518636.280177:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617339136 00010000:00010000:2.0:1789518636.280226:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc28 expref: 15 pid: 35847 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518636.280241:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627654272:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518636.280274:0:35847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518636.280276:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1789518636.280288:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1082450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617339136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518636.280311:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518636.280327:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc28 expref: 15 pid: 35847 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.280340:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc28 expref: 15 pid: 35847 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.280367:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c78635e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc28 expref: 15 pid: 35847 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.280385:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:2.0:1789518636.280391:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.280401:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.280409:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.280436:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518636.280463:0:35847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.280472:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518636.280503:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1082450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617339136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 217us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.280513:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000001:00080000:3.0:1789518636.280758:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771252 00000001:00080000:3.0:1789518636.280987:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771253 00000001:00080000:3.0:1789518636.281038:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771254 00000100:00100000:3.0:1789518636.281156:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3474380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627654400:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789518636.281210:0:35847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518636.281245:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1eb30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518636.281325:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627654400 00000100:00100000:0.0:1789518636.281330:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627654400 00000100:00100000:0.0:1789518636.281362:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789518636.281367:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35847:x1876445627654400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518636.281454:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35847:x1876445627654400:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518636.281465:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789518636.281497:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3474380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627654400:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789518636.281999:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771255 00000100:00100000:1.0:1789518636.282220:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627654528:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789518636.282258:0:35847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518636.282325:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627654528 00000100:00100000:0.0:1789518636.282331:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627654528 00000100:00100000:1.0:1789518636.282333:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518636.282368:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789518636.282376:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35847:x1876445627654528:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518636.282554:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:35847:x1876445627654528:12345-0@lo:1000:mdt00_002.0 Request processed in 178us (294us total) trans 30064771098 rc 0/0 00000100:00100000:0.0:1789518636.282562:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789518636.282786:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627654528:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789518636.282826:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282836:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282845:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282852:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518636.282857:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282865:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282893:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:1.0:1789518636.282896:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518636.282902:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282908:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78638f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282935:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282942:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282947:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282951:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518636.282954:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282959:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282966:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78800) 00010000:00010000:1.0:1789518636.282968:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518636.282975:0:35847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862d2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbfe expref: 17 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.282986:0:35847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862d2 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbfe expref: 17 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.283001:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862d2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbfe expref: 17 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.283029:0:35847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17600/0x631fd8698c7862d2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdbfe expref: 17 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518636.283041:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627654656:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518636.283250:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518636.285316:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627654656:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518636.285350:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285361:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7862cb lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285402:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285416:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285429:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285441:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285449:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285478:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285484:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518636.285490:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285499:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285513:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78800) 00010000:00010000:1.0:1789518636.285516:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518636.285520:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518636.285673:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518636.285699:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786396 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285713:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285720:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285725:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285730:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518636.285733:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285753:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285763:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78800) 00010000:00010000:1.0:1789518636.285765:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518636.285769:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.285778:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786388 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518636.285995:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617339264 00000100:00100000:2.0:1789518636.286005:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617339264 00000100:00100000:2.0:1789518636.286156:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:2.0:1789518636.286183:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:33612:x1876445617339264:12345-192.168.206.51@tcp:49:bash.0 00000040:00080000:3.0:1789518636.286235:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518636.286244:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518636.286290:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:3.0:1789518636.286298:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518636.286306:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:33612:x1876445617339264:12345-192.168.206.51@tcp:49:bash.0 Request processed in 123us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.286328:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1789518636.286411:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:33613:x1876445617339008:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 8638us (8776us total) trans 30064771256 rc 0/0 00000100:00100000:1.0:1789518636.286422:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 222 00000020:00080000:1.0:1789518636.286426:0:35847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789518636.288374:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.288432:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617339520 00000100:00100000:0.0:1789518636.288442:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617339520 00000100:00100000:0.0:1789518636.288491:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1789518636.288498:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:33613:x1876445617339520:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789518636.289365:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789518636.289497:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771257 00010000:00010000:0.0:1789518636.289573:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.289594:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.289608:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.289656:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.289663:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.289671:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518636.289691:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789518636.289812:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:33613:x1876445617339520:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1310us (1445us total) trans 30064771258 rc 0/0 00000100:00100000:0.0:1789518636.289822:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000020:00080000:0.0:1789518636.289828:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518636.289921:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518636.289930:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.289938:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518636.289942:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.289951:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.289966:0:36743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff99ffeaa78d00) 00010000:00010000:2.0:1789518636.289969:0:36743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518636.289975:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.289980:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78639d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.289993:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518636.289994:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518636.289996:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518636.290012:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.290271:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617339648 00000100:00100000:2.0:1789518636.290280:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617339648 00000100:00100000:2.0:1789518636.290334:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518636.290344:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:33612:x1876445617339648:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518636.290362:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518636.290377:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8bcc031/0x631fd8698c7863a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc3d expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.290419:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc36 expref: 10 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.290430:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518636.290436:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518636.290441:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bcc031/0x631fd8698c7863a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc3d expref: 10 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.290480:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc36 expref: 10 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.290494:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc36 expref: 10 pid: 36531 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518636.290511:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:36532:1876445627654784:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518636.290604:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7a43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789518636.292369:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:36532:1876445627654784:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518636.292405:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8bcc031/0x631fd8698c7863a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc3d expref: 10 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.292427:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5e00, rc 0) 00000100:00100000:2.0:1789518636.292487:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:33612:x1876445617339648:12345-192.168.206.51@tcp:101:bash.0 Request processed in 2143us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.292497:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:3.0:1789518636.292634:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518636.292670:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617339776 00000100:00100000:1.0:1789518636.292679:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617339776 00010000:00010000:1.0:1789518636.292729:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc36 expref: 10 pid: 36531 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518636.292762:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1789518636.292772:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617339776:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518636.292785:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518636.292813:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc36 expref: 10 pid: 36531 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.292838:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc36 expref: 10 pid: 36531 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.292863:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024cf40d2/0x631fd8698c786373 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc36 expref: 10 pid: 36531 timeout: 790 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.292878:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518636.292883:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518636.292891:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8bcc031/0x631fd8698c7863a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc3d expref: 9 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.292903:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8bcc031/0x631fd8698c7863a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc3d expref: 9 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.292948:0:35830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b8bcc031/0x631fd8698c7863a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc3d expref: 9 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518636.292972:0:35830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35830:1876445627654912:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518636.293028:0:35830:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518636.295021:0:35830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35830:1876445627654912:192.168.206.51@tcp:105: 00010000:00010000:0.0:1789518636.295047:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518636.295181:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617339776:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2409us (2571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518636.295191:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1789518636.295338:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518636.295496:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617340032 00000100:00100000:3.0:1789518636.295503:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617340032 00000100:00100000:3.0:1789518636.295653:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:2.0:1789518636.295809:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:33612:x1876445617340032:12345-192.168.206.51@tcp:35:bash.0 00000001:00080000:2.0:1789518636.296341:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771259 00000001:00080000:2.0:1789518636.296427:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771260 00000100:00100000:2.0:1789518636.296551:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:33612:x1876445617340032:12345-192.168.206.51@tcp:35:bash.0 Request processed in 887us (1212us total) trans 30064771261 rc 0/0 00000100:00100000:2.0:1789518636.296560:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000020:00080000:2.0:1789518636.296565:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789518636.355284:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518636.355368:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617340160 00000100:00100000:1.0:1789518636.355382:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617340160 00000100:00100000:1.0:1789518636.355444:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:1.0:1789518636.355542:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:33623:x1876445617340160:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518636.355584:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518636.355607:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7863ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc44 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.355711:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7863b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.355725:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7863b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.355739:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7863b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518636.355773:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518636.355777:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518636.355793:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7863b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.355817:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7863ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc44 expref: 24 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.355908:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7863b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc44 expref: 23 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518636.355917:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:1.0:1789518636.355920:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518636.355923:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:1.0:1789518636.356118:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:33623:x1876445617340160:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 663us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518636.356136:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:1.0:1789518636.359939:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.360047:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617340288 00000100:00100000:2.0:1789518636.360056:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617340288 00000100:00100000:2.0:1789518636.360110:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:2.0:1789518636.360120:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:33623:x1876445617340288:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518636.360200:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360217:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360229:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360245:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360252:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360258:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360493:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360502:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360509:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518636.360559:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360573:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360580:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360587:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360592:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518636.360597:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360604:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360917:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:2.0:1789518636.360920:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518636.360925:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360938:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7863b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360951:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360956:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360962:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360967:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518636.360970:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360976:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360984:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff99fec3b12900) 00010000:00010000:2.0:1789518636.360987:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518636.360990:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.360996:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7863c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.361012:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.361019:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.361031:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.361036:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518636.361039:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.361045:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.361053:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78800) 00010000:00010000:2.0:1789518636.361056:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518636.361059:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518636.361064:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7863c7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518636.361149:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:33623:x1876445617340288:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1029us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.361156:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:2.0:1789518636.408951:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518636.409087:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617340544 00000100:00100000:3.0:1789518636.409102:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617340544 00000100:00100000:3.0:1789518636.410276:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:3.0:1789518636.410305:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:33630:x1876445617340544:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:3.0:1789518636.410337:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518636.410361:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7863ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc4b expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.410479:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.410496:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.410510:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.411056:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.411067:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.411076:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.411858:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7863e3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.411870:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7863e3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.411877:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7863e3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518636.411888:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 12 00010000:00010000:3.0:1789518636.411984:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412002:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412009:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412016:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518636.412021:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412029:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412041:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:3.0:1789518636.412043:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518636.412048:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412053:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412065:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412071:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412077:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412082:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518636.412090:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412097:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412104:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff99ffeaa78100) 00010000:00010000:3.0:1789518636.412107:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518636.412110:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412115:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412160:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7863ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc4b expref: 26 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412553:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16000/0x631fd8698c7863e3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc4b expref: 25 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518636.412562:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff99ffeaa78800) 00010000:00010000:3.0:1789518636.412564:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518636.412567:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16000, rc 0) 00000100:00100000:3.0:1789518636.412691:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:33630:x1876445617340544:12345-192.168.206.51@tcp:101:cat.0 Request processed in 2398us (3757us total) trans 30064771262 rc 0/0 00000100:00100000:3.0:1789518636.412699:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:0.0:1789518636.416076:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.416183:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617340800 00000100:00100000:2.0:1789518636.416195:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617340800 00000100:00100000:2.0:1789518636.416254:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1789518636.416263:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:33630:x1876445617340800:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:2.0:1789518636.416539:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:33630:x1876445617340800:12345-192.168.206.51@tcp:35:cat.0 Request processed in 276us (475us total) trans 30064771263 rc 0/0 00000100:00100000:2.0:1789518636.416564:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00010000:00010000:3.0:1789518636.917913:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518636.941056:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.941159:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617340928 00000100:00100000:0.0:1789518636.941170:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617340928 00000100:00100000:3.0:1789518636.941222:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.941234:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:0.0:1789518636.941245:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617340928:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518636.941265:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.941313:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617340928:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518636.941320:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:3.0:1789518636.941388:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617341056 00000100:00100000:3.0:1789518636.941394:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617341056 00000100:00100000:3.0:1789518636.941435:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518636.941444:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2342:x1876445617341056:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518636.941500:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2342:x1876445617341056:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 57us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518636.941507:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518636.941575:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.941653:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.941667:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617341184 00000100:00100000:0.0:1789518636.941672:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617341184 00000100:00100000:2.0:1789518636.941679:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518636.941701:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518636.941707:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617341312 00000100:00100000:0.0:1789518636.941709:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617341312 00000100:00100000:2.0:1789518636.941717:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617341568 00000100:00100000:2.0:1789518636.941720:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617341568 00000100:00100000:0.0:1789518636.941721:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617341696 00000100:00100000:0.0:1789518636.941723:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617341696 00000100:00100000:0.0:1789518636.941737:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1789518636.941743:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617341184:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518636.941776:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617341184:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.941811:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1789518636.941820:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617341312:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518636.941850:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617341312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.941857:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:0.0:1789518636.941863:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1789518636.941871:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1789518636.941874:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518636.941877:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617341696:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518636.941880:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617341568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518636.941901:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617341696:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518636.941906:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:3.0:1789518636.942005:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617341440 00000100:00100000:3.0:1789518636.942010:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617341440 00000100:00100000:3.0:1789518636.942358:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1789518636.942367:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617341440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518636.942435:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617341568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 553us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518636.942443:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617341440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518636.942449:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1789518636.942458:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00080000:3.0:1789518636.942494:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518636.942499:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518636.942502:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789518637.724332:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771090 is committed 00000001:00080000:0.0:1789518637.724358:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771092 is committed 00010000:00010000:1.0:1789518637.938740:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518638.962831:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518639.029163:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518639.029241:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617341824 00000100:00100000:2.0:1789518639.029250:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617341824 00000100:00100000:2.0:1789518639.029326:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 226 00000100:00100000:2.0:1789518639.029337:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:33569:x1876445617341824:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789518639.029438:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:33569:x1876445617341824:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518639.029462:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 226 00000100:00080000:3.0:1789518639.029533:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518639.032803:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518639.036690:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617342080 00000100:00100000:2.0:1789518639.036705:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617342080 00000100:00100000:2.0:1789518639.036773:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:2.0:1789518639.036783:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:33569:x1876445617342080:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518639.037193:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:33569:x1876445617342080:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 410us (4397us total) trans 30064771264 rc 0/0 00000100:00100000:2.0:1789518639.037202:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000001:02000400:2.0:1789518639.921007:0:38837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 9: Test -ENOSPC tolerance on loop PCC device for RW-PCC ========================================================== 20:30:39 (1789518639) 00010000:00010000:3.0:1789518639.987784:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518640.243129:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627655040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518640.243205:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518640.244055:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627655040 00000100:00100000:0.0:1789518640.244064:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627655040 00000100:00100000:0.0:1789518640.244140:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518640.244151:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627655040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518640.244188:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789518640.244258:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627655040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518640.244265:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789518640.244357:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518640.244485:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771092 gen 2 00000004:00080000:1.0:1789518640.244491:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771091 committed transno 30064771092 00000004:00080000:1.0:1789518640.244525:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffefff2300, transno 30064771092 00000100:00100000:1.0:1789518640.244550:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627655040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518640.589415:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518640.589496:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617342336 00000100:00100000:3.0:1789518640.589516:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617342336 00000100:00100000:3.0:1789518640.589727:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:3.0:1789518640.589738:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:34321:x1876445617342336:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518640.589760:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518640.589779:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7863f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc52 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.589865:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.589879:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.589892:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.589906:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.589914:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.589920:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590132:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786406 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590141:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786406 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590148:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786406 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518640.590158:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789518640.590249:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590266:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590272:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590278:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518640.590286:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590294:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590306:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:3.0:1789518640.590309:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518640.590314:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590319:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7863f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590330:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590335:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590340:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590344:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518640.590353:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590359:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590366:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffeaa78000) 00010000:00010000:3.0:1789518640.590368:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518640.590370:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590375:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7863ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590772:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7863f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc52 expref: 30 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590786:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786406 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc52 expref: 29 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.590793:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:3.0:1789518640.590795:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518640.590798:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:3.0:1789518640.591186:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:34321:x1876445617342336:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1449us (1778us total) trans 30064771265 rc 0/0 00000100:00100000:3.0:1789518640.591194:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:3.0:1789518640.595032:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518640.595131:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.595381:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617342464 00000100:00100000:2.0:1789518640.595390:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617342464 00000100:00100000:2.0:1789518640.595452:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 228 00000100:00100000:2.0:1789518640.595462:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:34321:x1876445617342464:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789518640.595729:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:34321:x1876445617342464:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 267us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518640.595737:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 228 00000100:00100000:0.0:1789518640.596157:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617342592 00000100:00100000:0.0:1789518640.596229:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617342592 00000100:00100000:0.0:1789518640.596305:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518640.596312:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617342592:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518640.596321:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518640.596337:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786406 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc52 expref: 29 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.596349:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:0.0:1789518640.596352:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518640.596375:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2342:x1876445617342592:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 64us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518640.596382:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:0.0:1789518640.679785:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.679922:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617342848 00000100:00100000:2.0:1789518640.679934:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617342848 00000100:00100000:2.0:1789518640.680023:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:2.0:1789518640.680034:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:34336:x1876445617342848:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:2.0:1789518640.680055:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518640.680070:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518640.680100:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7863b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc44 expref: 28 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.680120:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:2.0:1789518640.680131:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518640.680146:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786414 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc59 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.680807:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.680819:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.680826:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.680834:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.680838:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.680842:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518640.681837:0:35846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc6:0x0], index 0: 0 00010000:00010000:2.0:1789518640.682103:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786429 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682115:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786429 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682130:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786429 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682370:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682378:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682385:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682390:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518640.682395:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682403:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682413:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:2.0:1789518640.682416:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518640.682419:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682425:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c78641b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518640.682437:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8ed5bff reply state 00000000a5568c45 transno 30064771266 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518640.682446:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518640.682483:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786414 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc59 expref: 30 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682514:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786429 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc59 expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.682522:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:2.0:1789518640.682524:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518640.682527:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4600, rc 0) 00000100:00100000:2.0:1789518640.682661:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:34336:x1876445617342848:12345-192.168.206.51@tcp:101:touch.0 Request processed in 2628us (2882us total) trans 30064771266 rc 0/0 00000100:00100000:2.0:1789518640.682669:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 229 00010000:00010000:0.0:1789518640.684690:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.684704:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.684711:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.684717:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518640.684721:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.684729:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.684741:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff99fec3b12500) 00010000:00010000:0.0:1789518640.684744:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518640.684749:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.684755:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786422 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518640.685948:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.685984:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617343104 00000100:00100000:2.0:1789518640.685993:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617343104 00000100:00100000:2.0:1789518640.686057:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:2.0:1789518640.686067:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:34336:x1876445617343104:12345-192.168.206.51@tcp:36:touch.0 00010000:00010000:2.0:1789518640.686126:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518640.686145:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786429 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc59 expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.686159:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:2.0:1789518640.686167:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518640.686227:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.686240:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.686249:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518640.686795:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099969a94 reply state 000000005400f309 transno 30064771267 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518640.686805:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518640.686950:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:34336:x1876445617343104:12345-192.168.206.51@tcp:36:touch.0 Request processed in 874us (1000us total) trans 30064771267 rc 0/0 00000100:00100000:2.0:1789518640.686958:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:3.0:1789518640.690135:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:2.0:1789518640.690276:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.690295:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.690303:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.690309:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518640.690314:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.690321:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.690335:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:2.0:1789518640.690338:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518640.690343:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.690358:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c786437 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518640.690847:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617343232 00000100:00100000:1.0:1789518640.690856:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617343232 00000100:00100000:1.0:1789518640.690935:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:1.0:1789518640.690946:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:34336:x1876445617343232:12345-192.168.206.51@tcp:101:touch.0 00010000:00010000:1.0:1789518640.690967:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518640.690985:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc60 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518640.691036:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc60 expref: 30 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518640.691050:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc60 expref: 30 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518640.691068:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99ffc6733800) 00010000:00010000:1.0:1789518640.691071:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518640.691073:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6400, rc 0) 00000100:00100000:1.0:1789518640.691132:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:34336:x1876445617343232:12345-192.168.206.51@tcp:101:touch.0 Request processed in 189us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518640.691147:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:3.0:1789518640.694136:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.694282:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617343360 00000100:00100000:2.0:1789518640.694291:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617343360 00000100:00100000:2.0:1789518640.694395:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:2.0:1789518640.694405:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2343:x1876445617343360:12345-192.168.206.51@tcp:2:touch.0 00000100:00100000:2.0:1789518640.694802:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617343360:12345-192.168.206.51@tcp:2:touch.0 Request processed in 398us (675us total) trans 30064771093 rc 0/0 00000100:00100000:2.0:1789518640.694810:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00080000:3.0:1789518640.695513:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518640.697197:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.697584:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617343616 00000100:00100000:2.0:1789518640.697593:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617343616 00000100:00100000:2.0:1789518640.697649:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:2.0:1789518640.697658:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:34336:x1876445617343616:12345-192.168.206.51@tcp:35:touch.0 00000100:00100000:2.0:1789518640.697949:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:34336:x1876445617343616:12345-192.168.206.51@tcp:35:touch.0 Request processed in 291us (758us total) trans 30064771268 rc 0/0 00000100:00100000:2.0:1789518640.697957:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:1.0:1789518640.727790:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518640.727868:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617343744 00000100:00100000:0.0:1789518640.727878:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617343744 00000100:00100000:0.0:1789518640.727925:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 232 00000100:00100000:0.0:1789518640.727932:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:34342:x1876445617343744:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518640.727954:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518640.727971:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786445 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc67 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.728020:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78644c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.728030:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78644c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.728039:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78644c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518640.728066:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518640.728070:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518640.728086:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78644c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.728111:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786445 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc67 expref: 33 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.728129:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78644c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc67 expref: 32 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.728136:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518640.728139:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518640.728143:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:0.0:1789518640.728351:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:34342:x1876445617343744:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 418us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518640.728359:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 232 00000100:00100000:3.0:1789518640.732441:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.732740:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617343872 00000100:00100000:2.0:1789518640.732750:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617343872 00000100:00100000:2.0:1789518640.732797:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:2.0:1789518640.732806:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:34342:x1876445617343872:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518640.732824:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518640.732843:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc6e expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.732900:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.732926:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.732934:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.732944:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.732949:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.732953:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733328:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733337:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733410:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518640.733445:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:2.0:1789518640.733448:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518640.733461:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733470:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733484:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733488:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733493:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733496:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518640.733499:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733516:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733528:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:2.0:1789518640.733530:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518640.733535:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733540:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78645a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733552:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733558:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733564:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733575:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518640.733578:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733582:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733587:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff99fec3b12800) 00010000:00010000:2.0:1789518640.733589:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518640.733591:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733594:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786461 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733641:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc6e expref: 34 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733655:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc6e expref: 33 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.733661:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99ffc6733800) 00010000:00010000:2.0:1789518640.733664:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518640.733667:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4800, rc 0) 00000100:00100000:2.0:1789518640.733766:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:34342:x1876445617343872:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 960us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518640.733773:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:2.0:1789518640.736447:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518640.736573:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617344000 00000100:00100000:0.0:1789518640.736583:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617344000 00000100:00100000:0.0:1789518640.736670:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1789518640.736684:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617344000:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518640.736701:0:36735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518640.736721:0:36735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc75 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518640.736746:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc6:0x0] initial LVB size: 0, mtime: 0x6aa9e331, atime: 0x6aa9e331, ctime: 0x6aa9e331, blocks: 0x1 00010000:00010000:0.0:1789518640.736765:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=694s v=(0 0) 00010000:00010000:0.0:1789518640.736770:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518640.736779:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc75 expref: 7 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.736798:0:36735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc75 expref: 7 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.736816:0:36735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:0.0:1789518640.736879:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617344000:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 196us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518640.736886:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1789518640.740483:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.740561:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617344256 00000100:00100000:2.0:1789518640.740570:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617344256 00000100:00100000:2.0:1789518640.740656:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:2.0:1789518640.740667:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:34342:x1876445617344256:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518640.740687:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518640.740706:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c786476 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc7c expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.740812:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.740826:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc6e expref: 34 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.740836:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.740869:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc6e expref: 34 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.740882:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc6e expref: 34 pid: 35846 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518640.740895:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1ec4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627655168:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518640.740986:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518640.742968:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518640.743067:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617344384 00000100:00100000:0.0:1789518640.743074:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617344384 00010000:00010000:0.0:1789518640.743106:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc6e expref: 35 pid: 35846 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518640.743122:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1ec4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627655168:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518640.743142:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518640.743149:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1789518640.743162:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2343:x1876445617344384:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518640.743177:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518640.743185:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc6e expref: 35 pid: 35846 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.743197:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc6e expref: 35 pid: 35846 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.743216:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786468 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc6e expref: 35 pid: 35846 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.743230:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99ffc6733800) 00010000:00010000:0.0:1789518640.743235:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.743248:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.743257:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.743283:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518640.743305:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.743315:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518640.743333:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2343:x1876445617344384:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 174us (370us total) trans 0 rc 0/0 00000004:00200000:2.0:1789518640.743338:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000100:00100000:0.0:1789518640.743343:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00010000:00010000:2.0:1789518640.743479:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c786476 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc7c expref: 35 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.743497:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc7c expref: 34 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.743517:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99ffc6733800) 00010000:00010000:2.0:1789518640.743520:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518640.743523:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4a00, rc 0) 00000100:00100000:2.0:1789518640.743557:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:34342:x1876445617344256:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2892us (3083us total) trans 30064771269 rc 0/0 00000100:00100000:2.0:1789518640.743566:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:1.0:1789518640.747334:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518640.747408:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617344640 00000100:00100000:3.0:1789518640.747425:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617344640 00000100:00100000:3.0:1789518640.747482:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:3.0:1789518640.747492:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:34342:x1876445617344640:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518640.747527:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518640.747530:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518640.747553:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c78647d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc7c expref: 34 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.747570:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99ffc6733800) 00010000:00010000:3.0:1789518640.747574:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518640.747587:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c78648b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc83 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.747699:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786492 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.747712:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786492 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.747723:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786492 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518640.747743:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:3.0:1789518640.747827:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c78648b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc83 expref: 36 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.747856:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786492 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc83 expref: 35 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.747863:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99ffc6733800) 00010000:00010000:3.0:1789518640.747865:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518640.747868:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16e00, rc 0) 00000100:00100000:3.0:1789518640.747929:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:34342:x1876445617344640:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 439us (603us total) trans 30064771270 rc 0/0 00000100:00100000:3.0:1789518640.747936:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:3.0:1789518640.752071:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518640.752247:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617344768 00000100:00100000:1.0:1789518640.752257:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617344768 00002000:00100000:1.0:1789518640.752301:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (0->4095) req@ffff99ffffe58e00 x1876445617344768/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:286/0 lens 488/0 e 0 to 0 dl 1789518651 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518640.752313:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58e00 with x1876445617344768 ext(0->4095) 00002000:00010000:1.0:1789518640.752318:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe58e00 00000100:00100000:1.0:1789518640.752428:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:1.0:1789518640.752438:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617344768:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518640.752752:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617344768:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 315us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518640.752761:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00002000:00100000:1.0:1789518640.752769:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc6:0x0] (0->4095) req@ffff99ffffe58e00 x1876445617344768/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:286/0 lens 488/440 e 0 to 0 dl 1789518651 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518640.752778:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58e00 with x1876445617344768 ext(0->4095) 00002000:00010000:1.0:1789518640.752787:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe58e00 00000100:00100000:0.0:1789518640.754897:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627655296:0@lo:400:kworker.0 00000100:00100000:0.0:1789518640.754958:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518640.755038:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627655296 00000100:00100000:1.0:1789518640.755046:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627655296 00000100:00100000:2.0:1789518640.755389:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789518640.755390:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518640.755400:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627655424:0@lo:400:kworker.0 00000100:00100000:2.0:1789518640.755407:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627655296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518640.755436:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518640.755467:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627655296:12345-0@lo:400:kworker.0 Request processed in 65us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518640.755475:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627655296:0@lo:400:kworker.0 00000100:00100000:0.0:1789518640.755513:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627655424 00000100:00100000:0.0:1789518640.755521:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627655424 00000100:00100000:0.0:1789518640.755556:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789518640.755562:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627655424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518640.755598:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627655424:12345-0@lo:400:kworker.0 Request processed in 36us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518640.755605:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789518640.755677:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518640.755717:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627655424:0@lo:400:kworker.0 00000100:00100000:2.0:1789518640.756139:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789518640.756239:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627655552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518640.756281:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518640.756300:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518640.756315:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627655936:0@lo:400:kworker.0 00000100:00100000:1.0:1789518640.756322:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518640.756335:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627655680:0@lo:400:kworker.0 00000100:00100000:0.0:1789518640.756348:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518640.756356:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617344896 00000100:00100000:1.0:1789518640.756360:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617344896 00000100:00100000:0.0:1789518640.756374:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627655808:0@lo:400:kworker.0 00000100:00100000:3.0:1789518640.756377:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518640.756378:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627655936 00000100:00100000:2.0:1789518640.756385:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627655936 00000100:00100000:1.0:1789518640.756399:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1789518640.756408:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518640.756409:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617344896:12345-192.168.206.51@tcp:1:lfs.0 00000100:00100000:3.0:1789518640.756438:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627655680 00000100:00100000:2.0:1789518640.756441:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627655808 00000100:00100000:3.0:1789518640.756444:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627655680 00000100:00080000:0.0:1789518640.756446:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518640.756447:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627655808 00010000:00010000:1.0:1789518640.756455:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518640.756461:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627655552 00000100:00100000:0.0:1789518640.756472:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627655552 00000100:00100000:3.0:1789518640.756475:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1789518640.756480:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc75 expref: 7 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518640.756490:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627655936:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1789518640.756493:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1789518640.756496:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789518640.756517:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1789518640.756519:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627655680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518640.756523:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1789518640.756524:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518640.756534:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627655552:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789518640.756556:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc75 expref: 7 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518640.756565:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627655936:12345-0@lo:400:kworker.0 Request processed in 80us (216us total) trans 0 rc 0/0 00002000:00000024:0.0:1789518640.756569:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3851419648 avail 3849322496 00010000:00010000:1.0:1789518640.756572:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc75 expref: 7 pid: 36735 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518640.756573:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789518640.756585:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627655680:12345-0@lo:400:kworker.0 Request processed in 68us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518640.756588:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8341180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627656064:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518640.756600:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789518640.756607:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518640.756633:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627655808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518640.756650:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627655552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518640.756657:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789518640.756672:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e300 going to sleep for 11 seconds 00000100:00080000:0.0:1789518640.756678:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518640.756689:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627655680:0@lo:400:kworker.0 00000100:00100000:0.0:1789518640.756704:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627655552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518640.756732:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627655936:0@lo:400:kworker.0 00000100:00100000:3.0:1789518640.756776:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627655808:12345-0@lo:400:kworker.0 Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518640.756782:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518640.756795:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627655808:0@lo:400:kworker.0 00000100:00100000:1.0:1789518640.758784:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8341180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627656064:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518640.758807:0:36532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518640.758970:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518640.759067:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617345024 00000100:00100000:0.0:1789518640.759073:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617345024 00010000:00010000:0.0:1789518640.759103:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc75 expref: 8 pid: 36735 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518640.759222:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:0.0:1789518640.759232:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617345024:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518640.759244:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518640.759266:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc75 expref: 8 pid: 36735 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.759275:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc75 expref: 8 pid: 36735 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.759292:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a4ca4e/0x631fd8698c78646f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc75 expref: 8 pid: 36735 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.759306:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518640.759311:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518640.759315:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.759324:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.759355:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518640.759402:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617345024:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 172us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518640.759410:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00010000:00010000:2.0:1789518640.759468:0:36532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.759480:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.759514:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.759523:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.759530:0:36532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.759537:0:36532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518640.759541:0:36532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.759559:0:36532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.759571:0:36532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.759579:0:36532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000919be93c/0x631fd8698c7864a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518640.759675:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617344896:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 3267us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518640.759683:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:1.0:1789518640.763318:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.763433:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617345280 00000100:00100000:2.0:1789518640.763443:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617345280 00000100:00100000:2.0:1789518640.763496:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:2.0:1789518640.763518:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:34342:x1876445617345280:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:2.0:1789518640.763574:0:35848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x16:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786492 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc83 expref: 35 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518640.763825:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771271 00000001:00080000:2.0:1789518640.763870:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771272 00000001:00080000:2.0:1789518640.764181:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771273 00010000:00010000:2.0:1789518640.764235:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.764249:0:35848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc60 expref: 39 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.764265:0:35848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.764310:0:35848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc60 expref: 39 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.764324:0:35848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc60 expref: 39 pid: 35847 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518640.764337:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627656192:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518640.764400:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518640.768283:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.768336:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627656192:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518640.768368:0:35848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518640.768797:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617345408 00000100:00100000:1.0:1789518640.768804:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617345408 00010000:00010000:1.0:1789518640.768849:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc60 expref: 40 pid: 35847 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518640.768890:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518640.768900:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2343:x1876445617345408:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518640.768913:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518640.768920:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc60 expref: 40 pid: 35847 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518640.768932:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc60 expref: 40 pid: 35847 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518640.768952:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78643e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc60 expref: 40 pid: 35847 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518640.768966:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99ffc6733800) 00010000:00010000:1.0:1789518640.768971:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518640.768981:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518640.769004:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518640.769026:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518640.769054:0:35848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.769063:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518640.769083:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617345408:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 183us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518640.769091:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000001:00080000:2.0:1789518640.769192:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771274 00000001:00080000:2.0:1789518640.769376:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771275 00000100:00100000:2.0:1789518640.769495:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627656320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789518640.769559:0:35848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518640.769595:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518640.769609:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627656320 00000100:00100000:0.0:1789518640.769650:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627656320 00000100:00100000:0.0:1789518640.769685:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789518640.769706:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627656320:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789518640.769780:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627656320:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518640.769791:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789518640.770030:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627656320:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789518640.770717:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771276 00000100:00100000:2.0:1789518640.770772:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627656448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789518640.770808:0:35848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518640.770838:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789518640.771155:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627656448 00000100:00100000:3.0:1789518640.771161:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627656448 00000100:00100000:3.0:1789518640.771204:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789518640.771213:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627656448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518640.771811:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35848:x1876445627656448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 598us (1001us total) trans 30064771094 rc 0/0 00000100:00100000:3.0:1789518640.771819:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789518640.772024:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627656448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789518640.772075:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771277 00010000:00010000:2.0:1789518640.772112:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.772122:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.772130:0:35848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.772137:0:35848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518640.772142:0:35848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.772150:0:35848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.772163:0:35848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99ffc6733800) 00010000:00010000:2.0:1789518640.772166:0:35848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789518640.772171:0:35848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.772177:0:35848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864a7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518640.772802:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x17:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789518640.773118:0:35848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].8, 64 off8752 00000004:00080000:2.0:1789518640.773128:0:35848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694769514183ns, next at 695769512234ns, rc = 0 00000001:00080000:2.0:1789518640.773135:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771278 00010000:00010000:2.0:1789518640.773173:0:35848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99ffc6733800) 00010000:00010000:2.0:1789518640.773176:0:35848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518640.773183:0:35848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c786492 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc83 expref: 43 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518640.773484:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:34342:x1876445617345280:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 9978us (10171us total) trans 30064771279 rc 0/0 00000100:00100000:2.0:1789518640.773494:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000020:00080000:2.0:1789518640.773499:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789518640.775929:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.776774:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617345536 00000100:00100000:2.0:1789518640.776784:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617345536 00000100:00100000:2.0:1789518640.776845:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 236 00000100:00100000:2.0:1789518640.776965:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:34342:x1876445617345536:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518640.776990:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518640.777014:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7864ae lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc8a expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.777070:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7864ae lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc8a expref: 43 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.777086:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7864ae lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc8a expref: 43 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.777106:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:2.0:1789518640.777110:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518640.777128:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4200, rc 0) 00000100:00100000:2.0:1789518640.777242:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:34342:x1876445617345536:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 387us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518640.777249:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 236 00000100:00100000:1.0:1789518640.780004:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518640.780066:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617345792 00000100:00100000:0.0:1789518640.780075:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617345792 00000100:00100000:0.0:1789518640.780122:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:0.0:1789518640.780134:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:34342:x1876445617345792:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518640.780362:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:34342:x1876445617345792:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 231us (379us total) trans 30064771280 rc 0/0 00000100:00100000:0.0:1789518640.780370:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1789518640.827395:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.827538:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617345920 00000100:00100000:2.0:1789518640.827548:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617345920 00000100:00100000:2.0:1789518640.827603:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 237 00000100:00100000:2.0:1789518640.827650:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:34352:x1876445617345920:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518640.827729:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827755:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827766:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827785:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827793:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827800:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827883:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827892:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827919:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518640.827958:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827975:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827982:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827989:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.827995:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518640.827999:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828006:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828016:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:2.0:1789518640.828019:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518640.828023:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828028:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828041:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828054:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828060:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828065:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518640.828069:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828075:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828083:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff99fec3b12000) 00010000:00010000:2.0:1789518640.828086:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518640.828089:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828095:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828109:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828115:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828121:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828126:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518640.828135:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828141:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828150:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:2.0:1789518640.828153:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518640.828155:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518640.828161:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7864c3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518640.828235:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:34352:x1876445617345920:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 623us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518640.828244:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 237 00000100:00100000:3.0:1789518640.863535:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518640.863701:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617346176 00000100:00100000:0.0:1789518640.863711:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617346176 00000100:00100000:0.0:1789518640.863826:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 238 00000100:00100000:0.0:1789518640.863837:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:34358:x1876445617346176:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1789518640.863856:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518640.863859:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518640.863883:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c78644c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc67 expref: 44 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.863901:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518640.863911:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518640.863924:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7864ca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc91 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864065:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864077:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864090:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864102:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864109:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864116:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864181:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7864df lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864191:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7864df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864198:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7864df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518640.864207:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:0.0:1789518640.864314:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864322:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864329:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864337:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518640.864343:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864361:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864370:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:0.0:1789518640.864373:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518640.864376:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864381:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7864d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864391:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864396:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864402:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864407:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518640.864410:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864416:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864423:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff99ffc2d97600) 00010000:00010000:0.0:1789518640.864425:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518640.864429:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864434:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7864d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864492:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c7864ca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc91 expref: 46 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864523:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7864df lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc91 expref: 45 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.864530:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:0.0:1789518640.864532:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518640.864534:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:0.0:1789518640.864590:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:34358:x1876445617346176:12345-192.168.206.51@tcp:101:dd.0 Request processed in 756us (1064us total) trans 30064771281 rc 0/0 00000100:00100000:0.0:1789518640.864595:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 238 00000100:00100000:1.0:1789518640.866851:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518640.866985:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617346432 00000100:00100000:2.0:1789518640.866994:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617346432 00000100:00100000:3.0:1789518640.867477:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 239 00000100:00100000:3.0:1789518640.867488:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:34358:x1876445617346432:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:3.0:1789518640.867552:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518640.867576:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7864df lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc91 expref: 45 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.867596:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:3.0:1789518640.867602:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518640.867853:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.867867:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518640.867876:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518640.867925:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771282 00000004:00010000:3.0:1789518640.867965:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000450297f8 reply state 00000000a1cc16a4 transno 30064771283 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518640.867973:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518640.868068:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:34358:x1876445617346432:12345-192.168.206.51@tcp:36:dd.0 Request processed in 581us (1223us total) trans 30064771283 rc 0/0 00000100:00100000:3.0:1789518640.868075:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 239 00000020:00080000:3.0:1789518640.868080:0:37723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789518640.870289:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.870305:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.870313:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.870319:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518640.870323:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.870335:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.870350:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:0.0:1789518640.870353:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518640.870369:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518640.870375:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7864ed lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.011037:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518641.216838:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.216959:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617346688 00000100:00100000:0.0:1789518641.216968:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617346688 00000100:00100000:0.0:1789518641.217045:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1789518641.217055:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:34358:x1876445617346688:12345-192.168.206.51@tcp:103:dd.0 00010000:00010000:0.0:1789518641.217071:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518641.217092:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7864ae lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc8a expref: 46 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.217108:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:0.0:1789518641.217116:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518641.217451:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:34358:x1876445617346688:12345-192.168.206.51@tcp:103:dd.0 Request processed in 396us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518641.217459:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00080000:2.0:1789518641.217647:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518641.218936:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.219045:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617346816 00000100:00100000:2.0:1789518641.219052:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617346816 00000100:00100000:2.0:1789518641.219274:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00100000:2.0:1789518641.219283:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:34358:x1876445617346816:12345-192.168.206.51@tcp:58:dd.0 00010000:00010000:2.0:1789518641.219387:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.219403:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.219414:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518641.219733:0:35845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].7, 136 off9144 00000100:00100000:2.0:1789518641.219813:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:34358:x1876445617346816:12345-192.168.206.51@tcp:58:dd.0 Request processed in 531us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.219822:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00100000:3.0:1789518641.223855:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.224449:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617346944 00000100:00100000:2.0:1789518641.224460:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617346944 00000100:00100000:2.0:1789518641.224576:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 241 00000100:00100000:2.0:1789518641.224589:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:34358:x1876445617346944:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518641.224609:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518641.224650:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864fb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc98 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.224701:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.224712:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864fb lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc98 expref: 46 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.224729:0:35847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.224744:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864fb lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc98 expref: 46 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.224757:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:2.0:1789518641.224760:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518641.224764:0:35847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864fb lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc98 expref: 46 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.224785:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5000, rc 0) 00000100:00100000:2.0:1789518641.224846:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:34358:x1876445617346944:12345-192.168.206.51@tcp:101:dd.0 Request processed in 261us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.224853:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 241 00000001:00080000:1.0:1789518641.299941:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771281 is committed 00000020:00080000:1.0:1789518641.299965:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc6ab3a80 refcount 2 committed 0 result 0 batchid 25769803898 00000020:00080000:1.0:1789518641.299969:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fec83f7700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc6ab36c0 00000020:00080000:1.0:1789518641.299972:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fec83f7900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec233d800 00000004:00080000:1.0:1789518641.299999:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789518641.300013:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fec846d480 refcount 2 committed 0 result 0 batchid 25769803899 00000020:00080000:1.0:1789518641.300015:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fec846d780 00000020:00080000:1.0:1789518641.300017:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec8346800 00000001:00080000:1.0:1789518641.300047:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771283 is committed 00000100:00100000:3.0:1789518641.300213:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518641.300232:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627656576:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789518641.300296:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518641.300359:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627656576 00000100:00100000:3.0:1789518641.300365:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627656576 00000100:00100000:3.0:1789518641.300413:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789518641.300421:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627656576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789518641.300444:0:36531:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:198 count 1 00002000:00010000:3.0:1789518641.300473:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc6:0x0] initial LVB size: 0, mtime: 0x6aa9e331, atime: 0x6aa9e331, ctime: 0x6aa9e331, blocks: 0x1 00010000:00010000:3.0:1789518641.300482:0:36531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518641.300508:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=695s v=(0 0) 00010000:00010000:3.0:1789518641.300513:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518641.300520:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518641.300533:0:36531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518641.300553:0:36531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518641.300558:0:36531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518641.300574:0:36531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789518641.300601:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518641.300609:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.300652:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518641.300665:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.300676:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.300694:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.300701:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d063c167/0x631fd8698c786502 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.300821:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518641.300824:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518641.300827:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518641.301074:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627656576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 652us (776us total) trans 30064771095 rc 0/0 00000100:00100000:3.0:1789518641.301082:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:0.0:1789518641.301386:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffffe5aa00/2, rc 0, transno 30064771095 00000100:00100000:0.0:1789518641.301396:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627656576:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1789518641.301554:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803899 committed batchid 25769803897 00000020:00080000:2.0:1789518641.301750:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803897 00000001:00080000:3.0:1789518641.301839:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771098 is committed 00000001:00080000:3.0:1789518641.301848:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771095 is committed 00000001:00080000:3.0:1789518641.301853:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771097 is committed 00000040:00080000:0.0:1789518641.395023:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518641.395032:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518641.396300:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:0.0:1789518641.396308:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518641.396410:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627656704:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518641.396658:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a0002162840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518641.399931:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627656704:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518641.400872:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.400949:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617347072 00000100:00100000:2.0:1789518641.400957:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617347072 00000100:00100000:2.0:1789518641.401017:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 242 00000100:00100000:2.0:1789518641.401029:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:34359:x1876445617347072:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518641.401059:0:35846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518641.401170:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:34359:x1876445617347072:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 143us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.401178:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 242 00000100:00100000:3.0:1789518641.403333:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.403680:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617347200 00000100:00100000:2.0:1789518641.403757:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617347200 00000100:00100000:2.0:1789518641.403810:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 243 00000100:00100000:2.0:1789518641.403821:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:34359:x1876445617347200:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789518641.403888:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.403905:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.403918:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.403979:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.403986:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.403990:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404009:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404014:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404018:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518641.404046:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:2.0:1789518641.404049:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518641.404057:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404064:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404068:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404073:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404084:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518641.404087:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404160:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404174:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:2.0:1789518641.404177:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518641.404182:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404189:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786509 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404207:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404214:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404219:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404224:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518641.404226:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404231:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404249:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x1989a751 (ffff99fec3b12300) 00010000:00010000:2.0:1789518641.404252:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518641.404255:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404261:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786510 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404276:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404283:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404288:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404293:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518641.404296:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404301:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404308:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:2.0:1789518641.404310:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518641.404313:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.404318:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786517 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518641.404417:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:34359:x1876445617347200:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 597us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.404426:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 243 00000100:00100000:1.0:1789518641.406329:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.406490:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617347456 00000100:00100000:2.0:1789518641.406512:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617347456 00000100:00100000:2.0:1789518641.406567:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 244 00000100:00100000:2.0:1789518641.406577:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:34359:x1876445617347456:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518641.406600:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518641.406642:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78651e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdc9f expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.406733:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.406747:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.407308:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518641.407325:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:2.0:1789518641.407523:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.407532:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.407539:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.407565:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518641.407570:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.407579:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.407688:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:2.0:1789518641.407691:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518641.407696:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.407703:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786525 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.407752:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78651e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc9f expref: 15 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.408218:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:2.0:1789518641.408221:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518641.408227:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78651e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc9f expref: 15 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.408243:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5600, rc 0) 00000100:00100000:2.0:1789518641.408335:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:34359:x1876445617347456:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1758us (2012us total) trans 30064771284 rc 301/301 00000100:00100000:2.0:1789518641.408345:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 244 00000100:00100000:1.0:1789518641.414993:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518641.415093:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617347584 00000100:00100000:3.0:1789518641.415103:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617347584 00000100:00100000:3.0:1789518641.415159:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 245 00000100:00100000:3.0:1789518641.415170:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:34359:x1876445617347584:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518641.415203:0:35847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518641.415362:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:34359:x1876445617347584:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 192us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518641.415371:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 245 00000100:00100000:3.0:1789518641.419276:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.419371:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617347712 00000100:00100000:2.0:1789518641.419396:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617347712 00000100:00100000:2.0:1789518641.419462:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 246 00000100:00100000:2.0:1789518641.419471:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:34359:x1876445617347712:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518641.419490:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518641.419524:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdca6 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.419585:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78653a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.419599:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78653a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.419611:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78653a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518641.419673:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518641.419677:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518641.419694:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78653a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.419717:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c786533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdca6 expref: 16 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.419738:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78653a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdca6 expref: 15 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.419746:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:2.0:1789518641.419750:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518641.419754:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5c00, rc 0) 00000100:00100000:2.0:1789518641.419825:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:34359:x1876445617347712:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 354us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.419833:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 246 00000100:00100000:1.0:1789518641.422479:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.422692:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617347968 00000100:00100000:2.0:1789518641.422703:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617347968 00000100:00100000:2.0:1789518641.422758:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 247 00000100:00100000:2.0:1789518641.422768:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:34359:x1876445617347968:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518641.422792:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518641.422796:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518641.422829:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c78653a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdca6 expref: 15 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.422851:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:2.0:1789518641.422863:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518641.422882:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786541 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcad expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518641.423664:0:37723:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc6:0x0], index 1: 0 00010000:00010000:2.0:1789518641.423921:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786548 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.423934:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786548 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.423944:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786548 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.423987:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786541 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcad expref: 17 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.424016:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786548 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcad expref: 16 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.424022:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:2.0:1789518641.424024:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518641.424026:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4a00, rc 0) 00000100:00100000:2.0:1789518641.424099:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:34359:x1876445617347968:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1331us (1627us total) trans 30064771285 rc 0/0 00000100:00100000:2.0:1789518641.424106:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 247 00000100:00100000:1.0:1789518641.427370:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.427530:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617348096 00000100:00100000:0.0:1789518641.427540:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617348096 00000100:00100000:0.0:1789518641.427646:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 248 00000100:00100000:0.0:1789518641.427657:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:34359:x1876445617348096:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518641.427682:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518641.427703:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786556 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcb4 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.427760:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78655d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.427773:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78655d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.427784:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78655d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518641.427814:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518641.427818:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518641.427835:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78655d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.427858:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786556 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcb4 expref: 18 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.427873:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78655d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcb4 expref: 17 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.427879:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:0.0:1789518641.427881:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518641.427883:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bca00, rc 0) 00000100:00100000:0.0:1789518641.427978:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:34359:x1876445617348096:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 323us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518641.427997:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 248 00000100:00100000:3.0:1789518641.430328:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.430375:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617348352 00000100:00100000:2.0:1789518641.430389:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617348352 00000100:00100000:2.0:1789518641.430446:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 249 00000100:00100000:2.0:1789518641.430457:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:34359:x1876445617348352:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518641.430515:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789518641.430540:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786548 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcad expref: 17 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.430558:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12800) 00010000:00010000:2.0:1789518641.430574:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c78655d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcb4 expref: 16 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.430583:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:2.0:1789518641.430589:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518641.430609:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.430664:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.430673:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.430686:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431147:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431159:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431486:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431509:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431516:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431522:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518641.431527:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431535:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431544:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12500) 00010000:00010000:2.0:1789518641.431553:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518641.431558:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431565:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786564 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431581:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431587:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431593:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431599:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518641.431601:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431607:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431720:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x188868c0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518641.431723:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518641.431727:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.431733:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c78656b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x188868c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518641.431845:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:34359:x1876445617348352:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1380us (1512us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789518641.431861:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 249 00000100:00100000:1.0:1789518641.434008:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.434162:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617348480 00000100:00100000:2.0:1789518641.434172:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617348480 00000100:00100000:2.0:1789518641.434254:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00100000:2.0:1789518641.434265:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:34359:x1876445617348480:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518641.434284:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518641.435122:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786572 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcbb expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.435159:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.435172:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.435183:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.435545:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786572 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcbb expref: 17 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.435565:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcbb expref: 16 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.435574:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:2.0:1789518641.435576:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518641.435578:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5c00, rc 0) 00000100:00100000:2.0:1789518641.435831:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:34359:x1876445617348480:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1566us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.435974:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00100000:3.0:1789518641.438172:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.438287:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617348736 00000100:00100000:2.0:1789518641.438296:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617348736 00000100:00100000:2.0:1789518641.438350:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 251 00000100:00100000:2.0:1789518641.438360:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:34359:x1876445617348736:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518641.438445:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.438460:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.438471:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518641.438984:0:37723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].8, 88 off8824 00000004:00080000:2.0:1789518641.438995:0:37723:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695435380835ns, next at 696435378013ns, rc = 0 00000004:00010000:2.0:1789518641.439144:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088eed436 reply state 00000000d5c90d7b transno 30064771286 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518641.439153:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518641.439246:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:34359:x1876445617348736:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 885us (1080us total) trans 30064771286 rc 0/0 00000100:00100000:2.0:1789518641.439254:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 251 00010000:00010000:2.0:1789518641.440917:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.440932:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.440956:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.440962:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518641.440967:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.440976:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.440992:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:2.0:1789518641.440996:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518641.441001:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.441008:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786580 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518641.442678:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.442792:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617348864 00000100:00100000:0.0:1789518641.442802:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617348864 00000100:00100000:0.0:1789518641.442858:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 252 00000100:00100000:0.0:1789518641.442868:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:34359:x1876445617348864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518641.442895:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518641.442914:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcc2 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.442970:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc2 expref: 18 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.442985:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc2 expref: 18 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.443010:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:0.0:1789518641.443025:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518641.443028:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:0.0:1789518641.443135:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:34359:x1876445617348864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 267us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518641.443143:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 252 00000100:00100000:3.0:1789518641.445206:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.445431:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617348992 00000100:00100000:0.0:1789518641.445441:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617348992 00000100:00100000:0.0:1789518641.445521:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:0.0:1789518641.445531:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617348992:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789518641.445542:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518641.445901:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617348992:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 371us (702us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1789518641.445910:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1789518641.448544:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.448744:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617349248 00000100:00100000:2.0:1789518641.448753:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617349248 00000100:00100000:2.0:1789518641.448846:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1789518641.448856:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:34359:x1876445617349248:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.449083:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:34359:x1876445617349248:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 227us (544us total) trans 30064771287 rc 0/0 00000100:00100000:2.0:1789518641.449104:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:3.0:1789518641.450764:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.450861:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617349504 00000100:00100000:2.0:1789518641.450870:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617349504 00000100:00100000:2.0:1789518641.450973:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 253 00000100:00100000:2.0:1789518641.450982:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:34359:x1876445617349504:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.451089:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:34359:x1876445617349504:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 108us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.451097:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 253 00000100:00100000:3.0:1789518641.453435:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.453662:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617349632 00000100:00100000:2.0:1789518641.453671:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617349632 00000100:00100000:2.0:1789518641.453718:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 254 00000100:00100000:2.0:1789518641.453728:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:34359:x1876445617349632:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518641.453747:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518641.453765:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78658e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcc9 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.453829:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786595 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.453843:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786595 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.453855:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786595 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518641.453890:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518641.453907:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786595 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.453934:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78658e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc9 expref: 21 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.453981:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786595 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc9 expref: 20 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.453990:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:2.0:1789518641.453993:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518641.453996:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5200, rc 0) 00000100:00100000:2.0:1789518641.454057:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:34359:x1876445617349632:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 330us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.454065:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 254 00000100:00100000:1.0:1789518641.457775:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.457866:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617349760 00000100:00100000:2.0:1789518641.457877:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617349760 00000100:00100000:2.0:1789518641.457968:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:2.0:1789518641.457978:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617349760:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518641.457998:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518641.458019:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcd0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518641.458045:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e332, blocks: 0x1 00010000:00010000:2.0:1789518641.458064:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=695s v=(0 0) 00010000:00010000:2.0:1789518641.458069:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518641.458090:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd0 expref: 9 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.458107:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd0 expref: 9 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518641.458142:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4600, rc 0) 00000100:00100000:2.0:1789518641.458201:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617349760:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 223us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.458208:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1789518641.461779:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.462007:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617350016 00000100:00100000:2.0:1789518641.462017:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617350016 00000100:00100000:2.0:1789518641.462071:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 255 00000100:00100000:2.0:1789518641.462225:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:34359:x1876445617350016:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.462372:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:34359:x1876445617350016:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 291us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518641.462380:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 255 00000100:00100000:3.0:1789518641.469033:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.469133:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617350144 00000100:00100000:0.0:1789518641.469144:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617350144 00000100:00100000:0.0:1789518641.469317:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:0.0:1789518641.469328:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:34359:x1876445617350144:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518641.469347:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518641.469366:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcd7 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.469400:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd0 expref: 10 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.469415:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518641.469420:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518641.469425:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 10 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.469457:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd0 expref: 10 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.469472:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd0 expref: 10 pid: 36532 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518641.469486:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627656832:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518641.469597:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a0002162840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518641.471789:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.471853:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617350272 00000100:00100000:1.0:1789518641.471861:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617350272 00010000:00010000:1.0:1789518641.471894:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd0 expref: 11 pid: 36532 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518641.471922:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfeeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627656832:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518641.471947:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 11 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518641.471963:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:0.0:1789518641.472028:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:34359:x1876445617350144:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2701us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518641.472036:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:1.0:1789518641.472265:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:1.0:1789518641.472276:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1083050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617350272:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518641.472313:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518641.472346:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd0 expref: 10 pid: 36532 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.472361:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd0 expref: 10 pid: 36532 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.472382:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f950f091/0x631fd8698c78659c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd0 expref: 10 pid: 36532 timeout: 795 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.472396:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518641.472401:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518641.472409:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 9 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.472420:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 9 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518641.472450:0:35830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 9 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518641.472464:0:35830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8343b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35830:1876445627656960:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518641.472532:0:35830:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc514af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518641.475455:0:35830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8343b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35830:1876445627656960:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518641.475482:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518641.475555:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1083050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617350272:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3281us (3773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518641.475566:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:3.0:1789518641.492234:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.492403:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617350400 00000100:00100000:0.0:1789518641.492416:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617350400 00002000:00100000:0.0:1789518641.492488:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (0->1048575) req@ffff99fffbb83480 x1876445617350400/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.492515:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb83480 with x1876445617350400 ext(0->1048575) 00002000:00010000:0.0:1789518641.492523:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb83480 00000100:00100000:0.0:1789518641.492558:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1789518641.492570:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617350400:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.506099:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.506130:0:36538:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789518641.506140:0:36538:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789518641.506683:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617350528 00000100:00100000:2.0:1789518641.506693:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617350528 00002000:00100000:2.0:1789518641.506738:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (1048576->2097151) req@ffff99fff4b1f480 x1876445617350528/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.506750:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1f480 with x1876445617350528 ext(1048576->2097151) 00002000:00010000:2.0:1789518641.506756:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1f480 00000100:00100000:1.0:1789518641.507293:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:1.0:1789518641.507306:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617350528:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518641.512045:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617350400:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 19466us (19814us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1789518641.512059:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00002000:00100000:0.0:1789518641.512074:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (0->1048575) req@ffff99fffbb83480 x1876445617350400/t30064771100(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.512083:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb83480 with x1876445617350400 ext(0->1048575) 00002000:00010000:0.0:1789518641.512089:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb83480 00000100:00100000:1.0:1789518641.516329:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617350528:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9017us (10230us total) trans 30064771101 rc 0/0 00000100:00100000:1.0:1789518641.516341:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00002000:00100000:1.0:1789518641.516355:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (1048576->2097151) req@ffff99fff4b1f480 x1876445617350528/t30064771101(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.516365:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1f480 with x1876445617350528 ext(1048576->2097151) 00002000:00010000:1.0:1789518641.516372:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1f480 00000100:00100000:2.0:1789518641.522738:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.523122:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617350656 00000100:00100000:1.0:1789518641.523132:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617350656 00002000:00100000:1.0:1789518641.523175:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (2097152->3145727) req@ffff99fff7388e00 x1876445617350656/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.523186:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7388e00 with x1876445617350656 ext(2097152->3145727) 00002000:00010000:1.0:1789518641.523192:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7388e00 00000100:00100000:1.0:1789518641.523271:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518641.523281:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617350656:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.531907:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617350656:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8618us (9168us total) trans 30064771102 rc 0/0 00000100:00100000:1.0:1789518641.531942:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00002000:00100000:1.0:1789518641.531955:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (2097152->3145727) req@ffff99fff7388e00 x1876445617350656/t30064771102(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.531966:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7388e00 with x1876445617350656 ext(2097152->3145727) 00002000:00010000:1.0:1789518641.531973:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7388e00 00000100:00100000:2.0:1789518641.537568:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.537859:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617350784 00000100:00100000:0.0:1789518641.537869:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617350784 00002000:00100000:0.0:1789518641.537915:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (3145728->4194303) req@ffff99fff7389c00 x1876445617350784/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.537927:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7389c00 with x1876445617350784 ext(3145728->4194303) 00002000:00010000:0.0:1789518641.537932:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7389c00 00000100:00100000:0.0:1789518641.538006:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:0.0:1789518641.538016:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617350784:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.547916:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617350784:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9891us (10350us total) trans 30064771103 rc 0/0 00000100:00100000:1.0:1789518641.547928:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00002000:00100000:1.0:1789518641.547941:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (3145728->4194303) req@ffff99fff7389c00 x1876445617350784/t30064771103(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.547952:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7389c00 with x1876445617350784 ext(3145728->4194303) 00002000:00010000:1.0:1789518641.547958:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7389c00 00000100:00100000:0.0:1789518641.551667:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518641.551729:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617350912 00000100:00100000:3.0:1789518641.551739:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617350912 00002000:00100000:2.0:1789518641.551865:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (4194304->5242879) req@ffff99ffdfeeb100 x1876445617350912/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.551874:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfeeb100 with x1876445617350912 ext(4194304->5242879) 00002000:00010000:2.0:1789518641.551889:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfeeb100 00000100:00100000:2.0:1789518641.551914:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:2.0:1789518641.551921:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2343:x1876445617350912:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.559111:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2343:x1876445617350912:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7172us (7434us total) trans 30064771104 rc 0/0 00000100:00100000:2.0:1789518641.559124:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00002000:00100000:2.0:1789518641.559136:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (4194304->5242879) req@ffff99ffdfeeb100 x1876445617350912/t30064771104(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.559145:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfeeb100 with x1876445617350912 ext(4194304->5242879) 00002000:00010000:2.0:1789518641.559152:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfeeb100 00000100:00100000:0.0:1789518641.561786:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.561887:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617351040 00000100:00100000:1.0:1789518641.561901:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617351040 00002000:00100000:1.0:1789518641.561960:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (5242880->6291455) req@ffff99ffdfee9880 x1876445617351040/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.561972:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfee9880 with x1876445617351040 ext(5242880->6291455) 00002000:00010000:1.0:1789518641.561986:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfee9880 00000100:00100000:1.0:1789518641.562031:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:1.0:1789518641.562043:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2343:x1876445617351040:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.573082:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617351040:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 11024us (11289us total) trans 30064771105 rc 0/0 00000100:00100000:1.0:1789518641.573112:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00002000:00100000:1.0:1789518641.573125:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (5242880->6291455) req@ffff99ffdfee9880 x1876445617351040/t30064771105(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.573135:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffdfee9880 with x1876445617351040 ext(5242880->6291455) 00002000:00010000:1.0:1789518641.573142:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffdfee9880 00000100:00100000:3.0:1789518641.574463:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.574535:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617351168 00000100:00100000:1.0:1789518641.574545:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617351168 00002000:00100000:1.0:1789518641.574601:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (6291456->7340031) req@ffff99fffbb82a00 x1876445617351168/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.574651:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb82a00 with x1876445617351168 ext(6291456->7340031) 00002000:00010000:1.0:1789518641.574657:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb82a00 00000100:00100000:1.0:1789518641.574691:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1789518641.574702:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617351168:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518641.584481:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.584701:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617351296 00000100:00100000:1.0:1789518641.584709:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617351296 00002000:00100000:1.0:1789518641.584749:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (7340032->8388607) req@ffff99ffeda6bb80 x1876445617351296/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.584760:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6bb80 with x1876445617351296 ext(7340032->8388607) 00002000:00010000:1.0:1789518641.584766:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda6bb80 00000100:00100000:1.0:1789518641.584853:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:1.0:1789518641.584863:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2342:x1876445617351296:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.594417:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2343:x1876445617351168:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 19707us (19951us total) trans 30064771106 rc 0/0 00000100:00100000:1.0:1789518641.594437:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00002000:00100000:1.0:1789518641.594451:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (6291456->7340031) req@ffff99fffbb82a00 x1876445617351168/t30064771106(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.594461:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb82a00 with x1876445617351168 ext(6291456->7340031) 00002000:00010000:1.0:1789518641.594468:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb82a00 00000100:00100000:0.0:1789518641.596325:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.596901:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617351424 00000100:00100000:2.0:1789518641.596911:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617351424 00002000:00100000:2.0:1789518641.596956:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (8388608->9437183) req@ffff99ffeda68a80 x1876445617351424/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.596967:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda68a80 with x1876445617351424 ext(8388608->9437183) 00002000:00010000:2.0:1789518641.596973:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda68a80 00000100:00100000:2.0:1789518641.597119:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1789518641.597130:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2342:x1876445617351424:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.598554:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617351296:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 13686us (14076us total) trans 30064771107 rc 0/0 00000100:00100000:1.0:1789518641.598565:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00002000:00100000:1.0:1789518641.598575:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (7340032->8388607) req@ffff99ffeda6bb80 x1876445617351296/t30064771107(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.598585:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6bb80 with x1876445617351296 ext(7340032->8388607) 00002000:00010000:1.0:1789518641.598590:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda6bb80 00000100:00100000:1.0:1789518641.604916:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617351424:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7776us (8585us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1789518641.604928:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00002000:00100000:1.0:1789518641.604940:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (8388608->9437183) req@ffff99ffeda68a80 x1876445617351424/t30064771108(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.604950:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda68a80 with x1876445617351424 ext(8388608->9437183) 00002000:00010000:1.0:1789518641.604957:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda68a80 00000100:00100000:3.0:1789518641.606142:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.606356:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617351552 00000100:00100000:1.0:1789518641.606364:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617351552 00002000:00100000:1.0:1789518641.606402:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (9437184->10485759) req@ffff99fffbb80000 x1876445617351552/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.606431:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb80000 with x1876445617351552 ext(9437184->10485759) 00002000:00010000:1.0:1789518641.606435:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb80000 00000100:00100000:1.0:1789518641.606471:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:1.0:1789518641.606481:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617351552:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.615145:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617351552:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8656us (8999us total) trans 30064771109 rc 0/0 00000100:00100000:1.0:1789518641.615159:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00002000:00100000:1.0:1789518641.615171:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (9437184->10485759) req@ffff99fffbb80000 x1876445617351552/t30064771109(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.615181:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb80000 with x1876445617351552 ext(9437184->10485759) 00002000:00010000:1.0:1789518641.615188:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb80000 00000100:00100000:0.0:1789518641.621915:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.622023:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617351680 00000100:00100000:1.0:1789518641.622033:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617351680 00002000:00100000:1.0:1789518641.622082:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (10485760->11534335) req@ffff99ffeda69880 x1876445617351680/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.622093:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda69880 with x1876445617351680 ext(10485760->11534335) 00002000:00010000:1.0:1789518641.622099:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda69880 00000100:00100000:1.0:1789518641.622184:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:1.0:1789518641.622194:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2343:x1876445617351680:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.632314:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2343:x1876445617351680:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 10113us (10398us total) trans 30064771110 rc 0/0 00000100:00100000:1.0:1789518641.632340:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00002000:00100000:1.0:1789518641.632367:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (10485760->11534335) req@ffff99ffeda69880 x1876445617351680/t30064771110(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.632379:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda69880 with x1876445617351680 ext(10485760->11534335) 00002000:00010000:1.0:1789518641.632386:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda69880 00000100:00100000:2.0:1789518641.634406:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.634494:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617351808 00000100:00100000:1.0:1789518641.634513:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617351808 00002000:00100000:1.0:1789518641.634554:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (11534336->12582911) req@ffff99fec82f9880 x1876445617351808/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.634564:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82f9880 with x1876445617351808 ext(11534336->12582911) 00002000:00010000:1.0:1789518641.634569:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82f9880 00000100:00100000:1.0:1789518641.634603:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:1.0:1789518641.634653:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2343:x1876445617351808:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.641262:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2343:x1876445617351808:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 6641us (6852us total) trans 30064771111 rc 0/0 00000100:00100000:1.0:1789518641.641276:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00002000:00100000:1.0:1789518641.641288:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (11534336->12582911) req@ffff99fec82f9880 x1876445617351808/t30064771111(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.641299:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82f9880 with x1876445617351808 ext(11534336->12582911) 00002000:00010000:1.0:1789518641.641306:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82f9880 00000100:00100000:2.0:1789518641.650101:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.650260:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617351936 00000100:00100000:1.0:1789518641.650274:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617351936 00002000:00100000:1.0:1789518641.650325:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (12582912->13631487) req@ffff99fec82d7100 x1876445617351936/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.650336:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82d7100 with x1876445617351936 ext(12582912->13631487) 00002000:00010000:1.0:1789518641.650356:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82d7100 00000100:00100000:1.0:1789518641.650396:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:1.0:1789518641.650405:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2342:x1876445617351936:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.656673:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2342:x1876445617351936:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 6258us (6575us total) trans 30064771112 rc 0/0 00000100:00100000:1.0:1789518641.656697:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00002000:00100000:1.0:1789518641.656710:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (12582912->13631487) req@ffff99fec82d7100 x1876445617351936/t30064771112(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.656721:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82d7100 with x1876445617351936 ext(12582912->13631487) 00002000:00010000:1.0:1789518641.656728:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82d7100 00000100:00100000:2.0:1789518641.663946:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.664063:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617352064 00000100:00100000:1.0:1789518641.664073:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617352064 00002000:00100000:1.0:1789518641.664118:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (13631488->14680063) req@ffff99fec82d6680 x1876445617352064/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.664129:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82d6680 with x1876445617352064 ext(13631488->14680063) 00002000:00010000:1.0:1789518641.664134:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82d6680 00000100:00100000:1.0:1789518641.664166:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:1.0:1789518641.664175:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2342:x1876445617352064:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.673311:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.674050:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617352192 00000100:00100000:0.0:1789518641.674060:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617352192 00002000:00100000:0.0:1789518641.674102:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (14680064->15728639) req@ffff99fec1f89500 x1876445617352192/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.674114:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f89500 with x1876445617352192 ext(14680064->15728639) 00002000:00010000:0.0:1789518641.674120:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f89500 00000100:00100000:0.0:1789518641.674154:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:0.0:1789518641.674162:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2343:x1876445617352192:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.680178:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2342:x1876445617352064:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 15993us (16230us total) trans 30064771113 rc 0/0 00000100:00100000:1.0:1789518641.680192:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00002000:00100000:1.0:1789518641.680205:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (13631488->14680063) req@ffff99fec82d6680 x1876445617352064/t30064771113(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.680234:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82d6680 with x1876445617352064 ext(13631488->14680063) 00002000:00010000:1.0:1789518641.680241:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82d6680 00000100:00100000:0.0:1789518641.681307:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617352192:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7140us (8002us total) trans 30064771114 rc 0/0 00000100:00100000:0.0:1789518641.681317:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00002000:00100000:0.0:1789518641.681326:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (14680064->15728639) req@ffff99fec1f89500 x1876445617352192/t30064771114(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.681334:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f89500 with x1876445617352192 ext(14680064->15728639) 00002000:00010000:0.0:1789518641.681338:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f89500 00000100:00100000:2.0:1789518641.685776:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.685871:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617352320 00000100:00100000:1.0:1789518641.685886:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617352320 00002000:00100000:1.0:1789518641.685948:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (15728640->16777215) req@ffff99fec1f88a80 x1876445617352320/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.685960:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f88a80 with x1876445617352320 ext(15728640->16777215) 00002000:00010000:1.0:1789518641.685966:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f88a80 00000100:00100000:1.0:1789518641.686009:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:1.0:1789518641.686018:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2342:x1876445617352320:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.693392:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.693594:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617352448 00000100:00100000:1.0:1789518641.693607:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617352448 00002000:00100000:1.0:1789518641.693704:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (16777216->17825791) req@ffff99fec1f8b480 x1876445617352448/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.693716:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8b480 with x1876445617352448 ext(16777216->17825791) 00002000:00010000:1.0:1789518641.693724:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8b480 00000100:00100000:0.0:1789518641.694057:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:0.0:1789518641.694144:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2343:x1876445617352448:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.695736:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2342:x1876445617352320:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9710us (9965us total) trans 30064771115 rc 0/0 00000100:00100000:1.0:1789518641.695749:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00002000:00100000:1.0:1789518641.695761:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (15728640->16777215) req@ffff99fec1f88a80 x1876445617352320/t30064771115(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.695773:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f88a80 with x1876445617352320 ext(15728640->16777215) 00002000:00010000:1.0:1789518641.695795:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f88a80 00000100:00100000:1.0:1789518641.701435:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2343:x1876445617352448:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7345us (8037us total) trans 30064771116 rc 0/0 00000100:00100000:1.0:1789518641.701450:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00002000:00100000:1.0:1789518641.701466:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (16777216->17825791) req@ffff99fec1f8b480 x1876445617352448/t30064771116(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.701478:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8b480 with x1876445617352448 ext(16777216->17825791) 00002000:00010000:1.0:1789518641.701486:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8b480 00000100:00100000:2.0:1789518641.705664:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.705820:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617352576 00000100:00100000:1.0:1789518641.705830:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617352576 00002000:00100000:1.0:1789518641.705876:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (17825792->18874367) req@ffff99fec1f8aa00 x1876445617352576/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.705889:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8aa00 with x1876445617352576 ext(17825792->18874367) 00002000:00010000:1.0:1789518641.705895:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8aa00 00000100:00100000:1.0:1789518641.705928:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:1.0:1789518641.705939:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2345:x1876445617352576:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.716842:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2345:x1876445617352576:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 10890us (11214us total) trans 30064771117 rc 0/0 00000100:00100000:1.0:1789518641.716852:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00002000:00100000:1.0:1789518641.716862:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (17825792->18874367) req@ffff99fec1f8aa00 x1876445617352576/t30064771117(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.716869:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8aa00 with x1876445617352576 ext(17825792->18874367) 00002000:00010000:1.0:1789518641.716874:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8aa00 00000100:00100000:0.0:1789518641.721759:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.721909:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617352704 00000100:00100000:1.0:1789518641.721923:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617352704 00002000:00100000:1.0:1789518641.721988:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (18874368->19922943) req@ffff99ffeda68e00 x1876445617352704/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.722001:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda68e00 with x1876445617352704 ext(18874368->19922943) 00002000:00010000:1.0:1789518641.722008:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda68e00 00000100:00100000:1.0:1789518641.722147:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:1.0:1789518641.722160:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2344:x1876445617352704:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.731634:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2344:x1876445617352704:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9440us (9853us total) trans 30064771118 rc 0/0 00000100:00100000:1.0:1789518641.731652:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00002000:00100000:1.0:1789518641.731669:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (18874368->19922943) req@ffff99ffeda68e00 x1876445617352704/t30064771118(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.731681:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda68e00 with x1876445617352704 ext(18874368->19922943) 00002000:00010000:1.0:1789518641.731689:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda68e00 00000100:00100000:2.0:1789518641.744991:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.745197:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617352832 00000100:00100000:1.0:1789518641.745210:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617352832 00002000:00100000:1.0:1789518641.745292:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (19922944->20971519) req@ffff99fec1f89880 x1876445617352832/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.745305:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f89880 with x1876445617352832 ext(19922944->20971519) 00002000:00010000:1.0:1789518641.745313:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f89880 00000100:00100000:1.0:1789518641.745391:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1789518641.745402:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2344:x1876445617352832:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518641.754161:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:2344:x1876445617352832:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8743us (9230us total) trans 30064771119 rc 0/0 00000100:00100000:0.0:1789518641.754183:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00002000:00100000:0.0:1789518641.754201:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (19922944->20971519) req@ffff99fec1f89880 x1876445617352832/t30064771119(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.754215:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f89880 with x1876445617352832 ext(19922944->20971519) 00002000:00010000:0.0:1789518641.754223:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f89880 00000100:00100000:1.0:1789518641.763157:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.764205:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617352960 00000100:00100000:0.0:1789518641.764221:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617352960 00002000:00100000:0.0:1789518641.764289:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (20971520->22020095) req@ffff99fec8341180 x1876445617352960/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.764303:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8341180 with x1876445617352960 ext(20971520->22020095) 00002000:00010000:0.0:1789518641.764311:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8341180 00000100:00100000:0.0:1789518641.764344:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1789518641.764355:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:2342:x1876445617352960:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.777309:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:2342:x1876445617352960:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 12939us (14150us total) trans 30064771120 rc 0/0 00000100:00100000:1.0:1789518641.777338:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00002000:00100000:1.0:1789518641.777354:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (20971520->22020095) req@ffff99fec8341180 x1876445617352960/t30064771120(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.777365:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8341180 with x1876445617352960 ext(20971520->22020095) 00002000:00010000:1.0:1789518641.777374:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8341180 00000100:00100000:2.0:1789518641.779064:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.779251:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617353088 00000100:00100000:1.0:1789518641.779263:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617353088 00002000:00100000:1.0:1789518641.779553:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (22020096->23068671) req@ffff99fec1f8ad80 x1876445617353088/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.779571:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8ad80 with x1876445617353088 ext(22020096->23068671) 00002000:00010000:1.0:1789518641.779579:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8ad80 00000100:00100000:1.0:1789518641.779641:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1789518641.779654:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:2344:x1876445617353088:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.787538:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:2344:x1876445617353088:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7870us (8472us total) trans 30064771121 rc 0/0 00000100:00100000:1.0:1789518641.787555:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00002000:00100000:1.0:1789518641.787572:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (22020096->23068671) req@ffff99fec1f8ad80 x1876445617353088/t30064771121(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.787595:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1f8ad80 with x1876445617353088 ext(22020096->23068671) 00002000:00010000:1.0:1789518641.787605:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1f8ad80 00000100:00100000:0.0:1789518641.793462:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.794022:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617353216 00000100:00100000:1.0:1789518641.794054:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617353216 00002000:00100000:1.0:1789518641.794118:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (23068672->24117247) req@ffff99ffeda69500 x1876445617353216/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.794131:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda69500 with x1876445617353216 ext(23068672->24117247) 00002000:00010000:1.0:1789518641.794138:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda69500 00000100:00100000:1.0:1789518641.794188:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518641.794263:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:2345:x1876445617353216:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.803333:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.803406:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617353344 00000100:00100000:1.0:1789518641.803418:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617353344 00002000:00100000:1.0:1789518641.803478:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (24117248->25165823) req@ffff99fff7a7b100 x1876445617353344/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.803492:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a7b100 with x1876445617353344 ext(24117248->25165823) 00002000:00010000:1.0:1789518641.803510:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a7b100 00000100:00100000:1.0:1789518641.803561:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1789518641.803573:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:2344:x1876445617353344:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.815421:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2345:x1876445617353216:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 21203us (21953us total) trans 30064771122 rc 0/0 00000100:00100000:2.0:1789518641.815441:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00002000:00100000:2.0:1789518641.815463:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (23068672->24117247) req@ffff99ffeda69500 x1876445617353216/t30064771122(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.815476:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda69500 with x1876445617353216 ext(23068672->24117247) 00002000:00010000:2.0:1789518641.815488:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffeda69500 00000100:00100000:0.0:1789518641.816156:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2344:x1876445617353344:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 12581us (12844us total) trans 30064771123 rc 0/0 00000100:00100000:0.0:1789518641.816172:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00002000:00100000:0.0:1789518641.816179:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (24117248->25165823) req@ffff99fff7a7b100 x1876445617353344/t30064771123(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.816188:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a7b100 with x1876445617353344 ext(24117248->25165823) 00002000:00010000:0.0:1789518641.816192:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a7b100 00000100:00100000:2.0:1789518641.820331:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.820517:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617353472 00000100:00100000:0.0:1789518641.820531:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617353472 00002000:00100000:0.0:1789518641.820598:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (25165824->26214399) req@ffff99fff7a7b800 x1876445617353472/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.820652:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a7b800 with x1876445617353472 ext(25165824->26214399) 00002000:00010000:0.0:1789518641.820662:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a7b800 00000100:00100000:0.0:1789518641.820698:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:0.0:1789518641.820710:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2343:x1876445617353472:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.827939:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:2343:x1876445617353472:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7218us (7609us total) trans 30064771124 rc 0/0 00000100:00100000:2.0:1789518641.827954:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00002000:00100000:2.0:1789518641.827969:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (25165824->26214399) req@ffff99fff7a7b800 x1876445617353472/t30064771124(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.827980:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a7b800 with x1876445617353472 ext(25165824->26214399) 00002000:00010000:2.0:1789518641.827987:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a7b800 00000100:00100000:1.0:1789518641.829746:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.829847:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617353600 00000100:00100000:2.0:1789518641.829858:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617353600 00002000:00100000:2.0:1789518641.829917:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (26214400->27262975) req@ffff99fec8341500 x1876445617353600/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.829930:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8341500 with x1876445617353600 ext(26214400->27262975) 00002000:00010000:2.0:1789518641.829937:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8341500 00000100:00100000:2.0:1789518641.830041:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:2.0:1789518641.830053:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:2345:x1876445617353600:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.838440:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:2345:x1876445617353600:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8371us (8687us total) trans 30064771125 rc 0/0 00000100:00100000:1.0:1789518641.838457:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00002000:00100000:1.0:1789518641.838474:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (26214400->27262975) req@ffff99fec8341500 x1876445617353600/t30064771125(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.838485:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8341500 with x1876445617353600 ext(26214400->27262975) 00002000:00010000:1.0:1789518641.838493:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8341500 00000100:00100000:2.0:1789518641.844710:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518641.845112:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617353728 00000100:00100000:3.0:1789518641.845124:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617353728 00002000:00100000:3.0:1789518641.845182:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (27262976->28311551) req@ffff99fff7a79500 x1876445617353728/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518641.845196:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a79500 with x1876445617353728 ext(27262976->28311551) 00002000:00010000:3.0:1789518641.845203:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a79500 00000100:00100000:3.0:1789518641.845273:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1789518641.845283:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:2344:x1876445617353728:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.855722:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.856654:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617353856 00000100:00100000:1.0:1789518641.856668:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617353856 00002000:00100000:1.0:1789518641.856735:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (28311552->29360127) req@ffff99ffd1009500 x1876445617353856/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.856749:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1009500 with x1876445617353856 ext(28311552->29360127) 00002000:00010000:1.0:1789518641.856759:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1009500 00000100:00100000:1.0:1789518641.856801:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:1.0:1789518641.856812:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:2344:x1876445617353856:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518641.864739:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+65:2344:x1876445617353728:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 19443us (20028us total) trans 30064771126 rc 0/0 00000100:00100000:0.0:1789518641.864756:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00002000:00100000:0.0:1789518641.864772:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (27262976->28311551) req@ffff99fff7a79500 x1876445617353728/t30064771126(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.864783:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a79500 with x1876445617353728 ext(27262976->28311551) 00002000:00010000:0.0:1789518641.864791:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a79500 00000100:00100000:3.0:1789518641.866775:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+65:2344:x1876445617353856:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9950us (11052us total) trans 30064771127 rc 0/0 00000100:00100000:3.0:1789518641.866792:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00002000:00100000:3.0:1789518641.866807:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (28311552->29360127) req@ffff99ffd1009500 x1876445617353856/t30064771127(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518641.866819:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1009500 with x1876445617353856 ext(28311552->29360127) 00002000:00010000:3.0:1789518641.866844:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd1009500 00000100:00100000:1.0:1789518641.871142:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.871386:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617353984 00000100:00100000:2.0:1789518641.871399:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617353984 00002000:00100000:2.0:1789518641.871462:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (29360128->30408703) req@ffff99fec8343b80 x1876445617353984/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.871475:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8343b80 with x1876445617353984 ext(29360128->30408703) 00002000:00010000:2.0:1789518641.871482:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8343b80 00000100:00100000:2.0:1789518641.871671:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:2.0:1789518641.871683:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+65:2345:x1876445617353984:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.881755:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:2345:x1876445617353984:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 10056us (10609us total) trans 30064771128 rc 0/0 00000100:00100000:2.0:1789518641.881772:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00002000:00100000:2.0:1789518641.881789:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (29360128->30408703) req@ffff99fec8343b80 x1876445617353984/t30064771128(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.881801:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8343b80 with x1876445617353984 ext(29360128->30408703) 00002000:00010000:2.0:1789518641.881809:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8343b80 00000100:00100000:2.0:1789518641.890078:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.890189:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617354112 00000100:00100000:1.0:1789518641.890201:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617354112 00002000:00100000:1.0:1789518641.890265:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (30408704->31457279) req@ffff99fec1b9dc00 x1876445617354112/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.890278:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9dc00 with x1876445617354112 ext(30408704->31457279) 00002000:00010000:1.0:1789518641.890285:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9dc00 00000100:00100000:1.0:1789518641.890324:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:1.0:1789518641.890335:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:2342:x1876445617354112:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518641.897958:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:2342:x1876445617354112:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7610us (7880us total) trans 30064771129 rc 0/0 00000100:00100000:0.0:1789518641.897974:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00002000:00100000:0.0:1789518641.897990:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (30408704->31457279) req@ffff99fec1b9dc00 x1876445617354112/t30064771129(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.898002:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9dc00 with x1876445617354112 ext(30408704->31457279) 00002000:00010000:0.0:1789518641.898011:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9dc00 00000100:00100000:1.0:1789518641.909335:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.909491:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617354240 00000100:00100000:2.0:1789518641.909516:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617354240 00002000:00100000:2.0:1789518641.909581:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (31457280->32505855) req@ffff99fec8342d80 x1876445617354240/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.909666:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8342d80 with x1876445617354240 ext(31457280->32505855) 00002000:00010000:2.0:1789518641.909673:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8342d80 00000100:00100000:2.0:1789518641.909705:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:2.0:1789518641.909716:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:2343:x1876445617354240:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.917895:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+71:2343:x1876445617354240:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8166us (8561us total) trans 30064771130 rc 0/0 00000100:00100000:2.0:1789518641.917911:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00002000:00100000:2.0:1789518641.917928:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (31457280->32505855) req@ffff99fec8342d80 x1876445617354240/t30064771130(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.917939:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8342d80 with x1876445617354240 ext(31457280->32505855) 00002000:00010000:2.0:1789518641.917947:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8342d80 00000100:00100000:1.0:1789518641.922999:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.924148:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617354368 00000100:00100000:2.0:1789518641.924161:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617354368 00002000:00100000:2.0:1789518641.924224:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (32505856->33554431) req@ffff99fec8342680 x1876445617354368/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.924238:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8342680 with x1876445617354368 ext(32505856->33554431) 00002000:00010000:2.0:1789518641.924244:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8342680 00000100:00100000:2.0:1789518641.924492:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:2.0:1789518641.924521:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8342680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+71:2345:x1876445617354368:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789518641.934754:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.934877:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617354496 00000100:00100000:0.0:1789518641.934891:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617354496 00002000:00100000:0.0:1789518641.935143:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (33554432->34603007) req@ffff99fffbb83b80 x1876445617354496/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.935153:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb83b80 with x1876445617354496 ext(33554432->34603007) 00002000:00010000:0.0:1789518641.935159:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb83b80 00000100:00100000:0.0:1789518641.935197:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:0.0:1789518641.935211:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:2344:x1876445617354496:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.941143:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8342680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:2345:x1876445617354368:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 16624us (18150us total) trans 30064771131 rc 0/0 00000100:00100000:2.0:1789518641.941155:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00002000:00100000:2.0:1789518641.941177:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (32505856->33554431) req@ffff99fec8342680 x1876445617354368/t30064771131(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.941187:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8342680 with x1876445617354368 ext(32505856->33554431) 00002000:00010000:2.0:1789518641.941194:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8342680 00000100:00100000:2.0:1789518641.946784:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518641.947243:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617354624 00000100:00100000:3.0:1789518641.947253:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617354624 00002000:00100000:3.0:1789518641.947302:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (34603008->35651583) req@ffff99fec1b9d180 x1876445617354624/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518641.947315:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9d180 with x1876445617354624 ext(34603008->35651583) 00002000:00010000:3.0:1789518641.947322:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9d180 00000100:00100000:3.0:1789518641.947345:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:3.0:1789518641.947357:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:2345:x1876445617354624:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518641.949072:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:2344:x1876445617354496:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 13846us (14319us total) trans 30064771132 rc 0/0 00000100:00100000:0.0:1789518641.949089:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00002000:00100000:0.0:1789518641.949103:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (33554432->34603007) req@ffff99fffbb83b80 x1876445617354496/t30064771132(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.949115:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb83b80 with x1876445617354496 ext(33554432->34603007) 00002000:00010000:0.0:1789518641.949123:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb83b80 00000100:00100000:0.0:1789518641.954851:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:2345:x1876445617354624:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7486us (8066us total) trans 30064771133 rc 0/0 00000100:00100000:0.0:1789518641.954865:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00002000:00100000:0.0:1789518641.954878:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (34603008->35651583) req@ffff99fec1b9d180 x1876445617354624/t30064771133(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.954890:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9d180 with x1876445617354624 ext(34603008->35651583) 00002000:00010000:0.0:1789518641.954897:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9d180 00000100:00100000:2.0:1789518641.959008:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518641.959114:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617354752 00000100:00100000:1.0:1789518641.959125:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617354752 00002000:00100000:1.0:1789518641.959175:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (35651584->36700159) req@ffff99fec1b9c000 x1876445617354752/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.959196:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9c000 with x1876445617354752 ext(35651584->36700159) 00002000:00010000:1.0:1789518641.959220:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9c000 00000100:00100000:1.0:1789518641.959254:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1789518641.959264:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:2343:x1876445617354752:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789518641.967297:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+79:2343:x1876445617354752:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8019us (8283us total) trans 30064771134 rc 0/0 00000100:00100000:3.0:1789518641.967313:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00002000:00100000:3.0:1789518641.967329:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (35651584->36700159) req@ffff99fec1b9c000 x1876445617354752/t30064771134(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518641.967340:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9c000 with x1876445617354752 ext(35651584->36700159) 00002000:00010000:3.0:1789518641.967348:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9c000 00000100:00100000:2.0:1789518641.972519:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518641.972696:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617354880 00000100:00100000:0.0:1789518641.972706:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617354880 00002000:00100000:0.0:1789518641.972749:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (36700160->37748735) req@ffff99fec1b9f100 x1876445617354880/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518641.972760:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9f100 with x1876445617354880 ext(36700160->37748735) 00002000:00010000:0.0:1789518641.972766:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9f100 00000100:00100000:0.0:1789518641.972795:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:0.0:1789518641.972804:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+79:2342:x1876445617354880:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518641.980272:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+81:2342:x1876445617354880:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7461us (7753us total) trans 30064771135 rc 0/0 00000100:00100000:1.0:1789518641.980285:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00002000:00100000:1.0:1789518641.980296:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (36700160->37748735) req@ffff99fec1b9f100 x1876445617354880/t30064771135(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518641.980306:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9f100 with x1876445617354880 ext(36700160->37748735) 00002000:00010000:1.0:1789518641.980312:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9f100 00000100:00100000:3.0:1789518641.986688:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518641.986834:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617355008 00000100:00100000:2.0:1789518641.986845:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617355008 00002000:00100000:2.0:1789518641.986890:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (37748736->38797311) req@ffff99fffbb81c00 x1876445617355008/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/0 e 0 to 0 dl 1789518652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.986901:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb81c00 with x1876445617355008 ext(37748736->38797311) 00002000:00010000:2.0:1789518641.986907:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb81c00 00000100:00100000:2.0:1789518641.986939:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:2.0:1789518641.986948:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+81:2343:x1876445617355008:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518641.994270:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+83:2343:x1876445617355008:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7313us (7582us total) trans 30064771136 rc 0/0 00000100:00100000:2.0:1789518641.994283:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00002000:00100000:2.0:1789518641.994295:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (37748736->38797311) req@ffff99fffbb81c00 x1876445617355008/t30064771136(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:287/0 lens 488/448 e 0 to 0 dl 1789518652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518641.994305:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb81c00 with x1876445617355008 ext(37748736->38797311) 00002000:00010000:2.0:1789518641.994311:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb81c00 00000100:00100000:1.0:1789518642.000980:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518642.001044:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617355136 00000100:00100000:3.0:1789518642.001053:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617355136 00002000:00100000:3.0:1789518642.001263:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (38797312->39845887) req@ffff99fec8341f80 x1876445617355136/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518642.001275:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8341f80 with x1876445617355136 ext(38797312->39845887) 00002000:00010000:3.0:1789518642.001281:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8341f80 00000100:00100000:3.0:1789518642.001326:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1789518642.001335:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+83:2342:x1876445617355136:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518642.008209:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+85:2342:x1876445617355136:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 6810us (7173us total) trans 30064771137 rc 0/0 00000100:00100000:0.0:1789518642.008224:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00002000:00100000:0.0:1789518642.008238:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (38797312->39845887) req@ffff99fec8341f80 x1876445617355136/t30064771137(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.008250:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8341f80 with x1876445617355136 ext(38797312->39845887) 00002000:00010000:0.0:1789518642.008257:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8341f80 00000100:00100000:3.0:1789518642.013893:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.014044:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617355264 00000100:00100000:1.0:1789518642.014055:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617355264 00002000:00100000:1.0:1789518642.014112:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (39845888->40894463) req@ffff99fffbb82d80 x1876445617355264/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.014124:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb82d80 with x1876445617355264 ext(39845888->40894463) 00002000:00010000:1.0:1789518642.014130:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb82d80 00000100:00100000:1.0:1789518642.014169:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:1.0:1789518642.014178:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+85:2343:x1876445617355264:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789518642.023480:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+87:2343:x1876445617355264:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9239us (9532us total) trans 30064771138 rc 0/0 00000100:00100000:3.0:1789518642.023503:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00002000:00100000:3.0:1789518642.023519:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (39845888->40894463) req@ffff99fffbb82d80 x1876445617355264/t30064771138(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518642.023530:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb82d80 with x1876445617355264 ext(39845888->40894463) 00002000:00010000:3.0:1789518642.023537:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffbb82d80 00000100:00100000:1.0:1789518642.023853:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.023924:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617355392 00000100:00100000:0.0:1789518642.023931:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617355392 00002000:00100000:0.0:1789518642.023963:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (40894464->41943039) req@ffff99fec8343800 x1876445617355392/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.023972:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8343800 with x1876445617355392 ext(40894464->41943039) 00002000:00010000:0.0:1789518642.023976:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8343800 00000100:00100000:0.0:1789518642.024040:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:0.0:1789518642.024049:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+87:2342:x1876445617355392:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518642.030471:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:2342:x1876445617355392:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 6407us (6603us total) trans 30064771139 rc 0/0 00000100:00100000:0.0:1789518642.030488:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00002000:00100000:0.0:1789518642.030517:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (40894464->41943039) req@ffff99fec8343800 x1876445617355392/t30064771139(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.030528:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8343800 with x1876445617355392 ext(40894464->41943039) 00002000:00010000:0.0:1789518642.030537:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8343800 00000100:00100000:2.0:1789518642.032794:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.032989:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617355520 00000100:00100000:0.0:1789518642.033004:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617355520 00002000:00100000:0.0:1789518642.033075:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (41943040->42811391) req@ffff99fec1b9e300 x1876445617355520/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.033088:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9e300 with x1876445617355520 ext(41943040->42811391) 00002000:00010000:0.0:1789518642.033094:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9e300 00000100:00100000:0.0:1789518642.033136:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:0.0:1789518642.033152:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:2342:x1876445617355520:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00010000:00010000:3.0:1789518642.034935:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518642.048573:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+91:2342:x1876445617355520:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 15411us (15776us total) trans 30064771140 rc 0/0 00000100:00100000:0.0:1789518642.048590:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00002000:00100000:0.0:1789518642.048606:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (41943040->42811391) req@ffff99fec1b9e300 x1876445617355520/t30064771140(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.048643:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9e300 with x1876445617355520 ext(41943040->42811391) 00002000:00010000:0.0:1789518642.048651:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9e300 00000100:00100000:2.0:1789518642.050553:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.050701:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617355648 00000100:00100000:0.0:1789518642.050713:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617355648 00000100:00100000:0.0:1789518642.050783:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 256 00000100:00100000:0.0:1789518642.050795:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:34359:x1876445617355648:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789518642.062443:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.062492:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617355776 00000100:00100000:0.0:1789518642.062515:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617355776 00000100:00100000:1.0:1789518642.062527:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.062557:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617355904 00000100:00100000:1.0:1789518642.062562:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617355904 00000100:00100000:0.0:1789518642.062579:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:0.0:1789518642.062591:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617355776:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518642.062712:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1789518642.062722:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617355904:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518642.062770:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617355904:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 51us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518642.062779:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1789518642.062798:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617355776:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 206us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518642.062811:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00080000:2.0:1789518642.064236:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518642.064299:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518642.064386:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617356032 00000100:00100000:3.0:1789518642.064394:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617356032 00000100:00080000:2.0:1789518642.064492:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518642.064506:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518642.064517:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617356032:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518642.064582:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617356032:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 67us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518642.064590:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:1.0:1789518642.069210:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.069307:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518642.069579:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617356160 00000100:00100000:2.0:1789518642.069591:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617356160 00000100:00100000:3.0:1789518642.069644:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617356288 00000100:00100000:3.0:1789518642.069650:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617356288 00000100:00100000:2.0:1789518642.069927:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:2.0:1789518642.069940:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2341:x1876445617356160:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:2.0:1789518642.069978:0:36532:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7855a4 00000100:00080000:2.0:1789518642.069998:0:36532:0:(import.c:65:import_set_state_nolock()) ffff99ffeedd4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789518642.070049:0:36532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771095 00000100:00100000:2.0:1789518642.070303:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+2:2341:x1876445617356160:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 365us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518642.070312:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00080000:2.0:1789518642.070466:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518642.070471:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789518642.070517:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518642.071317:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:3.0:1789518642.071328:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2341:x1876445617356288:12345-192.168.206.51@tcp:9:kworker.0 00000020:00000080:3.0:1789518642.071353:0:37973:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x631fd8698c7855ab 00000100:00080000:3.0:1789518642.071369:0:37973:0:(import.c:65:import_set_state_nolock()) ffff99fec2aba800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789518642.071408:0:37973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771140 00010000:00010000:0.0:1789518642.071542:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518642.071650:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+2:2341:x1876445617356288:12345-192.168.206.51@tcp:9:kworker.0 Request processed in 324us (2343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518642.071658:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000001:00080000:0.0:1789518642.074891:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771287 is committed 00000004:00080000:0.0:1789518642.074904:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789518642.074925:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803899 batchid updated 00000020:00080000:2.0:1789518642.075096:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803899 00000020:00080000:2.0:1789518642.075114:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803899 00000100:00100000:2.0:1789518642.075125:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518642.075150:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627657088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789518642.075234:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518642.075288:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627657088 00000100:00100000:0.0:1789518642.075297:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627657088 00000100:00080000:2.0:1789518642.075339:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518642.075362:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789518642.075370:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627657088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789518642.075572:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb size from disk: 0 -> 42811392 00002000:00010000:0.0:1789518642.075576:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb mtime from disk: 0 -> 1789518642 00002000:00010000:0.0:1789518642.075579:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518642.075581:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb ctime from disk: 1789518642 -> 1789518642 00002000:00010000:0.0:1789518642.075583:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518642.075657:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627657088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (423us total) trans 30064771141 rc 0/0 00000100:00100000:0.0:1789518642.075668:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789518642.075669:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:34359:x1876445617355648:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 24871us (25123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518642.075683:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 256 00000100:00100000:3.0:1789518642.075695:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771098 gen 2 00000004:00080000:3.0:1789518642.075703:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec3477b80, transno 30064771096 00000004:00080000:3.0:1789518642.075723:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771098 committed transno 30064771098 00000100:00100000:3.0:1789518642.075750:0:3282:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fec1b9ed80 x1876445627657088/t30064771141(30064771141) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518658 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789518642.075761:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec1b9ed80/2, rc 0, transno 30064771141 00000100:00100000:3.0:1789518642.075765:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627657088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789518642.077651:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.077708:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617356416 00000100:00100000:1.0:1789518642.077729:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617356416 00000100:00100000:1.0:1789518642.077823:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:1.0:1789518642.077833:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+91:2342:x1876445617356416:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789518642.154342:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771141 is committed 00000001:00080000:0.0:1789518642.154363:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771140 is committed 00000100:00100000:1.0:1789518642.154573:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2342:x1876445617356416:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 76733us (76918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518642.154586:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000001:00100000:0.0:1789518642.154604:0:7607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0 00000020:00000080:0.0:1789518642.154608:0:7607:0:(genops.c:885:class_export_put()) final put ffff99fec2ab8000/4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0 00000020:00000080:2.0:1789518642.154679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99fec2ab8000/4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0 for lustre-OST0001 00000020:00000080:2.0:1789518642.154727:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99fec2aba800 for lustre-OST0001 00000100:00100000:2.0:1789518642.158008:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518642.158074:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617356672 00000100:00100000:3.0:1789518642.158193:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617356672 00000100:00100000:3.0:1789518642.158282:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 257 00000100:00100000:3.0:1789518642.158294:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:34359:x1876445617356672:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518642.158370:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518642.158405:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786595 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc9 expref: 16 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.158428:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:3.0:1789518642.158435:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518642.158477:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.158503:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.158515:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518642.158874:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f0341fe reply state 00000000bcb03477 transno 30064771288 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518642.158885:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518642.159007:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:34359:x1876445617356672:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 714us (1012us total) trans 30064771288 rc 0/0 00000100:00100000:3.0:1789518642.159016:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 257 00000100:00100000:3.0:1789518642.162120:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:0.0:1789518642.162174:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.162191:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.162198:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.162206:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518642.162212:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.162220:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518642.162310:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617356800 00000100:00100000:2.0:1789518642.162324:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617356800 00010000:00010000:0.0:1789518642.162378:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:0.0:1789518642.162383:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518642.162390:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.162398:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c7865aa lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518642.162408:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:2.0:1789518642.162420:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617356800:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518642.162875:0:37973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb size from disk: 42811392 -> 42811392 00002000:00010000:2.0:1789518642.162880:0:37973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb mtime from disk: 1789518642 -> 1789518641 00002000:00010000:2.0:1789518642.162883:0:37973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb atime from disk: 0 -> 1789518641 00002000:00010000:2.0:1789518642.162886:0:37973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb ctime from disk: 1789518642 -> 1789518641 00002000:00010000:2.0:1789518642.162889:0:37973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb blocks from disk: 1 -> 83975 00000100:00100000:2.0:1789518642.162972:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617356800:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 552us (863us total) trans 30064771142 rc 0/0 00000100:00100000:2.0:1789518642.162982:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:2.0:1789518642.166909:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.167020:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617357056 00000100:00100000:1.0:1789518642.167033:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617357056 00000100:00100000:1.0:1789518642.167119:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 258 00000100:00100000:1.0:1789518642.167130:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:34359:x1876445617357056:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789518642.167224:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.167245:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcbb expref: 16 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.167278:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.167340:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcbb expref: 16 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.167357:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcbb expref: 16 pid: 35845 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518642.167374:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9670e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627657216:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518642.167483:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518642.171557:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518642.171587:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9670e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627657216:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518642.171642:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617357184 00000100:00100000:0.0:1789518642.171652:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617357184 00010000:00010000:2.0:1789518642.171665:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.171704:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcbb expref: 17 pid: 35845 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518642.171749:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:0.0:1789518642.171760:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617357184:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518642.171777:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518642.171785:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcbb expref: 17 pid: 35845 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.171800:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcbb expref: 17 pid: 35845 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.171830:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c786579 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcbb expref: 17 pid: 35845 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.171850:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:0.0:1789518642.171855:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.171878:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.171887:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.171918:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518642.171993:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617357184:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 234us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518642.172001:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00010000:00010000:2.0:1789518642.172313:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.172323:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.172361:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.172369:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.172376:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.172401:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518642.172406:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.172415:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.172426:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:2.0:1789518642.172429:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789518642.172434:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.172440:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7865b1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518642.172556:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:34359:x1876445617357056:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 5426us (5658us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789518642.172566:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 258 00000100:00100000:1.0:1789518642.174657:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.175064:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617357312 00000100:00100000:0.0:1789518642.175076:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617357312 00000100:00100000:0.0:1789518642.175142:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:0.0:1789518642.175155:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617357312:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789518642.175213:0:36533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.175239:0:36533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 9 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.175258:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789518642.175263:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518642.175269:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.175313:0:36533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 9 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.175329:0:36533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 9 pid: 36531 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518642.175347:0:36533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3477b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627657344:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518642.175447:0:36533:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518642.176879:0:36533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3477b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627657344:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518642.176910:0:36533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518642.222985:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.223816:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617357440 00000100:00100000:0.0:1789518642.223830:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617357440 00010000:00010000:0.0:1789518642.223882:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 10 pid: 36531 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518642.223941:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:0.0:1789518642.223953:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9670380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617357440:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518642.223972:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518642.224003:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 10 pid: 36531 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.224019:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 10 pid: 36531 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.224049:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c7865a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcd7 expref: 10 pid: 36531 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.224072:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518642.224078:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518642.224084:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.224096:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.224138:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518642.224264:0:36533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.224277:0:36533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518642.224287:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9670380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617357440:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 334us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518642.224298:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00010000:00010000:1.0:1789518642.224319:0:36533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.224331:0:36533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.224359:0:36533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.224368:0:36533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518642.224373:0:36533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.224383:0:36533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.224395:0:36533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518642.224402:0:36533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7dfc8ba/0x631fd8698c7865b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518642.224455:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617357312:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 49303us (49845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518642.224463:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:3.0:1789518642.227995:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518642.228077:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617357696 00000100:00100000:2.0:1789518642.228090:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617357696 00000100:00100000:2.0:1789518642.228159:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 259 00000100:00100000:2.0:1789518642.228167:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:34359:x1876445617357696:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789518642.228255:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.228272:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.228281:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.228531:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.228544:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc2 expref: 16 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.228553:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.228600:0:35847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc2 expref: 16 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.228649:0:35847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc2 expref: 16 pid: 35846 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518642.228667:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627657472:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518642.228828:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518642.231023:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.231080:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617357824 00000100:00100000:0.0:1789518642.231094:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617357824 00010000:00010000:0.0:1789518642.231150:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc2 expref: 17 pid: 35846 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518642.231230:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:0.0:1789518642.231243:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617357824:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518642.231264:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518642.231273:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc2 expref: 17 pid: 35846 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.231290:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc2 expref: 17 pid: 35846 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.231318:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:0.0:1789518642.231325:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.231342:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.231352:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.231380:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518642.231426:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c786587 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcc2 expref: 17 pid: 35846 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518642.231454:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627657472:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518642.231466:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617357824:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 222us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518642.231477:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00010000:00010000:2.0:1789518642.231486:0:35847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.231508:0:35847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.231515:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518642.231841:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771289 00000001:00080000:2.0:1789518642.232007:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771290 00000001:00080000:2.0:1789518642.232074:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771291 00000100:00100000:2.0:1789518642.232167:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627657600:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789518642.232231:0:35847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518642.232279:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518642.232809:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627657600 00000100:00100000:0.0:1789518642.232819:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627657600 00000100:00100000:0.0:1789518642.232876:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789518642.232887:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35847:x1876445627657600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518642.232990:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35847:x1876445627657600:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518642.232997:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789518642.233169:0:35847:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771141 gen 2 00000004:00080000:2.0:1789518642.233176:0:35847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec1b9ed80, transno 30064771141 00000100:00100000:2.0:1789518642.233199:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627657600:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789518642.234307:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771292 00000100:00100000:2.0:1789518642.234408:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627657728:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789518642.234474:0:35847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518642.234523:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789518642.234598:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627657728 00000100:00100000:0.0:1789518642.234608:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627657728 00000100:00100000:0.0:1789518642.234820:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789518642.234828:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35847:x1876445627657728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789518642.235121:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35847:x1876445627657728:12345-0@lo:1000:mdt00_002.0 Request processed in 293us (647us total) trans 30064771143 rc 0/0 00000100:00100000:0.0:1789518642.235130:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789518642.235207:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35847:1876445627657728:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789518642.235251:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235263:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235271:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235278:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518642.235284:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235293:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235324:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99fec3b12a00) 00010000:00010000:2.0:1789518642.235327:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518642.235333:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235340:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5c00/0x631fd8698c7865c6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235379:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235386:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235391:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235396:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518642.235399:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235405:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235412:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:2.0:1789518642.235414:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518642.235422:0:35847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864fb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc98 expref: 19 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235434:0:35847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864fb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc98 expref: 19 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235454:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864fb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc98 expref: 19 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.235492:0:35847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5000/0x631fd8698c7864fb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdc98 expref: 19 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518642.235515:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627657856:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518642.235599:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789518642.240150:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.240233:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617357952 00000100:00100000:0.0:1789518642.240247:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617357952 00000100:00100000:2.0:1789518642.240262:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627657856:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518642.240312:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240329:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7864f4 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518642.240364:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1789518642.240381:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:34358:x1876445617357952:12345-192.168.206.51@tcp:49:dd.0 00010000:00010000:2.0:1789518642.240386:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240411:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240428:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240443:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240450:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240492:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240511:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518642.240516:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240534:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240550:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:2.0:1789518642.240554:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518642.240558:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240565:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7865cd lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240577:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240584:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240590:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240596:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518642.240600:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240648:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240657:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:2.0:1789518642.240660:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518642.240663:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.240669:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7865bf lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518642.241016:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:34358:x1876445617357952:12345-192.168.206.51@tcp:49:dd.0 Request processed in 636us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518642.241028:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1789518642.241199:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:34359:x1876445617357696:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 13030us (13216us total) trans 30064771293 rc 0/0 00000100:00100000:2.0:1789518642.241212:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 259 00000020:00080000:2.0:1789518642.241218:0:35847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789518642.241542:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518642.241547:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518642.241578:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:0.0:1789518642.241586:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789518642.245276:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518642.245344:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617358080 00000100:00100000:1.0:1789518642.245357:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518642.245361:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617358080 00000100:00100000:2.0:1789518642.245453:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:2.0:1789518642.245466:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:34358:x1876445617358080:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518642.245515:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518642.245549:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c7865d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcde expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518642.245574:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617358336 00000100:00100000:3.0:1789518642.245580:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617358336 00000100:00100000:3.0:1789518642.245749:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:3.0:1789518642.245758:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:34359:x1876445617358336:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00002000:00010000:2.0:1789518642.245843:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc6:0x0] initial LVB size: 42811392, mtime: 0x6aa9e331, atime: 0x6aa9e331, ctime: 0x6aa9e331, blocks: 0x14807 00010000:00010000:2.0:1789518642.245871:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=696s v=(0 0) 00010000:00010000:2.0:1789518642.245877:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518642.245890:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c7865d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcde expref: 9 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.245930:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077c40cb0/0x631fd8698c7865d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcde expref: 9 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.245946:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5c00, rc 0) 00000100:00100000:2.0:1789518642.246089:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:34358:x1876445617358080:12345-192.168.206.51@tcp:101:dd.0 Request processed in 625us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518642.246107:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000004:00080000:3.0:1789518642.246832:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x19:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789518642.246972:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771294 00010000:00010000:3.0:1789518642.247022:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.247039:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.247052:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.247061:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.247080:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.247087:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.247117:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518642.247207:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:34359:x1876445617358336:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1448us (1848us total) trans 30064771295 rc 0/0 00000100:00100000:3.0:1789518642.247217:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000020:00080000:3.0:1789518642.247222:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518642.247279:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518642.247288:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.247296:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16e00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518642.247301:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.247311:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.247331:0:35834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:2.0:1789518642.247334:0:35834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518642.247339:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.247345:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16e00/0x631fd8698c7865db lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518642.247365:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518642.247367:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518642.247376:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518642.274491:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518642.274746:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617358464 00000100:00100000:3.0:1789518642.274760:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617358464 00002000:00100000:3.0:1789518642.274817:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (42991616->44040191) req@ffff99fec9670000 x1876445617358464/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518642.274830:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9670000 with x1876445617358464 ext(42991616->44040191) 00002000:00010000:3.0:1789518642.274837:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9670000 00000100:00100000:3.0:1789518642.274910:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518642.274921:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2345:x1876445617358464:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.281075:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2345:x1876445617358464:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6144us (6587us total) trans 30064771144 rc 0/0 00000100:00100000:0.0:1789518642.281087:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00002000:00100000:0.0:1789518642.281102:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (42991616->44040191) req@ffff99fec9670000 x1876445617358464/t30064771144(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.281120:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9670000 with x1876445617358464 ext(42991616->44040191) 00002000:00010000:0.0:1789518642.281128:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9670000 00000100:00100000:3.0:1789518642.284539:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.284976:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617358592 00000100:00100000:1.0:1789518642.284990:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617358592 00002000:00100000:1.0:1789518642.285053:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (44040192->45088767) req@ffff99fec82f8a80 x1876445617358592/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.285213:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82f8a80 with x1876445617358592 ext(44040192->45088767) 00002000:00010000:1.0:1789518642.285221:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82f8a80 00000100:00100000:1.0:1789518642.285265:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:1.0:1789518642.285276:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617358592:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.295586:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617358592:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10295us (11043us total) trans 30064771145 rc 0/0 00000100:00100000:0.0:1789518642.295604:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00002000:00100000:0.0:1789518642.295645:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (44040192->45088767) req@ffff99fec82f8a80 x1876445617358592/t30064771145(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.295657:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82f8a80 with x1876445617358592 ext(44040192->45088767) 00002000:00010000:0.0:1789518642.295665:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82f8a80 00000100:00100000:3.0:1789518642.296843:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.296901:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617358720 00000100:00100000:0.0:1789518642.296911:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617358720 00002000:00100000:0.0:1789518642.296956:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (45088768->46137343) req@ffff99fffc5f0000 x1876445617358720/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.296964:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f0000 with x1876445617358720 ext(45088768->46137343) 00002000:00010000:0.0:1789518642.296969:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f0000 00000100:00100000:0.0:1789518642.296998:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:0.0:1789518642.297005:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617358720:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.305607:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617358720:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8576us (8745us total) trans 30064771146 rc 0/0 00000100:00100000:0.0:1789518642.305659:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00002000:00100000:0.0:1789518642.305676:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (45088768->46137343) req@ffff99fffc5f0000 x1876445617358720/t30064771146(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.305696:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f0000 with x1876445617358720 ext(45088768->46137343) 00002000:00010000:0.0:1789518642.305704:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f0000 00000100:00100000:2.0:1789518642.307375:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.307780:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617358848 00000100:00100000:0.0:1789518642.307877:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617358848 00002000:00100000:0.0:1789518642.307937:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (46137344->47185919) req@ffff99fec1b9c700 x1876445617358848/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.307950:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9c700 with x1876445617358848 ext(46137344->47185919) 00002000:00010000:0.0:1789518642.307957:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9c700 00000100:00100000:0.0:1789518642.307999:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:0.0:1789518642.308049:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617358848:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.316220:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2343:x1876445617358848:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8195us (8842us total) trans 30064771147 rc 0/0 00000100:00100000:0.0:1789518642.316236:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00002000:00100000:0.0:1789518642.316251:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (46137344->47185919) req@ffff99fec1b9c700 x1876445617358848/t30064771147(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.316264:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9c700 with x1876445617358848 ext(46137344->47185919) 00002000:00010000:0.0:1789518642.316273:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9c700 00000100:00100000:3.0:1789518642.317426:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518642.317529:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617358976 00000100:00100000:2.0:1789518642.317542:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617358976 00002000:00100000:2.0:1789518642.317591:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (47185920->48234495) req@ffff99fffc5f1180 x1876445617358976/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518642.317605:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f1180 with x1876445617358976 ext(47185920->48234495) 00002000:00010000:2.0:1789518642.317610:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f1180 00000100:00100000:2.0:1789518642.317833:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:2.0:1789518642.317844:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617358976:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518642.325231:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2342:x1876445617358976:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7373us (7798us total) trans 30064771148 rc 0/0 00000100:00100000:2.0:1789518642.325246:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00002000:00100000:2.0:1789518642.325262:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (47185920->48234495) req@ffff99fffc5f1180 x1876445617358976/t30064771148(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518642.325273:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f1180 with x1876445617358976 ext(47185920->48234495) 00002000:00010000:2.0:1789518642.325281:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f1180 00000100:00100000:3.0:1789518642.329178:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.331260:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617359104 00000100:00100000:1.0:1789518642.331279:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617359104 00002000:00100000:1.0:1789518642.331357:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (48234496->49283071) req@ffff99fffc5f1f80 x1876445617359104/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.331371:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f1f80 with x1876445617359104 ext(48234496->49283071) 00002000:00010000:1.0:1789518642.331378:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f1f80 00000100:00100000:1.0:1789518642.331420:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:1.0:1789518642.331433:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2342:x1876445617359104:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518642.338245:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2342:x1876445617359104:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6805us (9071us total) trans 30064771149 rc 0/0 00000100:00100000:3.0:1789518642.338260:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00002000:00100000:3.0:1789518642.338285:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (48234496->49283071) req@ffff99fffc5f1f80 x1876445617359104/t30064771149(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518642.338297:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f1f80 with x1876445617359104 ext(48234496->49283071) 00002000:00010000:3.0:1789518642.338305:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f1f80 00000100:00100000:2.0:1789518642.340516:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.340708:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617359232 00000100:00100000:0.0:1789518642.340718:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617359232 00002000:00100000:0.0:1789518642.340764:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (49283072->50331647) req@ffff99fec1b9c380 x1876445617359232/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.340775:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9c380 with x1876445617359232 ext(49283072->50331647) 00002000:00010000:0.0:1789518642.340780:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9c380 00000100:00100000:0.0:1789518642.340861:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:0.0:1789518642.340872:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617359232:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.347367:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2343:x1876445617359232:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6487us (6862us total) trans 30064771150 rc 0/0 00000100:00100000:0.0:1789518642.347380:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00002000:00100000:0.0:1789518642.347392:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (49283072->50331647) req@ffff99fec1b9c380 x1876445617359232/t30064771150(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.347402:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9c380 with x1876445617359232 ext(49283072->50331647) 00002000:00010000:0.0:1789518642.347408:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9c380 00000100:00100000:1.0:1789518642.352046:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.353948:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617359360 00000100:00100000:0.0:1789518642.354014:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617359360 00002000:00100000:0.0:1789518642.354090:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (50331648->51380223) req@ffff99fec9671880 x1876445617359360/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.354103:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9671880 with x1876445617359360 ext(50331648->51380223) 00002000:00010000:0.0:1789518642.354110:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9671880 00000100:00100000:0.0:1789518642.354152:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:0.0:1789518642.354163:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2342:x1876445617359360:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518642.360449:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.360555:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617359488 00000100:00100000:0.0:1789518642.360568:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617359488 00002000:00100000:0.0:1789518642.360645:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (51380224->52428799) req@ffff99fec9672a00 x1876445617359488/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.360659:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9672a00 with x1876445617359488 ext(51380224->52428799) 00002000:00010000:0.0:1789518642.360666:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9672a00 00000100:00100000:0.0:1789518642.360705:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:0.0:1789518642.360718:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2343:x1876445617359488:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.363187:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617359360:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9017us (11145us total) trans 30064771151 rc 0/0 00000100:00100000:0.0:1789518642.363200:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00002000:00100000:0.0:1789518642.363213:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (50331648->51380223) req@ffff99fec9671880 x1876445617359360/t30064771151(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.363223:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9671880 with x1876445617359360 ext(50331648->51380223) 00002000:00010000:0.0:1789518642.363230:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9671880 00000100:00100000:2.0:1789518642.370879:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518642.370969:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617359616 00000100:00100000:3.0:1789518642.370990:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617359616 00002000:00100000:3.0:1789518642.371072:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (52428800->53477375) req@ffff99fec1b9d500 x1876445617359616/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518642.371086:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9d500 with x1876445617359616 ext(52428800->53477375) 00002000:00010000:3.0:1789518642.371213:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9d500 00000100:00100000:3.0:1789518642.371258:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:3.0:1789518642.371270:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2344:x1876445617359616:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.371563:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2343:x1876445617359488:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10843us (11124us total) trans 30064771152 rc 0/0 00000100:00100000:0.0:1789518642.371575:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00002000:00100000:0.0:1789518642.371589:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (51380224->52428799) req@ffff99fec9672a00 x1876445617359488/t30064771152(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.371600:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9672a00 with x1876445617359488 ext(51380224->52428799) 00002000:00010000:0.0:1789518642.371607:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9672a00 00000100:00100000:2.0:1789518642.378512:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2344:x1876445617359616:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7226us (7623us total) trans 30064771153 rc 0/0 00000100:00100000:2.0:1789518642.378522:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00002000:00100000:2.0:1789518642.378532:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (52428800->53477375) req@ffff99fec1b9d500 x1876445617359616/t30064771153(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518642.378540:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9d500 with x1876445617359616 ext(52428800->53477375) 00002000:00010000:2.0:1789518642.378557:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9d500 00000100:00100000:2.0:1789518642.383200:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.383291:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617359744 00000100:00100000:0.0:1789518642.383307:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617359744 00002000:00100000:0.0:1789518642.383367:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (53477376->54525951) req@ffff99fec1b9ed80 x1876445617359744/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.383376:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9ed80 with x1876445617359744 ext(53477376->54525951) 00002000:00010000:0.0:1789518642.383383:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9ed80 00000100:00100000:0.0:1789518642.383416:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:0.0:1789518642.383423:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617359744:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518642.389092:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2342:x1876445617359744:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5654us (5887us total) trans 30064771154 rc 0/0 00000100:00100000:1.0:1789518642.389108:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00002000:00100000:1.0:1789518642.389125:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (53477376->54525951) req@ffff99fec1b9ed80 x1876445617359744/t30064771154(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.389137:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9ed80 with x1876445617359744 ext(53477376->54525951) 00002000:00010000:1.0:1789518642.389146:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1b9ed80 00000100:00100000:0.0:1789518642.389422:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518642.389513:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617359872 00000100:00100000:2.0:1789518642.389523:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617359872 00002000:00100000:2.0:1789518642.389572:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (54525952->55574527) req@ffff99fec3477b80 x1876445617359872/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518642.389581:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3477b80 with x1876445617359872 ext(54525952->55574527) 00002000:00010000:2.0:1789518642.389585:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec3477b80 00000100:00100000:2.0:1789518642.389633:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:2.0:1789518642.389643:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2343:x1876445617359872:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518642.394068:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2343:x1876445617359872:12345-192.168.206.51@tcp:4:dd.0 Request processed in 4409us (4630us total) trans 30064771155 rc 0/0 00000100:00100000:3.0:1789518642.394085:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00002000:00100000:3.0:1789518642.394100:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (54525952->55574527) req@ffff99fec3477b80 x1876445617359872/t30064771155(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518642.394112:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3477b80 with x1876445617359872 ext(54525952->55574527) 00002000:00010000:3.0:1789518642.394120:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec3477b80 00000100:00100000:0.0:1789518642.399399:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.399962:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617360000 00000100:00100000:1.0:1789518642.399976:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617360000 00002000:00100000:1.0:1789518642.400061:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (55574528->56623103) req@ffff99fec525ea00 x1876445617360000/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.400075:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525ea00 with x1876445617360000 ext(55574528->56623103) 00002000:00010000:1.0:1789518642.400083:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525ea00 00000100:00100000:1.0:1789518642.400126:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:1.0:1789518642.400138:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2342:x1876445617360000:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518642.404987:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2342:x1876445617360000:12345-192.168.206.51@tcp:4:dd.0 Request processed in 4837us (5589us total) trans 30064771156 rc 0/0 00000100:00100000:1.0:1789518642.405004:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00002000:00100000:1.0:1789518642.405021:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (55574528->56623103) req@ffff99fec525ea00 x1876445617360000/t30064771156(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.405033:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525ea00 with x1876445617360000 ext(55574528->56623103) 00002000:00010000:1.0:1789518642.405043:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525ea00 00000100:00100000:0.0:1789518642.408598:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.408719:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617360128 00000100:00100000:1.0:1789518642.408732:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617360128 00002000:00100000:1.0:1789518642.408792:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (56623104->57671679) req@ffff99fec525dc00 x1876445617360128/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.408806:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525dc00 with x1876445617360128 ext(56623104->57671679) 00002000:00010000:1.0:1789518642.408813:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525dc00 00000100:00100000:1.0:1789518642.408851:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:1.0:1789518642.408863:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2342:x1876445617360128:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518642.414342:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2342:x1876445617360128:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5471us (5745us total) trans 30064771157 rc 0/0 00000100:00100000:1.0:1789518642.414355:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00002000:00100000:1.0:1789518642.414379:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (56623104->57671679) req@ffff99fec525dc00 x1876445617360128/t30064771157(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.414390:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525dc00 with x1876445617360128 ext(56623104->57671679) 00002000:00010000:1.0:1789518642.414396:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525dc00 00000100:00100000:0.0:1789518642.420081:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.420252:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617360256 00000100:00100000:1.0:1789518642.420376:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617360256 00002000:00100000:1.0:1789518642.420422:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (57671680->58720255) req@ffff99fec525fb80 x1876445617360256/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.420430:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525fb80 with x1876445617360256 ext(57671680->58720255) 00002000:00010000:1.0:1789518642.420435:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525fb80 00000100:00100000:1.0:1789518642.420469:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:1.0:1789518642.420475:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2342:x1876445617360256:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518642.427966:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2342:x1876445617360256:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7479us (7888us total) trans 30064771158 rc 0/0 00000100:00100000:1.0:1789518642.427979:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 106 00002000:00100000:1.0:1789518642.427993:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (57671680->58720255) req@ffff99fec525fb80 x1876445617360256/t30064771158(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.428003:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525fb80 with x1876445617360256 ext(57671680->58720255) 00002000:00010000:1.0:1789518642.428009:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525fb80 00000100:00100000:0.0:1789518642.431009:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518642.431222:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617360384 00000100:00100000:3.0:1789518642.431234:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617360384 00002000:00100000:3.0:1789518642.431288:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (58720256->59768831) req@ffff99fec525ed80 x1876445617360384/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518642.431297:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525ed80 with x1876445617360384 ext(58720256->59768831) 00002000:00010000:3.0:1789518642.431320:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525ed80 00000100:00100000:3.0:1789518642.431357:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:3.0:1789518642.431367:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617360384:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.439705:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518642.440703:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617360512 00000100:00100000:2.0:1789518642.440720:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617360512 00002000:00100000:2.0:1789518642.440790:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (59768832->60817407) req@ffff99fec525e680 x1876445617360512/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518642.440803:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525e680 with x1876445617360512 ext(59768832->60817407) 00002000:00010000:2.0:1789518642.440811:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525e680 00000100:00100000:2.0:1789518642.440849:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:2.0:1789518642.440873:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2343:x1876445617360512:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.443367:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2343:x1876445617360384:12345-192.168.206.51@tcp:4:dd.0 Request processed in 11987us (12360us total) trans 30064771159 rc 0/0 00000100:00100000:0.0:1789518642.443383:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00002000:00100000:0.0:1789518642.443399:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (58720256->59768831) req@ffff99fec525ed80 x1876445617360384/t30064771159(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.443411:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525ed80 with x1876445617360384 ext(58720256->59768831) 00002000:00010000:0.0:1789518642.443419:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525ed80 00000100:00100000:3.0:1789518642.447871:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518642.448024:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617360640 00000100:00100000:1.0:1789518642.448044:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617360640 00002000:00100000:1.0:1789518642.448113:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (60817408->61865983) req@ffff99fffc5f0e00 x1876445617360640/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518642.448127:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f0e00 with x1876445617360640 ext(60817408->61865983) 00002000:00010000:1.0:1789518642.448149:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f0e00 00000100:00100000:1.0:1789518642.448865:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:1.0:1789518642.448877:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2343:x1876445617360640:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518642.449438:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2343:x1876445617360512:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8577us (9744us total) trans 30064771160 rc 0/0 00000100:00100000:0.0:1789518642.449448:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00002000:00100000:0.0:1789518642.449459:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (59768832->60817407) req@ffff99fec525e680 x1876445617360512/t30064771160(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.449470:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525e680 with x1876445617360512 ext(59768832->60817407) 00002000:00010000:0.0:1789518642.449476:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525e680 00000100:00100000:0.0:1789518642.457883:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2343:x1876445617360640:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8993us (10004us total) trans 30064771161 rc 0/0 00000100:00100000:0.0:1789518642.457899:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1789518642.458266:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518642.458366:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518642.458424:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617360768 00000100:00100000:3.0:1789518642.458433:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617360768 00002000:00100000:3.0:1789518642.458477:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (61865984->62914559) req@ffff99fffc5f3800 x1876445617360768/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/0 e 0 to 0 dl 1789518653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518642.458489:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f3800 with x1876445617360768 ext(61865984->62914559) 00002000:00010000:3.0:1789518642.458507:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f3800 00000100:00100000:3.0:1789518642.458536:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:3.0:1789518642.458547:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2342:x1876445617360768:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518642.458762:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617361024 00000100:00100000:3.0:1789518642.458767:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617361024 00000100:00100000:3.0:1789518642.458800:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1789518642.458807:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:34358:x1876445617361024:12345-192.168.206.51@tcp:35:dd.0 00000001:00080000:3.0:1789518642.459085:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771296 00000001:00080000:3.0:1789518642.459146:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771297 00000100:00100000:3.0:1789518642.459228:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:34358:x1876445617361024:12345-192.168.206.51@tcp:35:dd.0 Request processed in 420us (861us total) trans 30064771298 rc 0/0 00000100:00100000:3.0:1789518642.459236:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000020:00080000:3.0:1789518642.459241:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00002000:00100000:0.0:1789518642.459697:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (60817408->61865983) req@ffff99fffc5f0e00 x1876445617360640/t30064771161(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.459713:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f0e00 with x1876445617360640 ext(60817408->61865983) 00002000:00010000:0.0:1789518642.459719:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f0e00 00000100:00100000:0.0:1789518642.467298:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2342:x1876445617360768:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8737us (9018us total) trans 30064771162 rc 0/0 00000100:00100000:0.0:1789518642.467316:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00002000:00100000:0.0:1789518642.467334:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (61865984->62914559) req@ffff99fffc5f3800 x1876445617360768/t30064771162(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:288/0 lens 488/448 e 0 to 0 dl 1789518653 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518642.467346:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f3800 with x1876445617360768 ext(61865984->62914559) 00002000:00010000:0.0:1789518642.467356:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f3800 00000100:00100000:2.0:1789518642.498886:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.498955:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617361152 00000100:00100000:0.0:1789518642.498968:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617361152 00000100:00100000:0.0:1789518642.499040:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 260 00000100:00100000:0.0:1789518642.499052:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:34370:x1876445617361152:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518642.499083:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518642.499113:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7865e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdce5 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.499193:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7865e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.499209:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7865e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.499223:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7865e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518642.499272:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518642.499276:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518642.499297:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7865e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.499326:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c7865e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdce5 expref: 26 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.499346:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7865e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdce5 expref: 25 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.499356:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97600) 00010000:00010000:0.0:1789518642.499359:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518642.499363:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bd000, rc 0) 00000100:00100000:0.0:1789518642.499441:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:34370:x1876445617361152:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 391us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518642.499449:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 260 00000100:00100000:2.0:1789518642.501570:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518642.501656:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617361280 00000100:00100000:3.0:1789518642.501696:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617361280 00000100:00100000:3.0:1789518642.501760:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 261 00000100:00100000:3.0:1789518642.501771:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:34370:x1876445617361280:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1789518642.501854:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.501873:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.501885:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.501901:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.501907:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.501913:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502304:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502314:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502322:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518642.502370:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502398:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502406:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502415:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502421:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518642.502426:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502435:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502448:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97600) 00010000:00010000:3.0:1789518642.502451:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518642.502457:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502462:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7865f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502474:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502481:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502486:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502509:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518642.502513:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502519:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502529:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff99ffeaa78900) 00010000:00010000:3.0:1789518642.502532:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518642.502534:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502540:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7865f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502558:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502565:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502570:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502575:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518642.502578:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502584:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502603:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:3.0:1789518642.502606:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518642.502662:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518642.502670:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c7865fe lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518642.502872:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:34370:x1876445617361280:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1099us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518642.502881:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 261 00000100:00100000:1.0:1789518642.543106:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518642.543403:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617361408 00000100:00100000:0.0:1789518642.543416:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617361408 00000100:00100000:0.0:1789518642.543487:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 262 00000100:00100000:0.0:1789518642.543508:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:34377:x1876445617361408:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:0.0:1789518642.543535:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518642.543562:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786605 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcec expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.543684:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.543707:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.543720:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.543746:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.543754:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.543761:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544224:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c78661a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544234:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c78661a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544241:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c78661a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518642.544515:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 62914560 00000004:00200000:0.0:1789518642.544520:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518642.544567:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c78661a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544582:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c78661a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544595:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544602:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544609:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544655:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518642.544660:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544669:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544682:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97600) 00010000:00010000:0.0:1789518642.544685:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518642.544691:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544698:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78660c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544712:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544719:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544725:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544730:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518642.544744:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544753:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544761:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518642.544764:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518642.544766:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544772:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786613 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544818:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786605 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcec expref: 27 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544833:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bda00/0x631fd8698c78661a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcec expref: 26 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518642.544841:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff99fec3b12000) 00010000:00010000:0.0:1789518642.544843:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518642.544846:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bda00, rc 0) 00000100:00100000:0.0:1789518642.544957:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:34377:x1876445617361408:12345-192.168.206.51@tcp:101:stat.0 Request processed in 1446us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518642.544967:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 262 00000001:00100000:1.0:1789518642.833415:0:6674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0 00000020:00000080:1.0:1789518642.833424:0:6674:0:(genops.c:885:class_export_put()) final put ffff99ffeedd4000/4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0 00000001:00080000:1.0:1789518642.833457:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771093 is committed 00000020:00000080:2.0:1789518642.833570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99ffeedd4000/4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0 for lustre-OST0000 00000020:00000080:2.0:1789518642.833661:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99ffeedd4800 for lustre-OST0000 00000001:00080000:1.0:1789518642.833968:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771095 is committed 00010000:00010000:2.0:1789518643.058779:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518644.082767:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518644.985501:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518644.985607:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617361536 00000100:00100000:2.0:1789518644.985662:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617361536 00000100:00100000:2.0:1789518644.985764:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 263 00000100:00100000:2.0:1789518644.985774:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:34321:x1876445617361536:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789518644.986205:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:34321:x1876445617361536:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 427us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518644.986219:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 263 00000100:00080000:0.0:1789518644.986514:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518644.988665:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518644.989051:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617361792 00000100:00100000:3.0:1789518644.989060:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617361792 00000100:00100000:3.0:1789518644.989119:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:3.0:1789518644.989129:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:34321:x1876445617361792:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518644.989341:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:34321:x1876445617361792:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 213us (681us total) trans 30064771299 rc 0/0 00000100:00100000:3.0:1789518644.989350:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00010000:00010000:2.0:1789518645.110508:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518645.364082:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec525df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627657984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518645.364158:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518645.364371:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627657984 00000100:00100000:1.0:1789518645.364379:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627657984 00000100:00100000:1.0:1789518645.364474:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789518645.364496:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627657984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518645.364528:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789518645.364597:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518645.364850:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627657984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 357us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518645.364858:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518645.364911:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771095 gen 2 00000004:00080000:3.0:1789518645.364917:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771094 committed transno 30064771095 00000004:00080000:3.0:1789518645.364937:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffffe5aa00, transno 30064771095 00000100:00100000:3.0:1789518645.364995:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec525df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627657984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518645.875105:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec525f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627658112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518645.876276:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518645.876466:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627658112 00000100:00100000:0.0:1789518645.876474:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627658112 00000100:00100000:0.0:1789518645.876542:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518645.876551:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627658112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518645.876584:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 185663488 pending 32374784 free 3808428032 avail 3806330880 00000100:00100000:0.0:1789518645.876656:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627658112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518645.876662:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789518645.876682:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518645.876715:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec525f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627658112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518645.878804:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627658496:0@lo:400:kworker.0 00000100:00100000:3.0:1789518645.878861:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518645.878871:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627658368:0@lo:400:kworker.0 00000100:00100000:3.0:1789518645.878912:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518645.878919:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627658624:0@lo:400:kworker.0 00000100:00100000:3.0:1789518645.878959:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518645.878982:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627658496 00000100:00100000:0.0:1789518645.878990:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627658496 00000100:00100000:2.0:1789518645.879015:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627658624 00000100:00100000:2.0:1789518645.879021:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627658624 00000100:00100000:1.0:1789518645.879030:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627658240:0@lo:400:kworker.0 00000100:00100000:1.0:1789518645.879091:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518645.879096:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518645.879103:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789518645.879113:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627658624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518645.879172:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627658624:12345-0@lo:400:kworker.0 Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518645.879178:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789518645.879196:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627658496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518645.879206:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627658240 00000100:00100000:2.0:1789518645.879211:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627658240 00000100:00100000:2.0:1789518645.879243:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789518645.879243:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627658496:12345-0@lo:400:kworker.0 Request processed in 139us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518645.879254:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627658240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518645.879254:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789518645.879279:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518645.879300:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627658240:12345-0@lo:400:kworker.0 Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518645.879305:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627658624:0@lo:400:kworker.0 00000100:00100000:0.0:1789518645.879310:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518645.879314:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789518645.879328:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627658496:0@lo:400:kworker.0 00000100:00100000:0.0:1789518645.879354:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627658368 00000100:00100000:0.0:1789518645.879359:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627658368 00000100:00100000:2.0:1789518645.879360:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627658240:0@lo:400:kworker.0 00000100:00100000:0.0:1789518645.879400:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518645.879408:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627658368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518645.879450:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627658368:12345-0@lo:400:kworker.0 Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518645.879457:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789518645.879567:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627658368:0@lo:400:kworker.0 00000001:02000400:2.0:1789518646.060847:0:39039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10a: Test RW-PCC with user quota on loop PCC device ========================================================== 20:30:45 (1789518645) 00010000:00010000:2.0:1789518646.132893:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518646.322868:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518646.322877:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518646.322912:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:0.0:1789518646.322920:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518646.958055:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518646.958131:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617362048 00000100:00100000:0.0:1789518646.958140:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617362048 00000100:00100000:0.0:1789518646.958220:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 264 00000100:00100000:0.0:1789518646.958230:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:35091:x1876445617362048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518646.958252:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518646.958271:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786621 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcf3 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.958336:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.958349:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.958360:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.958374:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.958380:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.958391:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518646.958899:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789518646.959492:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786636 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959506:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786636 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959515:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786636 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518646.959641:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789518646.959726:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959733:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959739:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959746:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518646.959750:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959757:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959768:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:0.0:1789518646.959771:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518646.959776:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959780:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786628 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959789:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959792:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959796:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959799:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518646.959800:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959891:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959899:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518646.959901:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518646.959903:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.959906:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c78662f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.960803:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786621 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcf3 expref: 30 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.960881:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786636 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcf3 expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518646.960889:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:0.0:1789518646.960891:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518646.960894:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:0.0:1789518646.960958:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35091:x1876445617362048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2729us (2910us total) trans 30064771300 rc 0/0 00000100:00100000:0.0:1789518646.960967:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 264 00000100:00100000:2.0:1789518646.963561:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518646.963604:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518646.964530:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617362176 00000100:00100000:3.0:1789518646.964541:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617362176 00000100:00100000:3.0:1789518646.964743:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:3.0:1789518646.964757:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2343:x1876445617362176:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518646.964772:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518646.964794:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786636 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcf3 expref: 29 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518646.964813:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:3.0:1789518646.964817:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518646.964909:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2343:x1876445617362176:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 156us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518646.964987:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617362304 00000100:00100000:1.0:1789518646.964992:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617362304 00000100:00100000:1.0:1789518646.965029:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 265 00000100:00100000:1.0:1789518646.965038:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35091:x1876445617362304:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789518646.965094:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1789518646.965131:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:35091:x1876445617362304:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 93us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518646.965138:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 265 00000100:00100000:2.0:1789518647.044456:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.044902:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617362560 00000100:00100000:3.0:1789518647.044914:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617362560 00000100:00100000:3.0:1789518647.044984:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 266 00000100:00100000:3.0:1789518647.044993:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:35106:x1876445617362560:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:3.0:1789518647.045044:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518647.045069:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c7865e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdce5 expref: 28 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.045091:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97600) 00010000:00010000:3.0:1789518647.045102:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518647.045315:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.045335:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.045346:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.045359:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.045367:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.045372:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518647.046252:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00010000:00010000:3.0:1789518647.046264:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.046271:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.046278:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.046284:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518647.046289:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.046298:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.046319:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78200) 00010000:00010000:3.0:1789518647.046321:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518647.046325:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.046331:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786644 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518647.046346:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046c4fb1f reply state 00000000fe5c4b6c transno 30064771301 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518647.046355:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518647.046443:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35106:x1876445617362560:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 1449us (2000us total) trans 30064771301 rc 0/0 00000100:00100000:3.0:1789518647.046453:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 266 00010000:00010000:1.0:1789518647.050569:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.050587:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.050595:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.050601:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518647.050606:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.050642:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.050659:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff99ffeaa78100) 00010000:00010000:1.0:1789518647.050662:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518647.050667:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.050674:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78664b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518647.057461:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.057607:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617362688 00000100:00100000:0.0:1789518647.057650:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617362688 00000100:00100000:0.0:1789518647.057711:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 267 00000100:00100000:0.0:1789518647.057720:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:35107:x1876445617362688:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1789518647.057742:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518647.057762:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdcfa expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.058409:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786659 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.058424:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.058435:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518647.058481:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518647.058486:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518647.058506:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.058941:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcfa expref: 30 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.058962:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcfa expref: 29 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.058971:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518647.058974:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518647.058977:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc000, rc 0) 00000100:00100000:0.0:1789518647.059086:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35107:x1876445617362688:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1365us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518647.059094:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 267 00000100:00100000:2.0:1789518647.062523:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.062812:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617362816 00000100:00100000:0.0:1789518647.062822:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617362816 00000100:00100000:0.0:1789518647.062915:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 268 00000100:00100000:0.0:1789518647.062925:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35107:x1876445617362816:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1789518647.062944:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518647.062962:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786660 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd01 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063045:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063059:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063080:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063095:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063102:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063109:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063221:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786675 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063230:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786675 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063237:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786675 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518647.063267:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00000004:00200000:0.0:1789518647.063272:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518647.063291:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786675 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063302:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063309:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063330:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063336:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518647.063340:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063348:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063358:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518647.063361:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518647.063366:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063372:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786667 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063385:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063391:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063397:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063401:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518647.063403:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063412:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063420:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518647.063422:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518647.063425:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063430:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78666e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063467:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786660 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd01 expref: 31 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063492:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc800/0x631fd8698c786675 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd01 expref: 30 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.063499:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518647.063502:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789518647.063504:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc800, rc 0) 00000100:00100000:0.0:1789518647.063561:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:35107:x1876445617362816:12345-192.168.206.51@tcp:101:dd.0 Request processed in 637us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518647.063568:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 268 00000100:00100000:2.0:1789518647.066454:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.066672:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617363072 00000100:00100000:1.0:1789518647.066682:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617363072 00000100:00100000:1.0:1789518647.066733:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 269 00000100:00100000:1.0:1789518647.066756:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:35107:x1876445617363072:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1789518647.066777:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518647.066796:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78667c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd08 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.067120:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.067134:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.067145:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.067197:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.067205:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.067665:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518647.068248:0:35847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc7:0x0], index 0: 0 00010000:00010000:1.0:1789518647.068432:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786691 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068443:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786691 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068452:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786691 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068506:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068513:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068520:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068526:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518647.068531:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068539:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068550:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:1.0:1789518647.068553:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518647.068558:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068566:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c786683 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518647.068581:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000028b7fd6 reply state 00000000bd56f706 transno 30064771302 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.068589:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518647.068642:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c78667c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd08 expref: 33 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068671:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786691 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd08 expref: 32 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.068678:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:1.0:1789518647.068681:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518647.068683:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:1.0:1789518647.068747:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:35107:x1876445617363072:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1992us (2300us total) trans 30064771302 rc 0/0 00000100:00100000:1.0:1789518647.068755:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 269 00010000:00010000:0.0:1789518647.073574:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.073591:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.073604:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.073609:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518647.073685:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.073696:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.073711:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff99ffc6733500) 00010000:00010000:0.0:1789518647.073715:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518647.073720:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.073727:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78668a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518647.073987:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.074182:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617363200 00000100:00100000:3.0:1789518647.074190:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617363200 00000100:00100000:3.0:1789518647.074244:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:3.0:1789518647.074251:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:35107:x1876445617363200:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518647.074271:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518647.074295:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd0f expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789518647.074604:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789518647.075432:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518647.075462:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=701s v=(0 0) 00010000:00010000:3.0:1789518647.075467:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518647.075490:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd0f expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.075533:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd0f expref: 6 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.075547:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:3.0:1789518647.075628:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:35107:x1876445617363200:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1363us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518647.075636:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1789518647.090771:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.090848:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617363328 00000100:00100000:0.0:1789518647.090857:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617363328 00002000:00100000:0.0:1789518647.090903:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (0->1048575) req@ffff99fff4000700 x1876445617363328/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.090914:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4000700 with x1876445617363328 ext(0->1048575) 00002000:00010000:0.0:1789518647.090920:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4000700 00000100:00100000:0.0:1789518647.090992:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:0.0:1789518647.091002:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2344:x1876445617363328:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518647.107061:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2344:x1876445617363328:12345-192.168.206.51@tcp:4:dd.0 Request processed in 16051us (16290us total) trans 30064771096 rc 0/0 00000100:00100000:0.0:1789518647.107076:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00002000:00100000:0.0:1789518647.107088:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (0->1048575) req@ffff99fff4000700 x1876445617363328/t30064771096(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.107099:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4000700 with x1876445617363328 ext(0->1048575) 00002000:00010000:0.0:1789518647.107105:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4000700 00000100:00100000:2.0:1789518647.107563:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.107650:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617363456 00000100:00100000:0.0:1789518647.107658:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617363456 00002000:00100000:0.0:1789518647.107692:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (1048576->2097151) req@ffff99fff4003480 x1876445617363456/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.107702:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4003480 with x1876445617363456 ext(1048576->2097151) 00002000:00010000:0.0:1789518647.107705:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4003480 00000100:00100000:0.0:1789518647.107732:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:0.0:1789518647.107741:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2345:x1876445617363456:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518647.112000:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617363456:12345-192.168.206.51@tcp:4:dd.0 Request processed in 4251us (4430us total) trans 30064771097 rc 0/0 00000100:00100000:0.0:1789518647.112012:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00002000:00100000:0.0:1789518647.112024:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (1048576->2097151) req@ffff99fff4003480 x1876445617363456/t30064771097(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.112033:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4003480 with x1876445617363456 ext(1048576->2097151) 00002000:00010000:0.0:1789518647.112039:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4003480 00000100:00100000:3.0:1789518647.119400:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.119576:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617363584 00000100:00100000:0.0:1789518647.119591:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617363584 00002000:00100000:0.0:1789518647.119691:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (2097152->3145727) req@ffff99fffc5f3100 x1876445617363584/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.119829:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f3100 with x1876445617363584 ext(2097152->3145727) 00002000:00010000:0.0:1789518647.119836:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffc5f3100 00000100:00100000:0.0:1789518647.119883:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:0.0:1789518647.119894:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617363584:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518647.132073:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.132193:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617363712 00000100:00100000:0.0:1789518647.132207:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617363712 00002000:00100000:0.0:1789518647.132269:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (3145728->4194303) req@ffff99fff4003800 x1876445617363712/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.132282:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4003800 with x1876445617363712 ext(3145728->4194303) 00002000:00010000:0.0:1789518647.132290:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4003800 00000100:00100000:0.0:1789518647.132330:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1789518647.132342:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2344:x1876445617363712:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.137995:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2345:x1876445617363584:12345-192.168.206.51@tcp:4:dd.0 Request processed in 18087us (18593us total) trans 30064771098 rc 0/0 00000100:00100000:1.0:1789518647.138010:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00002000:00100000:1.0:1789518647.138026:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (2097152->3145727) req@ffff99fffc5f3100 x1876445617363584/t30064771098(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.138038:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f3100 with x1876445617363584 ext(2097152->3145727) 00002000:00010000:1.0:1789518647.138046:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffc5f3100 00000100:00100000:0.0:1789518647.140308:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2344:x1876445617363712:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7954us (8235us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1789518647.140322:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00002000:00100000:0.0:1789518647.140335:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (3145728->4194303) req@ffff99fff4003800 x1876445617363712/t30064771099(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.140346:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4003800 with x1876445617363712 ext(3145728->4194303) 00002000:00010000:0.0:1789518647.140353:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4003800 00000100:00100000:2.0:1789518647.147123:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.147202:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617363840 00000100:00100000:0.0:1789518647.147214:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617363840 00002000:00100000:0.0:1789518647.147277:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (4194304->5242879) req@ffff99fff4000a80 x1876445617363840/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.147296:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4000a80 with x1876445617363840 ext(4194304->5242879) 00002000:00010000:0.0:1789518647.147304:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4000a80 00000100:00100000:0.0:1789518647.147346:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:0.0:1789518647.147356:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2345:x1876445617363840:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518647.153369:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.154003:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617363968 00000100:00100000:1.0:1789518647.154038:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617363968 00002000:00100000:1.0:1789518647.154118:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (5242880->6291455) req@ffff99fffc5f3480 x1876445617363968/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.154130:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f3480 with x1876445617363968 ext(5242880->6291455) 00002000:00010000:1.0:1789518647.154146:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffc5f3480 00000100:00100000:1.0:1789518647.154181:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:1.0:1789518647.154193:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2343:x1876445617363968:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:1.0:1789518647.154685:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518647.155280:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2345:x1876445617363840:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7923us (8167us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1789518647.155288:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00002000:00100000:0.0:1789518647.155294:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (4194304->5242879) req@ffff99fff4000a80 x1876445617363840/t30064771100(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.155301:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4000a80 with x1876445617363840 ext(4194304->5242879) 00002000:00010000:0.0:1789518647.155305:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4000a80 00000100:00100000:1.0:1789518647.162015:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2343:x1876445617363968:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7811us (8647us total) trans 30064771101 rc 0/0 00000100:00100000:1.0:1789518647.162031:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00002000:00100000:1.0:1789518647.162050:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (5242880->6291455) req@ffff99fffc5f3480 x1876445617363968/t30064771101(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.162062:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f3480 with x1876445617363968 ext(5242880->6291455) 00002000:00010000:1.0:1789518647.162070:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffc5f3480 00000100:00100000:2.0:1789518647.162581:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.162687:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617364096 00000100:00100000:1.0:1789518647.162697:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617364096 00002000:00100000:1.0:1789518647.162781:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (6291456->7340031) req@ffff99fff4002300 x1876445617364096/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.162808:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4002300 with x1876445617364096 ext(6291456->7340031) 00002000:00010000:1.0:1789518647.162812:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4002300 00000100:00100000:0.0:1789518647.163014:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:0.0:1789518647.163026:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2342:x1876445617364096:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518647.170575:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2342:x1876445617364096:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7536us (7980us total) trans 30064771102 rc 0/0 00000100:00100000:0.0:1789518647.170593:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00002000:00100000:0.0:1789518647.171371:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (6291456->7340031) req@ffff99fff4002300 x1876445617364096/t30064771102(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.171395:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4002300 with x1876445617364096 ext(6291456->7340031) 00002000:00010000:0.0:1789518647.171404:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4002300 00000100:00100000:2.0:1789518647.174305:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.174508:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617364224 00000100:00100000:0.0:1789518647.174522:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617364224 00002000:00100000:0.0:1789518647.174576:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (7340032->8388607) req@ffff99fff4002a00 x1876445617364224/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.174587:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4002a00 with x1876445617364224 ext(7340032->8388607) 00002000:00010000:0.0:1789518647.174593:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4002a00 00000100:00100000:0.0:1789518647.174659:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:0.0:1789518647.174668:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2342:x1876445617364224:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518647.182648:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.182743:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.182808:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.182844:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.182913:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617364480 00000100:00100000:1.0:1789518647.182930:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617364480 00000100:00100000:0.0:1789518647.183259:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617364352 00000100:00100000:0.0:1789518647.183282:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617364352 00000100:00100000:0.0:1789518647.183361:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:0.0:1789518647.183373:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617364352:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518647.183467:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617364352:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 95us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518647.183486:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:1.0:1789518647.184098:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1789518647.184110:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2343:x1876445617364480:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518647.184153:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2343:x1876445617364480:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 46us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518647.184161:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00080000:1.0:1789518647.184182:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518647.184257:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617364608 00000100:00100000:0.0:1789518647.184263:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617364608 00000100:00080000:2.0:1789518647.184310:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518647.184319:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518647.184328:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617364608:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518647.184378:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617364608:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 51us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518647.184389:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:1.0:1789518647.184949:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617364736 00000100:00100000:1.0:1789518647.184957:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617364736 00002000:00100000:1.0:1789518647.184996:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (8388608->9437183) req@ffff99fffc5f2d80 x1876445617364736/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.185020:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f2d80 with x1876445617364736 ext(8388608->9437183) 00002000:00010000:1.0:1789518647.185026:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffc5f2d80 00000100:00100000:1.0:1789518647.185105:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1789518647.185115:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2343:x1876445617364736:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.193082:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2342:x1876445617364224:12345-192.168.206.51@tcp:4:dd.0 Request processed in 18405us (18780us total) trans 30064771103 rc 0/0 00000100:00100000:1.0:1789518647.193095:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00002000:00100000:1.0:1789518647.193109:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (7340032->8388607) req@ffff99fff4002a00 x1876445617364224/t30064771103(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.193120:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4002a00 with x1876445617364224 ext(7340032->8388607) 00002000:00010000:1.0:1789518647.193127:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4002a00 00000100:00100000:1.0:1789518647.196323:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2343:x1876445617364736:12345-192.168.206.51@tcp:4:dd.0 Request processed in 11196us (13468us total) trans 30064771104 rc 0/0 00000100:00100000:1.0:1789518647.196340:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00002000:00100000:1.0:1789518647.196352:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (8388608->9437183) req@ffff99fffc5f2d80 x1876445617364736/t30064771104(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.196363:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f2d80 with x1876445617364736 ext(8388608->9437183) 00002000:00010000:1.0:1789518647.196369:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffc5f2d80 00000100:00100000:2.0:1789518647.199903:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.200017:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617364864 00000100:00100000:1.0:1789518647.200031:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617364864 00002000:00100000:1.0:1789518647.200079:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (9437184->10485759) req@ffff99fff4001880 x1876445617364864/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.200109:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001880 with x1876445617364864 ext(9437184->10485759) 00002000:00010000:1.0:1789518647.200116:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001880 00000100:00100000:1.0:1789518647.200192:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:1.0:1789518647.200211:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2342:x1876445617364864:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.204884:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2342:x1876445617364864:12345-192.168.206.51@tcp:4:dd.0 Request processed in 4663us (4978us total) trans 30064771105 rc 0/0 00000100:00100000:1.0:1789518647.204899:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00002000:00100000:1.0:1789518647.204913:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (9437184->10485759) req@ffff99fff4001880 x1876445617364864/t30064771105(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.204922:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001880 with x1876445617364864 ext(9437184->10485759) 00002000:00010000:1.0:1789518647.204928:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001880 00000100:00100000:2.0:1789518647.209583:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.209705:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617364992 00000100:00100000:1.0:1789518647.209715:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617364992 00002000:00100000:1.0:1789518647.209762:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (10485760->11534335) req@ffff99fff4000e00 x1876445617364992/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.209774:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4000e00 with x1876445617364992 ext(10485760->11534335) 00002000:00010000:1.0:1789518647.209780:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4000e00 00000100:00100000:1.0:1789518647.209817:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:1.0:1789518647.209829:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2342:x1876445617364992:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.215084:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2342:x1876445617364992:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5248us (5501us total) trans 30064771106 rc 0/0 00000100:00100000:1.0:1789518647.215097:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00002000:00100000:1.0:1789518647.215122:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (10485760->11534335) req@ffff99fff4000e00 x1876445617364992/t30064771106(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.215145:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4000e00 with x1876445617364992 ext(10485760->11534335) 00002000:00010000:1.0:1789518647.215152:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4000e00 00000100:00100000:2.0:1789518647.222973:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.223097:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617365120 00000100:00100000:0.0:1789518647.223107:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617365120 00002000:00100000:0.0:1789518647.223257:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (11534336->12582911) req@ffff99fff4001180 x1876445617365120/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.223269:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001180 with x1876445617365120 ext(11534336->12582911) 00002000:00010000:0.0:1789518647.223276:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001180 00000100:00100000:0.0:1789518647.223313:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:0.0:1789518647.223323:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2343:x1876445617365120:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518647.230251:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2343:x1876445617365120:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6919us (7277us total) trans 30064771107 rc 0/0 00000100:00100000:3.0:1789518647.230263:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00002000:00100000:3.0:1789518647.230274:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (11534336->12582911) req@ffff99fff4001180 x1876445617365120/t30064771107(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518647.230285:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001180 with x1876445617365120 ext(11534336->12582911) 00002000:00010000:3.0:1789518647.230291:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001180 00000100:00100000:2.0:1789518647.234433:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.234550:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617365248 00000100:00100000:1.0:1789518647.234568:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617365248 00002000:00100000:1.0:1789518647.234644:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (12582912->13631487) req@ffff99fff7a27480 x1876445617365248/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.234656:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a27480 with x1876445617365248 ext(12582912->13631487) 00002000:00010000:1.0:1789518647.234662:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a27480 00000100:00100000:1.0:1789518647.234826:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:1.0:1789518647.234837:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2342:x1876445617365248:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.242222:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2342:x1876445617365248:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7376us (7784us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1789518647.242236:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00002000:00100000:1.0:1789518647.242250:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (12582912->13631487) req@ffff99fff7a27480 x1876445617365248/t30064771108(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.242260:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a27480 with x1876445617365248 ext(12582912->13631487) 00002000:00010000:1.0:1789518647.242267:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a27480 00000100:00100000:0.0:1789518647.243746:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.243850:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617365376 00000100:00100000:1.0:1789518647.243859:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617365376 00002000:00100000:1.0:1789518647.243904:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (13631488->14680063) req@ffff99fec525d180 x1876445617365376/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.243915:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525d180 with x1876445617365376 ext(13631488->14680063) 00002000:00010000:1.0:1789518647.243930:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec525d180 00000100:00100000:1.0:1789518647.243962:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:1.0:1789518647.243971:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2343:x1876445617365376:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.250894:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2343:x1876445617365376:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6914us (7148us total) trans 30064771109 rc 0/0 00000100:00100000:1.0:1789518647.250907:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00002000:00100000:1.0:1789518647.250919:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (13631488->14680063) req@ffff99fec525d180 x1876445617365376/t30064771109(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.250929:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525d180 with x1876445617365376 ext(13631488->14680063) 00002000:00010000:1.0:1789518647.250935:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec525d180 00000100:00100000:2.0:1789518647.257969:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.258026:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.258080:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617365760 00000100:00100000:0.0:1789518647.258095:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617365760 00000100:00100000:1.0:1789518647.258162:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617365504 00000100:00100000:1.0:1789518647.258167:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617365504 00002000:00100000:1.0:1789518647.258222:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (14680064->15728639) req@ffff99fff7a24700 x1876445617365504/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.258232:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24700 with x1876445617365504 ext(14680064->15728639) 00002000:00010000:1.0:1789518647.258238:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a24700 00000100:00100000:1.0:1789518647.258273:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:1.0:1789518647.258284:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2343:x1876445617365504:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518647.258308:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:0.0:1789518647.258316:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35107:x1876445617365760:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:0.0:1789518647.258710:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:35107:x1876445617365760:12345-192.168.206.51@tcp:35:dd.0 Request processed in 393us (753us total) trans 30064771303 rc 0/0 00000100:00100000:0.0:1789518647.258718:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:1.0:1789518647.267668:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2343:x1876445617365504:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9368us (9623us total) trans 30064771110 rc 0/0 00000100:00100000:1.0:1789518647.267685:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00002000:00100000:1.0:1789518647.267701:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (14680064->15728639) req@ffff99fff7a24700 x1876445617365504/t30064771110(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.267738:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24700 with x1876445617365504 ext(14680064->15728639) 00002000:00010000:1.0:1789518647.267746:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a24700 00000100:00100000:0.0:1789518647.269425:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.269503:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617366016 00000100:00100000:2.0:1789518647.269514:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617366016 00000100:00100000:2.0:1789518647.269685:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 270 00000100:00100000:2.0:1789518647.269697:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:35108:x1876445617366016:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518647.269727:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518647.269765:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7866a6 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd16 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.269903:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.269920:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.269933:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.269948:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.269955:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.269961:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518647.271087:0:37723:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc7:0x0], index 1: 0 00010000:00010000:2.0:1789518647.272912:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7866bb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.272938:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7866bb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.272953:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7866bb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.273001:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.273028:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.273036:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.273042:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518647.273047:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.273055:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.273069:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:2.0:1789518647.273072:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518647.273077:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.273084:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4200/0x631fd8698c7866ad lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518647.273101:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a387f9d3 reply state 00000000b5970285 transno 30064771304 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518647.273111:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518647.274968:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7866a6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd16 expref: 36 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.275001:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7866bb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd16 expref: 35 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.275030:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:2.0:1789518647.275032:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518647.275036:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5400, rc 0) 00000100:00100000:2.0:1789518647.275174:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:35108:x1876445617366016:12345-192.168.206.51@tcp:101:dd.0 Request processed in 5480us (5771us total) trans 30064771304 rc 0/0 00000100:00100000:2.0:1789518647.275182:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 270 00010000:00010000:1.0:1789518647.278285:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.278428:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.278439:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.278446:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518647.278451:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.278460:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.278489:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xdee864c2 (ffff99fec3b12900) 00010000:00010000:1.0:1789518647.278492:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518647.278497:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.278503:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866b4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518647.281694:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.282093:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617366144 00000100:00100000:2.0:1789518647.282112:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617366144 00000100:00100000:2.0:1789518647.282199:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1789518647.282213:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35108:x1876445617366144:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518647.282236:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518647.282259:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f0d8f30/0x631fd8698c7866c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd1d expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518647.282303:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518647.282335:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=701s v=(0 0) 00010000:00010000:2.0:1789518647.282341:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518647.282352:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f0d8f30/0x631fd8698c7866c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd1d expref: 48 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.282380:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f0d8f30/0x631fd8698c7866c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd1d expref: 48 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.282395:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4200, rc 0) 00000100:00100000:2.0:1789518647.282466:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35108:x1876445617366144:12345-192.168.206.51@tcp:101:dd.0 Request processed in 257us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518647.282502:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1789518647.296665:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.296880:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617366272 00000100:00100000:3.0:1789518647.296894:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617366272 00002000:00100000:3.0:1789518647.296957:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (0->1048575) req@ffff99fff7a24e00 x1876445617366272/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518647.296993:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24e00 with x1876445617366272 ext(0->1048575) 00002000:00010000:3.0:1789518647.297001:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a24e00 00000100:00100000:3.0:1789518647.297051:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:3.0:1789518647.297063:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:2343:x1876445617366272:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518647.310274:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.310601:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617366400 00000100:00100000:2.0:1789518647.310691:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617366400 00002000:00100000:2.0:1789518647.310752:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (1048576->2097151) req@ffff99fec525d500 x1876445617366400/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518647.310766:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525d500 with x1876445617366400 ext(1048576->2097151) 00002000:00010000:2.0:1789518647.310773:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525d500 00000100:00100000:2.0:1789518647.311105:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:2.0:1789518647.311118:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:2342:x1876445617366400:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518647.317795:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:2343:x1876445617366272:12345-192.168.206.51@tcp:4:dd.0 Request processed in 20602us (21070us total) trans 30064771163 rc 0/0 00000100:00100000:0.0:1789518647.317805:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 126 00002000:00100000:0.0:1789518647.317817:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (0->1048575) req@ffff99fff7a24e00 x1876445617366272/t30064771163(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.317824:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24e00 with x1876445617366272 ext(0->1048575) 00002000:00010000:0.0:1789518647.317829:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a24e00 00000100:00100000:1.0:1789518647.318743:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:2342:x1876445617366400:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7625us (8482us total) trans 30064771164 rc 0/0 00000100:00100000:1.0:1789518647.318752:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00002000:00100000:1.0:1789518647.318776:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (1048576->2097151) req@ffff99fec525d500 x1876445617366400/t30064771164(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.318783:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525d500 with x1876445617366400 ext(1048576->2097151) 00002000:00010000:1.0:1789518647.318788:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525d500 00000100:00100000:0.0:1789518647.325906:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.326042:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617366528 00000100:00100000:1.0:1789518647.326065:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617366528 00002000:00100000:1.0:1789518647.326116:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (2097152->3145727) req@ffff99fec525e300 x1876445617366528/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.326137:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525e300 with x1876445617366528 ext(2097152->3145727) 00002000:00010000:1.0:1789518647.326143:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525e300 00000100:00100000:1.0:1789518647.326176:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:1.0:1789518647.326185:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:2345:x1876445617366528:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.334376:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:2345:x1876445617366528:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8183us (8477us total) trans 30064771165 rc 0/0 00000100:00100000:1.0:1789518647.334389:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00002000:00100000:1.0:1789518647.334401:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (2097152->3145727) req@ffff99fec525e300 x1876445617366528/t30064771165(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.334410:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525e300 with x1876445617366528 ext(2097152->3145727) 00002000:00010000:1.0:1789518647.334417:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525e300 00000100:00100000:3.0:1789518647.341998:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.342318:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617366656 00000100:00100000:0.0:1789518647.342331:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617366656 00002000:00100000:0.0:1789518647.342394:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (3145728->4194303) req@ffff99fffc5f3b80 x1876445617366656/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.342407:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f3b80 with x1876445617366656 ext(3145728->4194303) 00002000:00010000:0.0:1789518647.342414:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f3b80 00000100:00100000:0.0:1789518647.342450:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:0.0:1789518647.342461:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:2344:x1876445617366656:12345-192.168.206.51@tcp:4:dd.0 00000040:00080000:0.0:1789518647.346891:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518647.346905:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518647.346954:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:0.0:1789518647.346962:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518647.349985:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2344:x1876445617366656:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7347us (7820us total) trans 30064771166 rc 0/0 00000100:00100000:2.0:1789518647.349998:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00002000:00100000:2.0:1789518647.350013:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (3145728->4194303) req@ffff99fffc5f3b80 x1876445617366656/t30064771166(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518647.350022:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f3b80 with x1876445617366656 ext(3145728->4194303) 00002000:00010000:2.0:1789518647.350029:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f3b80 00000100:00100000:2.0:1789518647.351564:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.351838:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617366784 00000100:00100000:0.0:1789518647.351851:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617366784 00002000:00100000:0.0:1789518647.351909:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (4194304->5242879) req@ffff99fff7a26300 x1876445617366784/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.351922:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a26300 with x1876445617366784 ext(4194304->5242879) 00002000:00010000:0.0:1789518647.351928:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a26300 00000100:00100000:0.0:1789518647.351963:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:0.0:1789518647.351974:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617366784:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.359194:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2342:x1876445617366784:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7207us (7625us total) trans 30064771167 rc 0/0 00000100:00100000:1.0:1789518647.359211:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00002000:00100000:1.0:1789518647.359227:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (4194304->5242879) req@ffff99fff7a26300 x1876445617366784/t30064771167(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.359259:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a26300 with x1876445617366784 ext(4194304->5242879) 00002000:00010000:1.0:1789518647.359268:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a26300 00000100:00100000:0.0:1789518647.365186:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.365306:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617366912 00000100:00100000:1.0:1789518647.365320:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617366912 00002000:00100000:1.0:1789518647.365381:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (5242880->6291455) req@ffff99fec525c380 x1876445617366912/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.365394:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525c380 with x1876445617366912 ext(5242880->6291455) 00002000:00010000:1.0:1789518647.365402:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525c380 00000100:00100000:1.0:1789518647.365439:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:1.0:1789518647.365450:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2342:x1876445617366912:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518647.373504:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.373694:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617367040 00000100:00100000:1.0:1789518647.373706:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617367040 00002000:00100000:1.0:1789518647.373761:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (6291456->7340031) req@ffff99fff7a25f80 x1876445617367040/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.373773:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25f80 with x1876445617367040 ext(6291456->7340031) 00002000:00010000:1.0:1789518647.373780:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a25f80 00000100:00100000:1.0:1789518647.373815:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:1.0:1789518647.373827:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:2343:x1876445617367040:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.376967:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:2342:x1876445617366912:12345-192.168.206.51@tcp:4:dd.0 Request processed in 11509us (11785us total) trans 30064771168 rc 0/0 00000100:00100000:1.0:1789518647.376994:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00002000:00100000:1.0:1789518647.377009:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (5242880->6291455) req@ffff99fec525c380 x1876445617366912/t30064771168(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.377053:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525c380 with x1876445617366912 ext(5242880->6291455) 00002000:00010000:1.0:1789518647.377061:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525c380 00000100:00100000:1.0:1789518647.384545:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:2343:x1876445617367040:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10711us (11066us total) trans 30064771169 rc 0/0 00000100:00100000:1.0:1789518647.384558:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 132 00002000:00100000:1.0:1789518647.384570:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (6291456->7340031) req@ffff99fff7a25f80 x1876445617367040/t30064771169(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.384582:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25f80 with x1876445617367040 ext(6291456->7340031) 00002000:00010000:1.0:1789518647.384589:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a25f80 00000100:00100000:2.0:1789518647.387958:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.389845:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617367168 00000100:00100000:0.0:1789518647.389858:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617367168 00002000:00100000:0.0:1789518647.389910:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (7340032->8388607) req@ffff99fff7a25180 x1876445617367168/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.389923:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25180 with x1876445617367168 ext(7340032->8388607) 00002000:00010000:0.0:1789518647.389929:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a25180 00000100:00100000:0.0:1789518647.389999:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:0.0:1789518647.390011:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:2345:x1876445617367168:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518647.397026:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:2345:x1876445617367168:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7009us (9461us total) trans 30064771170 rc 0/0 00000100:00100000:0.0:1789518647.397040:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 133 00002000:00100000:0.0:1789518647.397052:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (7340032->8388607) req@ffff99fff7a25180 x1876445617367168/t30064771170(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.397062:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25180 with x1876445617367168 ext(7340032->8388607) 00002000:00010000:0.0:1789518647.397069:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a25180 00000100:00100000:2.0:1789518647.403415:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.404771:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617367296 00000100:00100000:1.0:1789518647.404785:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617367296 00002000:00100000:1.0:1789518647.404832:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (8388608->9437183) req@ffff99fff7a24000 x1876445617367296/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.404840:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24000 with x1876445617367296 ext(8388608->9437183) 00002000:00010000:1.0:1789518647.404845:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a24000 00000100:00100000:1.0:1789518647.404883:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:1.0:1789518647.404893:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:2345:x1876445617367296:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518647.414505:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:2345:x1876445617367296:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9603us (11094us total) trans 30064771171 rc 0/0 00000100:00100000:0.0:1789518647.414520:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00002000:00100000:0.0:1789518647.414544:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (8388608->9437183) req@ffff99fff7a24000 x1876445617367296/t30064771171(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.414556:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24000 with x1876445617367296 ext(8388608->9437183) 00002000:00010000:0.0:1789518647.414563:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a24000 00000100:00100000:3.0:1789518647.431438:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.431508:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.431557:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617367424 00000100:00100000:3.0:1789518647.431566:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617367424 00002000:00100000:3.0:1789518647.431640:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (9437184->10485759) req@ffff99fffc5f1500 x1876445617367424/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518647.431652:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f1500 with x1876445617367424 ext(9437184->10485759) 00002000:00010000:3.0:1789518647.431659:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f1500 00000100:00100000:3.0:1789518647.431681:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617367552 00000100:00100000:3.0:1789518647.431684:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617367552 00002000:00100000:3.0:1789518647.431704:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (10485760->11534335) req@ffff99fffc5f2300 x1876445617367552/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518647.431712:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f2300 with x1876445617367552 ext(10485760->11534335) 00002000:00010000:3.0:1789518647.431715:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f2300 00000100:00100000:3.0:1789518647.431737:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:3.0:1789518647.431747:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:2344:x1876445617367424:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.431913:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:1.0:1789518647.431926:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:2344:x1876445617367552:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518647.441459:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:2344:x1876445617367424:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9704us (10018us total) trans 30064771172 rc 0/0 00000100:00100000:2.0:1789518647.441487:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00002000:00100000:2.0:1789518647.441511:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (9437184->10485759) req@ffff99fffc5f1500 x1876445617367424/t30064771172(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518647.441522:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f1500 with x1876445617367424 ext(9437184->10485759) 00002000:00010000:2.0:1789518647.441530:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f1500 00000100:00100000:1.0:1789518647.442600:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:2344:x1876445617367552:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10673us (11086us total) trans 30064771173 rc 0/0 00000100:00100000:1.0:1789518647.442610:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 136 00002000:00100000:1.0:1789518647.442666:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (10485760->11534335) req@ffff99fffc5f2300 x1876445617367552/t30064771173(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.442676:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f2300 with x1876445617367552 ext(10485760->11534335) 00002000:00010000:1.0:1789518647.442681:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f2300 00000100:00100000:3.0:1789518647.444676:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.447544:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617367680 00000100:00100000:0.0:1789518647.447559:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617367680 00002000:00100000:0.0:1789518647.447608:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (11534336->12582911) req@ffff99fff4b1ea00 x1876445617367680/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.447637:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1ea00 with x1876445617367680 ext(11534336->12582911) 00002000:00010000:0.0:1789518647.447643:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1ea00 00000100:00100000:0.0:1789518647.447667:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:0.0:1789518647.447677:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:2343:x1876445617367680:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.456787:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:2343:x1876445617367680:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9100us (12107us total) trans 30064771174 rc 0/0 00000100:00100000:1.0:1789518647.456801:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 00002000:00100000:1.0:1789518647.456813:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (11534336->12582911) req@ffff99fff4b1ea00 x1876445617367680/t30064771174(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.456823:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1ea00 with x1876445617367680 ext(11534336->12582911) 00002000:00010000:1.0:1789518647.456829:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1ea00 00000100:00100000:3.0:1789518647.459510:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.459717:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617367808 00000100:00100000:0.0:1789518647.459739:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617367808 00002000:00100000:0.0:1789518647.459788:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (12582912->13631487) req@ffff99fec8340700 x1876445617367808/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.459800:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8340700 with x1876445617367808 ext(12582912->13631487) 00002000:00010000:0.0:1789518647.459806:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8340700 00000100:00100000:0.0:1789518647.459837:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:0.0:1789518647.459849:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:2343:x1876445617367808:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518647.469729:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:2343:x1876445617367808:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9875us (10221us total) trans 30064771175 rc 0/0 00000100:00100000:1.0:1789518647.469743:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00002000:00100000:1.0:1789518647.469757:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (12582912->13631487) req@ffff99fec8340700 x1876445617367808/t30064771175(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518647.469767:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8340700 with x1876445617367808 ext(12582912->13631487) 00002000:00010000:1.0:1789518647.469775:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8340700 00000001:00080000:3.0:1789518647.472996:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771303 is committed 00000001:00080000:3.0:1789518647.473058:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771304 is committed 00000020:00080000:3.0:1789518647.473073:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fec846d480 refcount 2 committed 0 result 0 batchid 25769803900 00000020:00080000:3.0:1789518647.473078:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffee47e700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fec846da80 00000020:00080000:3.0:1789518647.473081:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffee47e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec9fd7000 00000020:00080000:2.0:1789518647.473135:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803900 committed batchid 25769803899 00000020:00080000:2.0:1789518647.473316:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803899 00000100:00100000:1.0:1789518647.474437:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.474573:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617367936 00000100:00100000:0.0:1789518647.474584:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617367936 00002000:00100000:0.0:1789518647.474786:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (13631488->14680063) req@ffff99fec9673b80 x1876445617367936/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518647.474797:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9673b80 with x1876445617367936 ext(13631488->14680063) 00002000:00010000:0.0:1789518647.474803:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9673b80 00000100:00100000:0.0:1789518647.474827:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:0.0:1789518647.474837:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:2342:x1876445617367936:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518647.481677:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:2342:x1876445617367936:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6831us (7236us total) trans 30064771176 rc 0/0 00000100:00100000:2.0:1789518647.481691:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 139 00002000:00100000:2.0:1789518647.481705:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (13631488->14680063) req@ffff99fec9673b80 x1876445617367936/t30064771176(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518647.481715:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9673b80 with x1876445617367936 ext(13631488->14680063) 00002000:00010000:2.0:1789518647.481722:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9673b80 00000100:00100000:1.0:1789518647.487220:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.487277:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.487338:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617368192 00000100:00100000:0.0:1789518647.487338:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617368320 00000100:00100000:3.0:1789518647.487350:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617368192 00000100:00100000:0.0:1789518647.487350:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617368320 00002000:00100000:0.0:1789518647.487400:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (14680064->15728639) req@ffff99fec9672680 x1876445617368320/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/0 e 0 to 0 dl 1789518658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1789518647.487412:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00002000:00100000:0.0:1789518647.487416:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9672680 with x1876445617368320 ext(14680064->15728639) 00002000:00010000:0.0:1789518647.487424:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9672680 00000100:00100000:3.0:1789518647.487426:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:35108:x1876445617368192:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:0.0:1789518647.487445:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:0.0:1789518647.487454:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:2343:x1876445617368320:12345-192.168.206.51@tcp:4:dd.0 00000001:00080000:2.0:1789518647.488141:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771305 00000100:00100000:2.0:1789518647.488236:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:35108:x1876445617368192:12345-192.168.206.51@tcp:35:dd.0 Request processed in 812us (1029us total) trans 30064771306 rc 0/0 00000100:00100000:2.0:1789518647.488243:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000020:00080000:2.0:1789518647.488248:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1789518647.497058:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771170 is committed 00000100:00100000:3.0:1789518647.497188:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:2343:x1876445617368320:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9729us (9905us total) trans 30064771177 rc 0/0 00000100:00100000:3.0:1789518647.497200:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 140 00002000:00100000:3.0:1789518647.497214:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (14680064->15728639) req@ffff99fec9672680 x1876445617368320/t30064771177(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:293/0 lens 488/448 e 0 to 0 dl 1789518658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518647.497225:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9672680 with x1876445617368320 ext(14680064->15728639) 00002000:00010000:3.0:1789518647.497232:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9672680 00000001:00080000:2.0:1789518647.497411:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771143 is committed 00000100:00100000:1.0:1789518647.507926:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.510422:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617368448 00000100:00100000:0.0:1789518647.510437:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617368448 00000100:00100000:0.0:1789518647.510523:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 271 00000100:00100000:0.0:1789518647.510533:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:35109:x1876445617368448:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:0.0:1789518647.510558:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518647.511223:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7866d0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd24 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.511279:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.511292:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.511303:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.511413:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c7866d0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd24 expref: 22 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.511434:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd24 expref: 21 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.511442:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:1.0:1789518647.511445:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789518647.511449:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6400, rc 0) 00000100:00100000:1.0:1789518647.511536:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:35109:x1876445617368448:12345-192.168.206.51@tcp:101:chown.0 Request processed in 1004us (3619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518647.511544:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 271 00000100:00100000:0.0:1789518647.516645:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.517592:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617368704 00000100:00100000:1.0:1789518647.517606:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617368704 00000100:00100000:1.0:1789518647.517685:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 272 00000100:00100000:1.0:1789518647.517695:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:35109:x1876445617368704:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:1.0:1789518647.517740:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518647.517764:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786691 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd08 expref: 21 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.517795:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:1.0:1789518647.517800:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518647.517848:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.517861:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.517871:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518647.518438:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].9, 88 off8840 00000004:00080000:1.0:1789518647.518450:0:35847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701514834873ns, next at 702514832390ns, rc = 0 00000004:00010000:1.0:1789518647.518535:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008fb2384 reply state 0000000014ce177d transno 30064771307 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.518545:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518647.518688:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:35109:x1876445617368704:12345-192.168.206.51@tcp:36:chown.0 Request processed in 992us (2081us total) trans 30064771307 rc 0/0 00000100:00100000:1.0:1789518647.518696:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 272 00000100:00100000:0.0:1789518647.523277:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.523523:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617368832 00000100:00100000:2.0:1789518647.523533:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617368832 00000100:00100000:2.0:1789518647.523587:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 273 00000100:00100000:2.0:1789518647.523596:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:35109:x1876445617368832:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518647.523647:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518647.523676:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd2b expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.523738:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd2b expref: 23 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.523754:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd2b expref: 23 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.523772:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:2.0:1789518647.523775:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518647.523780:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4800, rc 0) 00010000:00010000:3.0:1789518647.523790:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.523799:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.523807:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.523813:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518647.523817:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.523834:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.523862:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:3.0:1789518647.523864:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518647.523869:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.523874:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c7866de lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518647.523895:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:35109:x1876445617368832:12345-192.168.206.51@tcp:101:chown.0 Request processed in 298us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518647.523902:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 273 00000100:00100000:0.0:1789518647.528324:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.528963:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617368960 00000100:00100000:3.0:1789518647.528974:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617368960 00000100:00100000:3.0:1789518647.529146:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518647.529156:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2342:x1876445617368960:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:3.0:1789518647.529340:0:37973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1789518647.529344:0:37973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb mtime from disk: 0 -> 1789518647 00002000:00010000:3.0:1789518647.529347:0:37973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789518647.529349:0:37973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb ctime from disk: 0 -> 1789518648 00002000:00010000:3.0:1789518647.529351:0:37973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789518647.529486:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2342:x1876445617368960:12345-192.168.206.51@tcp:2:chown.0 Request processed in 331us (1169us total) trans 30064771111 rc 0/0 00000100:00100000:3.0:1789518647.529495:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:0.0:1789518647.551501:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.551597:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617369088 00000100:00100000:2.0:1789518647.551607:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617369088 00000100:00100000:2.0:1789518647.551694:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:2.0:1789518647.551703:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:35110:x1876445617369088:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518647.551721:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518647.551738:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7866ec lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd32 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.551773:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866f3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.551787:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.551814:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.551904:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c7866ec lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd32 expref: 24 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.551920:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5a00/0x631fd8698c7866f3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd32 expref: 23 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.551929:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:2.0:1789518647.551932:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518647.551947:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5a00, rc 0) 00000100:00100000:2.0:1789518647.551994:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:35110:x1876445617369088:12345-192.168.206.51@tcp:101:chown.0 Request processed in 293us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518647.552001:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:0.0:1789518647.556303:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.556830:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617369344 00000100:00100000:1.0:1789518647.556840:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617369344 00000100:00100000:1.0:1789518647.556943:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 275 00000100:00100000:1.0:1789518647.556954:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:35110:x1876445617369344:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:1.0:1789518647.557004:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518647.557028:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7866bb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd16 expref: 23 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.557064:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:1.0:1789518647.557069:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518647.557094:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.557106:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.557116:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518647.557601:0:35845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].9, 88 off8912 00000004:00080000:1.0:1789518647.557647:0:35845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701553996543ns, next at 702553994333ns, rc = 0 00000004:00010000:1.0:1789518647.557730:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016bff186 reply state 0000000050e12b7d transno 30064771308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.557740:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518647.557839:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:35110:x1876445617369344:12345-192.168.206.51@tcp:36:chown.0 Request processed in 886us (1544us total) trans 30064771308 rc 0/0 00000100:00100000:1.0:1789518647.557846:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 275 00000100:00100000:0.0:1789518647.562753:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518647.562798:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.562811:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.562820:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.562826:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518647.562842:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.562850:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.562865:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:1.0:1789518647.562868:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518647.562872:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.562878:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c7866fa lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518647.564575:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617369472 00000100:00100000:2.0:1789518647.564588:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617369472 00000100:00100000:2.0:1789518647.564679:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 276 00000100:00100000:2.0:1789518647.564689:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:35110:x1876445617369472:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518647.564712:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518647.564729:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786701 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd39 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.564784:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786701 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd39 expref: 24 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.564798:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4a00/0x631fd8698c786701 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd39 expref: 24 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.564844:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:2.0:1789518647.564848:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518647.564851:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4a00, rc 0) 00000100:00100000:2.0:1789518647.564911:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:35110:x1876445617369472:12345-192.168.206.51@tcp:101:chown.0 Request processed in 224us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518647.564918:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 276 00000100:00100000:0.0:1789518647.568991:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.570819:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617369600 00000100:00100000:2.0:1789518647.570835:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617369600 00000100:00100000:2.0:1789518647.570901:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:2.0:1789518647.570912:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2343:x1876445617369600:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:2.0:1789518647.571095:0:36531:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1789518647.571099:0:36531:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb mtime from disk: 0 -> 1789518648 00002000:00010000:2.0:1789518647.571101:0:36531:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518647.571104:0:36531:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb ctime from disk: 0 -> 1789518648 00002000:00010000:2.0:1789518647.571106:0:36531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 16391 00000100:00100000:2.0:1789518647.571168:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2343:x1876445617369600:12345-192.168.206.51@tcp:2:chown.0 Request processed in 258us (2185us total) trans 30064771178 rc 0/0 00000100:00100000:2.0:1789518647.571176:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:0.0:1789518647.629060:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.629171:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617369728 00000100:00100000:2.0:1789518647.629180:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617369728 00000100:00100000:2.0:1789518647.629240:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 277 00000100:00100000:2.0:1789518647.629251:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:35116:x1876445617369728:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518647.629270:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518647.629290:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786708 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd40 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518647.637585:0:35846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8228us 00010000:00010000:3.0:1789518647.644140:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78670f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.644161:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78670f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.644185:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78670f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518647.644219:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00000004:00200000:3.0:1789518647.644224:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518647.644259:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78670f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.644290:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd40 expref: 26 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.644308:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78670f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd40 expref: 25 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.644317:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:3.0:1789518647.644320:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518647.644324:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:3.0:1789518647.644394:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:35116:x1876445617369728:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 15144us (15342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518647.644403:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 277 00000100:00100000:0.0:1789518647.647420:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.647480:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617369856 00000100:00100000:2.0:1789518647.647490:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617369856 00000100:00100000:2.0:1789518647.647646:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 278 00000100:00100000:2.0:1789518647.647658:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:35116:x1876445617369856:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518647.647677:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518647.647695:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786716 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd47 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.647753:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.647767:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.647777:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.647792:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.647800:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.647806:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649041:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649067:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649143:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518647.649247:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00000004:00200000:2.0:1789518647.649253:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518647.649278:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649291:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649299:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649305:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649312:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649318:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518647.649321:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649328:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649339:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:2.0:1789518647.649349:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518647.649354:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649360:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78671d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649372:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649377:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649383:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649388:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518647.649391:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649396:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649403:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff99fec3b12200) 00010000:00010000:2.0:1789518647.649405:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518647.649408:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649413:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786724 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649451:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786716 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd47 expref: 27 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649485:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd47 expref: 26 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518647.649493:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:2.0:1789518647.649495:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518647.649497:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5400, rc 0) 00000100:00100000:2.0:1789518647.649768:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:35116:x1876445617369856:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 2111us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518647.649776:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 278 00000100:00100000:0.0:1789518647.653745:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.653842:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617370112 00000100:00100000:1.0:1789518647.653852:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617370112 00000100:00100000:1.0:1789518647.653915:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 279 00000100:00100000:1.0:1789518647.653927:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:35116:x1876445617370112:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518647.653946:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518647.653966:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786732 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd4e expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.654064:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786739 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.654079:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786739 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.654090:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786739 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518647.654117:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:1.0:1789518647.654362:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7200/0x631fd8698c786732 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd4e expref: 29 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.654380:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786739 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd4e expref: 28 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.654389:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:1.0:1789518647.654392:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518647.654395:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:1.0:1789518647.654510:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:35116:x1876445617370112:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 585us (773us total) trans 30064771309 rc 0/0 00000100:00100000:1.0:1789518647.654517:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 279 00000100:00100000:0.0:1789518647.659589:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.659719:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617370368 00000100:00100000:1.0:1789518647.659729:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617370368 00000100:00100000:1.0:1789518647.659795:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 280 00000100:00100000:1.0:1789518647.659805:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:35116:x1876445617370368:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518647.659827:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518647.659846:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786747 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd55 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.659932:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78674e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.659947:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78674e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.659974:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78674e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518647.659998:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:1.0:1789518647.660131:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786747 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd55 expref: 31 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.660150:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78674e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd55 expref: 30 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.660158:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:1.0:1789518647.660161:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518647.660165:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:1.0:1789518647.660212:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:35116:x1876445617370368:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 408us (630us total) trans 30064771310 rc 0/0 00000100:00100000:1.0:1789518647.660219:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 280 00000100:00100000:0.0:1789518647.662679:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.662899:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617370496 00000100:00100000:1.0:1789518647.662908:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617370496 00000100:00100000:1.0:1789518647.663010:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1789518647.663020:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2342:x1876445617370496:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518647.663051:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518647.663073:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786739 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd4e expref: 30 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.663091:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:1.0:1789518647.663096:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518647.663171:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617370496:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 152us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518647.663179:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:2.0:1789518647.795743:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.795833:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617370624 00000100:00100000:1.0:1789518647.795844:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617370624 00000100:00100000:1.0:1789518647.795943:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:1.0:1789518647.795953:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2345:x1876445617370624:12345-192.168.206.51@tcp:1:lfs.500 00010000:00010000:1.0:1789518647.795997:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.796017:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd0f expref: 37 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.796025:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518647.796029:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518647.796034:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.796067:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd0f expref: 37 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.796082:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd0f expref: 37 pid: 37973 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.796095:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9673800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627658752:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518647.796186:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518647.803233:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9673800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627658752:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518647.803260:0:36532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518647.808982:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.809055:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617370752 00000100:00100000:3.0:1789518647.809063:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617370752 00010000:00010000:3.0:1789518647.809096:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd0f expref: 38 pid: 37973 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518647.809135:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:3.0:1789518647.809143:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2343:x1876445617370752:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518647.809167:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518647.809187:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd0f expref: 38 pid: 37973 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.809200:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd0f expref: 38 pid: 37973 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.809220:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f4a233/0x631fd8698c78669f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd0f expref: 38 pid: 37973 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.809235:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518647.809239:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518647.809245:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.809254:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.809280:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518647.809331:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2343:x1876445617370752:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 186us (356us total) trans 0 rc 0/0 00010000:00010000:1.0:1789518647.809331:0:36532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518647.809347:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00010000:00010000:1.0:1789518647.809352:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.809382:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.809391:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.809399:0:36532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.809406:0:36532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518647.809411:0:36532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.809421:0:36532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.810748:0:36532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.810759:0:36532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c78675c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.811401:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2345:x1876445617370624:12345-192.168.206.51@tcp:1:lfs.500 Request processed in 15444us (15661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518647.811412:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:2.0:1789518647.814662:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.814790:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617371008 00000100:00100000:1.0:1789518647.814799:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617371008 00000100:00100000:1.0:1789518647.814855:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1789518647.814864:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35116:x1876445617371008:12345-192.168.206.51@tcp:35:lfs.500 00000004:00010000:1.0:1789518647.814922:0:35848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78674e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd55 expref: 29 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518647.815306:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771311 00000001:00080000:1.0:1789518647.815769:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771312 00000001:00080000:1.0:1789518647.816687:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771313 00010000:00010000:1.0:1789518647.816743:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.816760:0:35848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd24 expref: 33 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.816769:0:35848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd47 expref: 33 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.816784:0:35848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd2b expref: 33 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.816793:0:35848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 6/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.816826:0:35848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd2b expref: 33 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.816841:0:35848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd2b expref: 33 pid: 35846 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.816855:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9673800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627658880:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518647.816947:0:35848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd47 expref: 33 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.816957:0:35848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd47 expref: 33 pid: 37723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.816966:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9673100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627659008:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518647.817187:0:35848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd24 expref: 33 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.817197:0:35848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd24 expref: 33 pid: 35845 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.817218:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9671180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627659136:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518647.817241:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518647.819269:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9673800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627658880:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518647.819281:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9673100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627659008:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518647.819888:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.819924:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.819997:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617371136 00000100:00100000:0.0:1789518647.820005:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617371136 00010000:00010000:0.0:1789518647.820047:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd47 expref: 34 pid: 37723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518647.820082:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617371264 00000100:00100000:0.0:1789518647.820090:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617371264 00010000:00010000:0.0:1789518647.820103:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd2b expref: 35 pid: 35846 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518647.820123:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1789518647.820132:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1080c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2342:x1876445617371136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518647.820145:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518647.820151:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd47 expref: 35 pid: 37723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820161:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd47 expref: 35 pid: 37723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820179:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78672b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd47 expref: 35 pid: 37723 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820195:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:0.0:1789518647.820201:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820209:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820216:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518647.820255:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1080c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2342:x1876445617371136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 124us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518647.820262:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1789518647.820303:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:0.0:1789518647.820310:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2343:x1876445617371264:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518647.820320:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518647.820325:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd2b expref: 33 pid: 35846 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820335:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd2b expref: 33 pid: 35846 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820346:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7866e5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd2b expref: 33 pid: 35846 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820369:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:0.0:1789518647.820374:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820380:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.820389:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518647.820408:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2343:x1876445617371264:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 98us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518647.820414:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:0.0:1789518647.821002:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.821071:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617371392 00000100:00100000:3.0:1789518647.821076:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617371392 00010000:00010000:3.0:1789518647.821095:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd24 expref: 32 pid: 35845 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518647.821142:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1789518647.821150:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2342:x1876445617371392:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518647.821159:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518647.821165:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd24 expref: 32 pid: 35845 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.821176:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd24 expref: 32 pid: 35845 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.821187:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:3.0:1789518647.821191:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.821199:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.821206:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.821223:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518647.821250:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2342:x1876445617371392:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 101us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518647.821256:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00010000:00010000:1.0:1789518647.821696:0:35848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7866d7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd24 expref: 31 pid: 35845 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.821712:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9671180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627659136:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518647.821732:0:35848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.821741:0:35848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.821748:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518647.821853:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771314 00000001:00080000:1.0:1789518647.822109:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771315 00000100:00100000:1.0:1789518647.822201:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9671180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627659264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518647.822282:0:35848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518647.822701:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc9184480 going to sleep for 11 seconds 00000100:00100000:3.0:1789518647.822816:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627659264 00000100:00100000:3.0:1789518647.822821:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627659264 00000100:00080000:2.0:1789518647.822862:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518647.822910:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789518647.822919:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627659264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518647.823002:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627659264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518647.823009:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789518647.823071:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9671180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627659264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789518647.823658:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771316 00000100:00100000:1.0:1789518647.823719:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9671180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627659392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518647.823759:0:35848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518647.824223:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789518647.824252:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627659392 00000100:00100000:0.0:1789518647.824257:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627659392 00000100:00100000:0.0:1789518647.824285:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789518647.824292:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627659392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789518647.826023:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35848:x1876445627659392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1724us (2256us total) trans 30064771112 rc 0/0 00000100:00100000:0.0:1789518647.826037:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789518647.826598:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9671180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627659392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789518647.826699:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771317 00010000:00010000:1.0:1789518647.826750:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.826761:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.826769:0:35848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.826774:0:35848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518647.826778:0:35848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.826785:0:35848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.826800:0:35848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:1.0:1789518647.826802:0:35848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789518647.826807:0:35848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.826812:0:35848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786763 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518647.827193:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x1d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789518647.827261:0:35848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].10, 64 off8904 00000001:00080000:1.0:1789518647.827270:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771318 00010000:00010000:1.0:1789518647.827321:0:35848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc6733700) 00010000:00010000:1.0:1789518647.827325:0:35848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518647.827332:0:35848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78674e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd55 expref: 35 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518647.827656:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35116:x1876445617371008:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 12791us (13002us total) trans 30064771319 rc 0/0 00000100:00100000:1.0:1789518647.827666:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000020:00080000:1.0:1789518647.827670:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789518647.832149:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.832264:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617371520 00000100:00100000:3.0:1789518647.832274:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617371520 00000100:00100000:3.0:1789518647.832322:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 281 00000100:00100000:3.0:1789518647.832331:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35116:x1876445617371520:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518647.832352:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518647.832373:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78676a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd5c expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.832430:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78676a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd5c expref: 35 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.832445:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78676a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd5c expref: 35 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.832462:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518647.832477:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518647.832481:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:3.0:1789518647.832576:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:35116:x1876445617371520:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 245us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518647.832590:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 281 00000100:00100000:2.0:1789518647.836763:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.836845:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617371776 00000100:00100000:3.0:1789518647.836854:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617371776 00000100:00100000:3.0:1789518647.836910:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:3.0:1789518647.836920:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:35116:x1876445617371776:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:3.0:1789518647.837136:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:35116:x1876445617371776:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 216us (382us total) trans 30064771320 rc 0/0 00000100:00100000:3.0:1789518647.837144:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1789518647.890415:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.890519:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617371904 00000100:00100000:0.0:1789518647.890529:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617371904 00000100:00100000:0.0:1789518647.890588:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 282 00000100:00100000:0.0:1789518647.890598:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:35123:x1876445617371904:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:0.0:1789518647.890659:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518647.890679:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786771 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd63 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.890739:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.890754:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.890766:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.890781:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.890788:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.890795:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891017:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786786 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891026:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786786 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891033:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786786 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518647.891060:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00000004:00200000:0.0:1789518647.891065:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518647.891092:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786786 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891390:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786786 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891400:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891407:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891413:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891419:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518647.891424:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891431:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891442:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518647.891756:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518647.891762:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891769:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786778 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891782:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891789:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891795:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891801:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518647.891805:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891811:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891818:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xdee864c2 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518647.891821:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518647.891824:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891830:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c78677f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891872:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786771 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd63 expref: 38 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891887:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bca00/0x631fd8698c786786 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd63 expref: 37 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.891894:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:0.0:1789518647.891896:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518647.891899:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bca00, rc 0) 00000100:00100000:0.0:1789518647.891966:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:35123:x1876445617371904:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 1369us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518647.891974:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 282 00000100:00100000:0.0:1789518647.896445:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518647.896608:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617372160 00000100:00100000:1.0:1789518647.896644:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617372160 00000100:00100000:1.0:1789518647.896755:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 283 00000100:00100000:1.0:1789518647.896767:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:35123:x1876445617372160:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518647.896788:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518647.896810:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78678d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd6a expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.896904:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786794 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.896918:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786794 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.896930:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786794 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518647.896941:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:1.0:1789518647.897071:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c78678d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd6a expref: 40 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.897106:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786794 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd6a expref: 39 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.897114:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:1.0:1789518647.897117:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518647.897121:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:1.0:1789518647.897177:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:35123:x1876445617372160:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 413us (743us total) trans 30064771321 rc 0/0 00000100:00100000:1.0:1789518647.897184:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 283 00000100:00100000:2.0:1789518647.900785:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518647.900868:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.900956:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617372288 00000100:00100000:3.0:1789518647.900966:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617372288 00000100:00100000:1.0:1789518647.901040:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617372544 00000100:00100000:1.0:1789518647.901045:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617372544 00000100:00100000:3.0:1789518647.901064:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:3.0:1789518647.901077:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2343:x1876445617372288:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518647.901096:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518647.901119:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786794 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd6a expref: 40 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518647.901141:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00000100:00100000:1.0:1789518647.901143:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 284 00010000:00010000:3.0:1789518647.901149:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518647.901166:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:35123:x1876445617372544:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518647.901188:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789518647.901202:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617372288:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 128us (423us total) trans 0 rc 0/0 00010000:00010000:1.0:1789518647.901204:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7867a2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd71 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518647.901214:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00010000:00010000:1.0:1789518647.901295:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7867a9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.901310:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7867a9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.901320:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7867a9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518647.901330:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:1.0:1789518647.901482:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7867a2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd71 expref: 41 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.901497:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7867a9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd71 expref: 40 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518647.901504:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:1.0:1789518647.901507:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518647.901510:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:1.0:1789518647.901534:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:35123:x1876445617372544:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 382us (666us total) trans 30064771322 rc 0/0 00000100:00100000:1.0:1789518647.901540:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 284 00000100:00100000:2.0:1789518647.944373:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.944428:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617372672 00000100:00100000:0.0:1789518647.944436:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617372672 00000100:00100000:0.0:1789518647.944501:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1789518647.944511:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:35123:x1876445617372672:12345-192.168.206.51@tcp:103:lfs.500 00010000:00010000:0.0:1789518647.944526:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518647.944548:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7867a9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd71 expref: 40 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518647.944567:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff99fec3b12300) 00010000:00010000:0.0:1789518647.944572:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518647.944641:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:35123:x1876445617372672:12345-192.168.206.51@tcp:103:lfs.500 Request processed in 130us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518647.944648:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:1.0:1789518647.946272:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518647.946344:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617372928 00000100:00100000:3.0:1789518647.946352:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617372928 00000100:00100000:3.0:1789518647.946426:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:3.0:1789518647.946434:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:35123:x1876445617372928:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:3.0:1789518647.946687:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:35123:x1876445617372928:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 252us (671us total) trans 30064771323 rc 0/0 00000100:00100000:3.0:1789518647.946694:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:3.0:1789518647.960348:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518647.960442:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617373184 00000100:00100000:0.0:1789518647.960451:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617373184 00000100:00100000:0.0:1789518647.960600:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1789518647.960632:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:35123:x1876445617373184:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:0.0:1789518647.960935:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:35123:x1876445617373184:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 325us (591us total) trans 30064771324 rc 0/0 00000100:00100000:0.0:1789518647.960943:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000001:00080000:1.0:1789518647.981780:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771112 is committed 00000001:00080000:1.0:1789518647.981795:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771103 is committed 00000001:00080000:1.0:1789518647.982152:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771110 is committed 00000001:00080000:1.0:1789518647.982252:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771111 is committed 00000100:00100000:2.0:1789518648.021053:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.022099:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617373440 00000100:00100000:3.0:1789518648.022123:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617373440 00000100:00100000:3.0:1789518648.022252:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 285 00000100:00100000:3.0:1789518648.022263:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:35133:x1876445617373440:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518648.022285:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518648.022305:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7867b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd78 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518648.022387:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00010000:00010000:3.0:1789518648.022508:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7867b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd78 expref: 43 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.022522:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518648.022526:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518648.022531:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c7867b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd78 expref: 43 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.022544:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17000, rc 0) 00000100:00100000:3.0:1789518648.022606:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:35133:x1876445617373440:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 346us (1561us total) trans 30064771325 rc 301/301 00000100:00100000:3.0:1789518648.022652:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 285 00000100:00080000:2.0:1789518648.022784:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518648.026271:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.026370:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617373568 00000100:00100000:2.0:1789518648.026380:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617373568 00000100:00100000:2.0:1789518648.026435:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 286 00000100:00100000:2.0:1789518648.026445:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:35133:x1876445617373568:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518648.026535:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.026547:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.026556:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.026566:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.026571:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.026577:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.026921:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.026936:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.026943:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518648.026985:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.026998:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027019:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027025:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027032:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518648.027036:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027043:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027055:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:2.0:1789518648.027058:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518648.027063:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027082:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867c5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027095:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027101:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027107:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027112:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518648.027266:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027273:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027290:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff99fec3b12700) 00010000:00010000:2.0:1789518648.027292:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518648.027296:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027302:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867cc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027319:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027326:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027331:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027337:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518648.027339:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027350:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027356:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518648.027358:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518648.027368:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.027374:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867d3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.027455:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:35133:x1876445617373568:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1011us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518648.027477:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 286 00000100:00100000:0.0:1789518648.029933:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.030032:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617373824 00000100:00100000:3.0:1789518648.030106:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617373824 00000100:00100000:3.0:1789518648.030163:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1789518648.030173:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:35133:x1876445617373824:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518648.030380:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:35133:x1876445617373824:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 209us (454us total) trans 30064771326 rc 0/0 00000100:00100000:3.0:1789518648.030387:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:0.0:1789518648.085655:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.088562:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617374080 00000100:00100000:1.0:1789518648.088577:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617374080 00000100:00100000:1.0:1789518648.088683:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 287 00000100:00100000:1.0:1789518648.088693:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:35143:x1876445617374080:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518648.088717:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518648.088743:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7867da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd7f expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.088847:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c7867e1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.088879:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c7867e1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.088891:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c7867e1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518648.088904:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 16384 00010000:00010000:1.0:1789518648.089048:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7867da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd7f expref: 46 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.089067:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6000/0x631fd8698c7867e1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd7f expref: 45 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.089075:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:1.0:1789518648.089078:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789518648.089082:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6000, rc 0) 00000100:00100000:1.0:1789518648.089154:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:35143:x1876445617374080:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 462us (3545us total) trans 30064771327 rc 0/0 00000100:00100000:1.0:1789518648.089161:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 287 00000100:00100000:1.0:1789518648.145487:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.145608:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617374336 00000100:00100000:2.0:1789518648.145638:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617374336 00000100:00100000:2.0:1789518648.145748:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 288 00000100:00100000:2.0:1789518648.145759:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:35149:x1876445617374336:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:2.0:1789518648.145782:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518648.145803:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867ef lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd86 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.145868:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.145882:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.145893:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.145905:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.145911:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.145934:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146181:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786804 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146189:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786804 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146197:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786804 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518648.146206:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:2.0:1789518648.146291:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146299:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146305:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146311:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518648.146315:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146322:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146334:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:2.0:1789518648.146337:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518648.146349:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146355:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7867f6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146369:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146376:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146382:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146387:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518648.146390:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146396:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146404:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff99fec3b12700) 00010000:00010000:2.0:1789518648.146406:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518648.146409:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146415:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7867fd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146482:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7867ef lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd86 expref: 48 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146509:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786804 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd86 expref: 47 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.146516:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518648.146518:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518648.146521:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5400, rc 0) 00000100:00100000:2.0:1789518648.146760:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35149:x1876445617374336:12345-192.168.206.51@tcp:101:dd.500 Request processed in 1002us (1291us total) trans 30064771328 rc 0/0 00000100:00100000:2.0:1789518648.146768:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 288 00000100:00100000:0.0:1789518648.149295:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.149484:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617374592 00000100:00100000:1.0:1789518648.149493:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617374592 00000100:00100000:1.0:1789518648.149555:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 289 00000100:00100000:1.0:1789518648.149566:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35149:x1876445617374592:12345-192.168.206.51@tcp:36:dd.500 00010000:00010000:1.0:1789518648.149702:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518648.149726:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786804 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd86 expref: 47 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.149765:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:1.0:1789518648.149770:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518648.150015:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.150029:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.150039:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518648.150110:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771329 00000004:00010000:1.0:1789518648.150146:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddb9510d reply state 00000000dbe78c2f transno 30064771330 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518648.150154:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518648.150237:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35149:x1876445617374592:12345-192.168.206.51@tcp:36:dd.500 Request processed in 674us (951us total) trans 30064771330 rc 0/0 00000100:00100000:1.0:1789518648.150244:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 289 00000020:00080000:1.0:1789518648.150248:0:35845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518648.152401:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.152415:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.152421:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.152427:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518648.152432:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.152440:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.152453:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518648.152455:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518648.152460:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.152478:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786812 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.178852:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518648.293744:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.294046:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617374848 00000100:00100000:3.0:1789518648.294055:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617374848 00000100:00100000:3.0:1789518648.294121:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518648.294132:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35149:x1876445617374848:12345-192.168.206.51@tcp:103:dd.500 00010000:00010000:3.0:1789518648.294146:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518648.294168:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c78676a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd5c expref: 48 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.294205:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518648.294217:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518648.294276:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35149:x1876445617374848:12345-192.168.206.51@tcp:103:dd.500 Request processed in 146us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518648.294283:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:3.0:1789518648.296926:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.296998:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617374976 00000100:00100000:0.0:1789518648.297006:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617374976 00000100:00100000:0.0:1789518648.297066:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 290 00000100:00100000:0.0:1789518648.297076:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35149:x1876445617374976:12345-192.168.206.51@tcp:58:dd.500 00010000:00010000:0.0:1789518648.297179:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.297194:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.297221:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518648.297960:0:37723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].8, 136 off9280 00000100:00100000:0.0:1789518648.298098:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35149:x1876445617374976:12345-192.168.206.51@tcp:58:dd.500 Request processed in 1020us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518648.298107:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 290 00000100:00100000:2.0:1789518648.300431:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.300541:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617375104 00000100:00100000:3.0:1789518648.300550:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617375104 00000100:00100000:3.0:1789518648.300609:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 291 00000100:00100000:3.0:1789518648.300641:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35149:x1876445617375104:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:3.0:1789518648.300661:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518648.300680:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c786820 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd8d expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.300739:0:35846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.300750:0:35846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c786820 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd8d expref: 48 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.300770:0:35846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.300783:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c786820 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd8d expref: 48 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.300816:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:3.0:1789518648.300819:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518648.300824:0:35846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c786820 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd8d expref: 48 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.300831:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17000, rc 0) 00000100:00100000:3.0:1789518648.300889:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35149:x1876445617375104:12345-192.168.206.51@tcp:101:dd.500 Request processed in 252us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518648.300896:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 291 00000040:00080000:0.0:1789518648.371234:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518648.371360:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518648.371406:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 9 count 9 00000040:00080000:0.0:1789518648.371413:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518648.371545:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627659520:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518648.371888:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518648.376379:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627659520:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518648.377592:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.378013:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617375232 00000100:00100000:2.0:1789518648.378026:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617375232 00000100:00100000:2.0:1789518648.378203:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 292 00000100:00100000:2.0:1789518648.378215:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35150:x1876445617375232:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518648.378257:0:35847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518648.378391:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35150:x1876445617375232:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 177us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518648.378400:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 292 00000100:00100000:2.0:1789518648.381604:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.381789:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617375360 00000100:00100000:1.0:1789518648.381812:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617375360 00000100:00100000:1.0:1789518648.381924:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 293 00000100:00100000:1.0:1789518648.381942:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35150:x1876445617375360:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789518648.382108:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382134:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382177:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382403:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382432:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382446:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382500:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382510:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382517:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518648.382566:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00000004:00200000:1.0:1789518648.382571:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518648.382586:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382599:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382605:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382666:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382673:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518648.382678:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382686:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382698:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518648.382701:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518648.382706:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382712:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786827 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382726:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382731:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382737:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382742:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518648.382745:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382761:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382770:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdcf8d881 (ffff99ffc6733700) 00010000:00010000:1.0:1789518648.382772:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518648.382775:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382781:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78682e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382882:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382890:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382896:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382901:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518648.382904:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382910:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382918:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:1.0:1789518648.382920:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518648.382924:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.382939:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786835 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518648.383804:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35150:x1876445617375360:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 1849us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518648.383820:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 293 00000100:00100000:1.0:1789518648.388839:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.389702:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617375616 00000100:00100000:0.0:1789518648.389717:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617375616 00000100:00100000:0.0:1789518648.389780:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 294 00000100:00100000:0.0:1789518648.389808:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35150:x1876445617375616:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518648.389835:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518648.389864:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78683c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd94 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.389985:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390002:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390015:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518648.390025:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00010000:00010000:0.0:1789518648.390127:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390135:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390147:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390153:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518648.390157:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390165:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390176:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:0.0:1789518648.390179:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518648.390184:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390190:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786843 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390236:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78683c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd94 expref: 50 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390247:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:0.0:1789518648.390249:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518648.390253:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c78683c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd94 expref: 50 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.390263:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:0.0:1789518648.390341:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35150:x1876445617375616:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 549us (1509us total) trans 30064771331 rc 301/301 00000100:00100000:0.0:1789518648.390352:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 294 00000100:00100000:3.0:1789518648.394148:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.394520:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617375744 00000100:00100000:0.0:1789518648.394531:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617375744 00000100:00100000:0.0:1789518648.394589:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 295 00000100:00100000:0.0:1789518648.394600:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35150:x1876445617375744:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518648.394651:0:35846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518648.394759:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35150:x1876445617375744:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 160us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518648.394767:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 295 00000100:00100000:3.0:1789518648.398208:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.398272:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617376000 00000100:00100000:0.0:1789518648.398282:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617376000 00000100:00100000:0.0:1789518648.398342:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 296 00000100:00100000:0.0:1789518648.398351:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35150:x1876445617376000:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518648.398371:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518648.398374:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518648.398402:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c78670f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd40 expref: 49 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.398422:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:0.0:1789518648.398426:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518648.398443:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786851 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdd9b expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518648.399155:0:37723:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc8:0x0], index 0: 0 00010000:00010000:0.0:1789518648.399394:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786858 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.399410:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786858 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.399420:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786858 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.399485:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786851 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd9b expref: 51 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.399500:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786858 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd9b expref: 50 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.399508:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:0.0:1789518648.399510:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518648.399513:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d200, rc 0) 00000100:00100000:0.0:1789518648.400800:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:35150:x1876445617376000:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2441us (2591us total) trans 30064771332 rc 0/0 00000100:00100000:0.0:1789518648.400812:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 296 00000100:00100000:3.0:1789518648.408431:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.408522:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617376256 00000100:00100000:1.0:1789518648.408550:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617376256 00000100:00100000:1.0:1789518648.408610:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 297 00000100:00100000:1.0:1789518648.408644:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:35150:x1876445617376256:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518648.408702:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518648.408727:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786858 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd9b expref: 50 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.408745:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99ffc2d97700) 00010000:00010000:1.0:1789518648.408755:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518648.408775:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.408801:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.408811:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.408825:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.408849:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.408856:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409035:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409043:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409050:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409056:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518648.409060:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409067:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409075:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:1.0:1789518648.409078:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518648.409082:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409088:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786866 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409098:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409108:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409114:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409119:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518648.409122:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409128:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409134:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xda4f6723 (ffff99ffc6733700) 00010000:00010000:1.0:1789518648.409136:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518648.409139:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.409144:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c78686d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xda4f6723 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518648.409216:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35150:x1876445617376256:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 575us (793us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518648.409222:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 297 00000100:00100000:3.0:1789518648.411981:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.412083:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617376384 00000100:00100000:2.0:1789518648.412091:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617376384 00000100:00100000:2.0:1789518648.412145:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 298 00000100:00100000:2.0:1789518648.412156:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35150:x1876445617376384:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518648.412174:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518648.412204:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786874 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdda2 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.412239:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.412252:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.412274:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.412360:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786874 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda2 expref: 51 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.412377:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda2 expref: 50 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.412396:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518648.412399:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518648.412403:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5600, rc 0) 00000100:00100000:2.0:1789518648.412475:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:35150:x1876445617376384:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 320us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518648.412482:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 298 00000100:00100000:3.0:1789518648.416739:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.416940:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617376640 00000100:00100000:0.0:1789518648.416953:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617376640 00000100:00100000:0.0:1789518648.417015:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 299 00000100:00100000:0.0:1789518648.417027:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:35150:x1876445617376640:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518648.417104:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.417120:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.417137:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518648.418870:0:35846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].11, 88 off8992 00000004:00010000:0.0:1789518648.418966:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fc8e6e0 reply state 00000000df12768e transno 30064771333 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518648.418976:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518648.419090:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:35150:x1876445617376640:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 2063us (2358us total) trans 30064771333 rc 0/0 00000100:00100000:0.0:1789518648.419098:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 299 00010000:00010000:1.0:1789518648.421872:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.421893:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.421921:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.421927:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518648.421931:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.421940:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.421956:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:1.0:1789518648.421959:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518648.421964:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.421970:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786882 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518648.424886:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.425339:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617376768 00000100:00100000:2.0:1789518648.425349:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617376768 00000100:00100000:2.0:1789518648.425490:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 300 00000100:00100000:2.0:1789518648.425500:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:35150:x1876445617376768:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518648.425524:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518648.425555:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdda9 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.425637:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda9 expref: 52 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.425663:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda9 expref: 52 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.425683:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518648.425687:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518648.425690:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4e00, rc 0) 00000100:00100000:2.0:1789518648.425746:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:35150:x1876445617376768:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 247us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518648.425753:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 300 00000100:00100000:3.0:1789518648.428204:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.428388:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617376896 00000100:00100000:2.0:1789518648.428397:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617376896 00000100:00100000:2.0:1789518648.428448:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:2.0:1789518648.428457:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+5:2342:x1876445617376896:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.428801:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617376896:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 343us (603us total) trans 30064771113 rc 0/0 00000100:00100000:2.0:1789518648.428809:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1789518648.447769:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.447889:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617377152 00000100:00100000:2.0:1789518648.447900:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617377152 00000100:00100000:2.0:1789518648.448209:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:2.0:1789518648.448221:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:35150:x1876445617377152:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.448495:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:35150:x1876445617377152:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 275us (734us total) trans 30064771334 rc 0/0 00000100:00100000:2.0:1789518648.448519:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1789518648.450074:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.450226:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617377408 00000100:00100000:1.0:1789518648.450233:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617377408 00000100:00100000:1.0:1789518648.450285:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 301 00000100:00100000:1.0:1789518648.450295:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:35150:x1876445617377408:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518648.450394:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:35150:x1876445617377408:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 100us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518648.450401:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 301 00000100:00100000:2.0:1789518648.452222:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.452326:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617377536 00000100:00100000:0.0:1789518648.452333:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617377536 00000100:00100000:0.0:1789518648.452426:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 302 00000100:00100000:0.0:1789518648.452435:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:35150:x1876445617377536:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518648.452452:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518648.452483:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786890 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddb0 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.452553:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786897 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.452569:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786897 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.452581:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786897 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518648.452651:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518648.452670:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786897 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.452695:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786890 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb0 expref: 55 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.452714:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786897 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb0 expref: 54 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.452722:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:0.0:1789518648.452725:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789518648.452729:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c000, rc 0) 00000100:00100000:0.0:1789518648.452780:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:35150:x1876445617377536:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 346us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518648.452787:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 302 00000100:00100000:3.0:1789518648.455538:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.455728:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617377664 00000100:00100000:1.0:1789518648.455737:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617377664 00000100:00100000:1.0:1789518648.455792:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:1.0:1789518648.455803:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617377664:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518648.455832:0:36735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518648.455852:0:36735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddb7 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518648.455876:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e339, blocks: 0x1 00010000:00010000:1.0:1789518648.455895:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=702s v=(0 0) 00010000:00010000:1.0:1789518648.455899:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518648.455909:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb7 expref: 7 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.455926:0:36735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb7 expref: 7 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.455940:0:36735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6400, rc 0) 00000100:00100000:1.0:1789518648.455989:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617377664:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 189us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518648.455994:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:3.0:1789518648.459005:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.459395:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617377920 00000100:00100000:1.0:1789518648.459405:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617377920 00000100:00100000:1.0:1789518648.459512:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 303 00000100:00100000:1.0:1789518648.459523:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:35150:x1876445617377920:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518648.459658:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:35150:x1876445617377920:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 136us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518648.459667:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 303 00000100:00100000:2.0:1789518648.466560:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.466658:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617378048 00000100:00100000:1.0:1789518648.466681:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617378048 00000100:00100000:1.0:1789518648.466840:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:1.0:1789518648.466850:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:35150:x1876445617378048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518648.466867:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518648.466886:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddbe expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.466918:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb7 expref: 8 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.466928:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518648.466933:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518648.466939:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 8 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.466971:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb7 expref: 8 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.466985:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb7 expref: 8 pid: 36735 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518648.466999:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9670380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627659648:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518648.467109:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789518648.469278:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9670380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627659648:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518648.469325:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 8 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.469380:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:1.0:1789518648.469517:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:35150:x1876445617378048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2667us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518648.469529:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1789518648.482324:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.483443:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617378176 00000100:00100000:2.0:1789518648.483459:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617378176 00010000:00010000:2.0:1789518648.483511:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb7 expref: 8 pid: 36735 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.483552:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1789518648.483563:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617378176:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518648.483583:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518648.483643:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb7 expref: 8 pid: 36735 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.483664:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb7 expref: 8 pid: 36735 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.483687:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043c63214/0x631fd8698c78689e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb7 expref: 8 pid: 36735 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.483703:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518648.483708:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518648.483716:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 7 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.483745:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 7 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.483783:0:35830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 7 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.483799:0:35830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a25500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35830:1876445627659776:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518648.483882:0:35830:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789518648.485932:0:35830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a25500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35830:1876445627659776:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518648.485958:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518648.486013:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617378176:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2451us (3706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518648.486023:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:3.0:1789518648.502044:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.503402:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617378304 00000100:00100000:1.0:1789518648.503419:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617378304 00002000:00100000:1.0:1789518648.503507:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (0->1048575) req@ffff99ffedb2aa00 x1876445617378304/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.503519:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2aa00 with x1876445617378304 ext(0->1048575) 00002000:00010000:1.0:1789518648.503527:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffedb2aa00 00000100:00100000:1.0:1789518648.503564:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:1.0:1789518648.503576:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617378304:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518648.512027:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.513132:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617378432 00000100:00100000:1.0:1789518648.513149:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617378432 00002000:00100000:1.0:1789518648.513276:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (1048576->2097151) req@ffff99fec48d7800 x1876445617378432/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.513289:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d7800 with x1876445617378432 ext(1048576->2097151) 00002000:00010000:1.0:1789518648.513297:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d7800 00000100:00100000:1.0:1789518648.513344:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:1.0:1789518648.513355:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617378432:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.525301:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.525487:0:36539:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789518648.525502:0:36539:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1789518648.527411:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617378304:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 23827us (25369us total) trans 30064771114 rc 0/0 00000100:00100000:1.0:1789518648.527439:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 141 00002000:00100000:1.0:1789518648.527455:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (0->1048575) req@ffff99ffedb2aa00 x1876445617378304/t30064771114(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.527476:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2aa00 with x1876445617378304 ext(0->1048575) 00002000:00010000:1.0:1789518648.527485:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffedb2aa00 00000100:00100000:1.0:1789518648.527518:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617378560 00000100:00100000:1.0:1789518648.527527:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617378560 00002000:00100000:1.0:1789518648.527570:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (2097152->3145727) req@ffff99fff7a25500 x1876445617378560/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.527578:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25500 with x1876445617378560 ext(2097152->3145727) 00002000:00010000:1.0:1789518648.527581:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a25500 00000100:00100000:1.0:1789518648.527642:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:1.0:1789518648.527655:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617378560:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.536392:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617378432:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 23022us (24371us total) trans 30064771115 rc 0/0 00000100:00100000:2.0:1789518648.536410:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 142 00002000:00100000:2.0:1789518648.536428:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (1048576->2097151) req@ffff99fec48d7800 x1876445617378432/t30064771115(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.536439:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d7800 with x1876445617378432 ext(1048576->2097151) 00002000:00010000:2.0:1789518648.536448:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d7800 00000100:00100000:3.0:1789518648.537670:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.537710:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617378688 00000100:00100000:3.0:1789518648.537742:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617378688 00002000:00100000:3.0:1789518648.537797:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (3145728->4194303) req@ffff99ffedb29c00 x1876445617378688/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518648.537811:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29c00 with x1876445617378688 ext(3145728->4194303) 00002000:00010000:3.0:1789518648.537817:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffedb29c00 00000100:00100000:3.0:1789518648.537845:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:3.0:1789518648.537858:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2344:x1876445617378688:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.548376:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.549156:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617378560:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 21499us (23868us total) trans 30064771116 rc 0/0 00000100:00100000:0.0:1789518648.549171:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00002000:00100000:0.0:1789518648.549190:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (2097152->3145727) req@ffff99fff7a25500 x1876445617378560/t30064771116(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518648.549202:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25500 with x1876445617378560 ext(2097152->3145727) 00002000:00010000:0.0:1789518648.549211:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a25500 00000100:00100000:0.0:1789518648.549246:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617378816 00000100:00100000:0.0:1789518648.549255:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617378816 00002000:00100000:0.0:1789518648.549294:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (4194304->5242879) req@ffff99ffeda68000 x1876445617378816/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518648.549310:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda68000 with x1876445617378816 ext(4194304->5242879) 00002000:00010000:0.0:1789518648.549313:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda68000 00000100:00100000:1.0:1789518648.549885:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:1.0:1789518648.549903:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2345:x1876445617378816:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.557782:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2344:x1876445617378688:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 19907us (20102us total) trans 30064771117 rc 0/0 00000100:00100000:2.0:1789518648.557824:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00002000:00100000:2.0:1789518648.557841:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (3145728->4194303) req@ffff99ffedb29c00 x1876445617378688/t30064771117(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.557854:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29c00 with x1876445617378688 ext(3145728->4194303) 00002000:00010000:2.0:1789518648.557862:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffedb29c00 00000100:00100000:0.0:1789518648.564813:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.564986:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617378944 00000100:00100000:3.0:1789518648.564999:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617378944 00000100:00100000:2.0:1789518648.565504:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2345:x1876445617378816:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 15603us (17138us total) trans 30064771118 rc 0/0 00000100:00100000:2.0:1789518648.565519:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 145 00002000:00100000:2.0:1789518648.565536:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (4194304->5242879) req@ffff99ffeda68000 x1876445617378816/t30064771118(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.565549:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda68000 with x1876445617378816 ext(4194304->5242879) 00002000:00010000:2.0:1789518648.565558:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda68000 00002000:00100000:3.0:1789518648.565825:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (5242880->6291455) req@ffff99fec48d7100 x1876445617378944/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518648.565837:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d7100 with x1876445617378944 ext(5242880->6291455) 00002000:00010000:3.0:1789518648.565841:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d7100 00000100:00100000:3.0:1789518648.565867:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:3.0:1789518648.565879:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2345:x1876445617378944:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.575268:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2345:x1876445617378944:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9378us (10712us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1789518648.575286:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 146 00002000:00100000:2.0:1789518648.575303:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (5242880->6291455) req@ffff99fec48d7100 x1876445617378944/t30064771119(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.575315:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d7100 with x1876445617378944 ext(5242880->6291455) 00002000:00010000:2.0:1789518648.575325:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d7100 00000100:00100000:0.0:1789518648.581146:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.581281:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617379072 00000100:00100000:3.0:1789518648.581295:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617379072 00002000:00100000:3.0:1789518648.581363:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (6291456->7340031) req@ffff99fec48d5180 x1876445617379072/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518648.581375:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5180 with x1876445617379072 ext(6291456->7340031) 00002000:00010000:3.0:1789518648.581383:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d5180 00000100:00100000:3.0:1789518648.581504:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:3.0:1789518648.581517:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2344:x1876445617379072:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.591136:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2344:x1876445617379072:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9605us (9990us total) trans 30064771120 rc 0/0 00000100:00100000:2.0:1789518648.591154:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 147 00002000:00100000:2.0:1789518648.591191:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (6291456->7340031) req@ffff99fec48d5180 x1876445617379072/t30064771120(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.591203:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5180 with x1876445617379072 ext(6291456->7340031) 00002000:00010000:2.0:1789518648.591212:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d5180 00000100:00100000:0.0:1789518648.597895:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.597991:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617379200 00000100:00100000:2.0:1789518648.598002:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617379200 00002000:00100000:2.0:1789518648.598057:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (7340032->8388607) req@ffff99fec48d4700 x1876445617379200/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.598066:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d4700 with x1876445617379200 ext(7340032->8388607) 00002000:00010000:2.0:1789518648.598073:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d4700 00000100:00100000:2.0:1789518648.598109:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:2.0:1789518648.598119:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2345:x1876445617379200:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.605782:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2345:x1876445617379200:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7652us (7886us total) trans 30064771121 rc 0/0 00000100:00100000:2.0:1789518648.605798:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00002000:00100000:2.0:1789518648.605812:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (7340032->8388607) req@ffff99fec48d4700 x1876445617379200/t30064771121(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.605835:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d4700 with x1876445617379200 ext(7340032->8388607) 00002000:00010000:2.0:1789518648.605842:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d4700 00000100:00100000:1.0:1789518648.613918:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.614071:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617379328 00000100:00100000:2.0:1789518648.614087:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617379328 00002000:00100000:2.0:1789518648.614349:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (8388608->9437183) req@ffff99fec9670380 x1876445617379328/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.614362:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9670380 with x1876445617379328 ext(8388608->9437183) 00002000:00010000:2.0:1789518648.614383:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec9670380 00000100:00100000:2.0:1789518648.614422:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:2.0:1789518648.614438:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2342:x1876445617379328:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.624090:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2342:x1876445617379328:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9651us (10180us total) trans 30064771122 rc 0/0 00000100:00100000:2.0:1789518648.624101:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 149 00002000:00100000:2.0:1789518648.624111:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (8388608->9437183) req@ffff99fec9670380 x1876445617379328/t30064771122(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.624125:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9670380 with x1876445617379328 ext(8388608->9437183) 00002000:00010000:2.0:1789518648.624131:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec9670380 00000100:00100000:1.0:1789518648.631770:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.632507:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617379456 00000100:00100000:2.0:1789518648.632523:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617379456 00002000:00100000:2.0:1789518648.632652:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (9437184->10485759) req@ffff99fec9673480 x1876445617379456/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.632664:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9673480 with x1876445617379456 ext(9437184->10485759) 00002000:00010000:2.0:1789518648.632670:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec9673480 00000100:00100000:2.0:1789518648.632708:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:2.0:1789518648.632718:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2342:x1876445617379456:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518648.640324:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.640418:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617379584 00000100:00100000:1.0:1789518648.640431:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617379584 00002000:00100000:1.0:1789518648.640505:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (10485760->11534335) req@ffff99fec48d4e00 x1876445617379584/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.640520:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d4e00 with x1876445617379584 ext(10485760->11534335) 00002000:00010000:1.0:1789518648.640526:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d4e00 00000100:00100000:1.0:1789518648.640656:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:1.0:1789518648.640669:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617379584:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.641336:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617379456:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8606us (9569us total) trans 30064771123 rc 0/0 00000100:00100000:2.0:1789518648.641352:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 150 00002000:00100000:2.0:1789518648.641368:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (9437184->10485759) req@ffff99fec9673480 x1876445617379456/t30064771123(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.641398:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9673480 with x1876445617379456 ext(9437184->10485759) 00002000:00010000:2.0:1789518648.641407:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec9673480 00000100:00100000:0.0:1789518648.650775:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.650918:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617379712 00000100:00100000:2.0:1789518648.650927:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617379712 00002000:00100000:2.0:1789518648.650969:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (11534336->12582911) req@ffff99fec48d5500 x1876445617379712/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.650981:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5500 with x1876445617379712 ext(11534336->12582911) 00002000:00010000:2.0:1789518648.650986:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d5500 00000100:00100000:2.0:1789518648.651018:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:2.0:1789518648.651027:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617379712:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518648.658336:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2342:x1876445617379584:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 17658us (18013us total) trans 30064771124 rc 0/0 00000100:00100000:1.0:1789518648.658355:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 151 00002000:00100000:1.0:1789518648.658367:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (10485760->11534335) req@ffff99fec48d4e00 x1876445617379584/t30064771124(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.658375:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d4e00 with x1876445617379584 ext(10485760->11534335) 00002000:00010000:1.0:1789518648.658380:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d4e00 00000100:00100000:3.0:1789518648.663319:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.663904:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617379840 00000100:00100000:2.0:1789518648.663917:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617379840 00002000:00100000:2.0:1789518648.663982:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (12582912->13631487) req@ffff99ffedb2ad80 x1876445617379840/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.663995:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2ad80 with x1876445617379840 ext(12582912->13631487) 00002000:00010000:2.0:1789518648.664003:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffedb2ad80 00000100:00100000:2.0:1789518648.664103:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:2.0:1789518648.664115:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2342:x1876445617379840:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518648.664825:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2342:x1876445617379712:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 13794us (14054us total) trans 30064771125 rc 0/0 00000100:00100000:1.0:1789518648.664837:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 152 00002000:00100000:1.0:1789518648.664846:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (11534336->12582911) req@ffff99fec48d5500 x1876445617379712/t30064771125(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.664857:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5500 with x1876445617379712 ext(11534336->12582911) 00002000:00010000:1.0:1789518648.664863:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d5500 00000100:00100000:3.0:1789518648.672488:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2342:x1876445617379840:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8350us (9158us total) trans 30064771126 rc 0/0 00000100:00100000:3.0:1789518648.672507:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 153 00002000:00100000:3.0:1789518648.672524:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (12582912->13631487) req@ffff99ffedb2ad80 x1876445617379840/t30064771126(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518648.672536:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2ad80 with x1876445617379840 ext(12582912->13631487) 00002000:00010000:3.0:1789518648.672545:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffedb2ad80 00000100:00100000:2.0:1789518648.673455:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.673662:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617379968 00000100:00100000:0.0:1789518648.673675:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617379968 00002000:00100000:0.0:1789518648.673739:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (13631488->14680063) req@ffff99ffeda6ad80 x1876445617379968/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518648.673751:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6ad80 with x1876445617379968 ext(13631488->14680063) 00002000:00010000:0.0:1789518648.673756:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda6ad80 00000100:00100000:0.0:1789518648.673792:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:0.0:1789518648.673804:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2342:x1876445617379968:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518648.685217:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.685541:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617380096 00000100:00100000:0.0:1789518648.685554:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617380096 00002000:00100000:0.0:1789518648.685635:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (14680064->15728639) req@ffff99ffeda6b800 x1876445617380096/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518648.685649:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6b800 with x1876445617380096 ext(14680064->15728639) 00002000:00010000:0.0:1789518648.685656:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda6b800 00000100:00100000:0.0:1789518648.685696:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:0.0:1789518648.685706:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2343:x1876445617380096:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518648.689060:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2342:x1876445617379968:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 15243us (15596us total) trans 30064771127 rc 0/0 00000100:00100000:1.0:1789518648.689078:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 154 00002000:00100000:1.0:1789518648.689093:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (13631488->14680063) req@ffff99ffeda6ad80 x1876445617379968/t30064771127(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.689106:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6ad80 with x1876445617379968 ext(13631488->14680063) 00002000:00010000:1.0:1789518648.689115:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda6ad80 00000100:00100000:0.0:1789518648.693666:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.693712:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617380224 00000100:00100000:0.0:1789518648.693724:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617380224 00002000:00100000:0.0:1789518648.693791:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (15728640->16777215) req@ffff99fff4001500 x1876445617380224/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518648.693805:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001500 with x1876445617380224 ext(15728640->16777215) 00002000:00010000:0.0:1789518648.693813:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001500 00000100:00100000:0.0:1789518648.693852:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:0.0:1789518648.693864:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2343:x1876445617380224:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518648.694542:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617380096:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8834us (9335us total) trans 30064771128 rc 0/0 00000100:00100000:1.0:1789518648.694552:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 155 00002000:00100000:1.0:1789518648.694563:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (14680064->15728639) req@ffff99ffeda6b800 x1876445617380096/t30064771128(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.694572:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffeda6b800 with x1876445617380096 ext(14680064->15728639) 00002000:00010000:1.0:1789518648.694576:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffeda6b800 00000100:00100000:3.0:1789518648.700491:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617380224:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 6610us (6820us total) trans 30064771129 rc 0/0 00000100:00100000:3.0:1789518648.700508:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 156 00002000:00100000:3.0:1789518648.700534:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (15728640->16777215) req@ffff99fff4001500 x1876445617380224/t30064771129(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518648.700546:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001500 with x1876445617380224 ext(15728640->16777215) 00002000:00010000:3.0:1789518648.700554:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001500 00000100:00100000:0.0:1789518648.707107:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.707241:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617380352 00000100:00100000:2.0:1789518648.707255:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617380352 00002000:00100000:2.0:1789518648.707325:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (16777216->17825791) req@ffff99fff4003b80 x1876445617380352/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518648.707356:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4003b80 with x1876445617380352 ext(16777216->17825791) 00002000:00010000:2.0:1789518648.707363:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4003b80 00000100:00100000:2.0:1789518648.707406:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:2.0:1789518648.707417:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2342:x1876445617380352:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518648.718188:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.718295:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617380480 00000100:00100000:1.0:1789518648.718314:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617380480 00000100:00100000:3.0:1789518648.718449:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2342:x1876445617380352:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 11031us (11354us total) trans 30064771130 rc 0/0 00000100:00100000:3.0:1789518648.718460:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 157 00002000:00100000:3.0:1789518648.718484:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (16777216->17825791) req@ffff99fff4003b80 x1876445617380352/t30064771130(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518648.718499:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4003b80 with x1876445617380352 ext(16777216->17825791) 00002000:00010000:3.0:1789518648.718507:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4003b80 00002000:00100000:1.0:1789518648.718563:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (17825792->18874367) req@ffff99fec25cf800 x1876445617380480/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.718574:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cf800 with x1876445617380480 ext(17825792->18874367) 00002000:00010000:1.0:1789518648.718578:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec25cf800 00000100:00100000:1.0:1789518648.718746:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:1.0:1789518648.718761:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2342:x1876445617380480:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518648.725428:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2342:x1876445617380480:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 6649us (7231us total) trans 30064771131 rc 0/0 00000100:00100000:1.0:1789518648.725445:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 158 00002000:00100000:1.0:1789518648.725474:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (17825792->18874367) req@ffff99fec25cf800 x1876445617380480/t30064771131(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.725795:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cf800 with x1876445617380480 ext(17825792->18874367) 00002000:00010000:1.0:1789518648.725803:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec25cf800 00000100:00100000:0.0:1789518648.731261:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.731318:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617380608 00000100:00100000:3.0:1789518648.731330:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617380608 00002000:00100000:3.0:1789518648.731386:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (18874368->19922943) req@ffff99fec25cd500 x1876445617380608/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518648.731416:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cd500 with x1876445617380608 ext(18874368->19922943) 00002000:00010000:3.0:1789518648.731424:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec25cd500 00000100:00100000:1.0:1789518648.731673:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:1.0:1789518648.731689:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2345:x1876445617380608:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518648.739127:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.739299:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617380736 00000100:00100000:3.0:1789518648.739311:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617380736 00002000:00100000:3.0:1789518648.739474:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (19922944->20971519) req@ffff99fec1ec4a80 x1876445617380736/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518648.739487:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec4a80 with x1876445617380736 ext(19922944->20971519) 00002000:00010000:3.0:1789518648.739495:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec4a80 00000100:00100000:3.0:1789518648.739536:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:3.0:1789518648.739548:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2343:x1876445617380736:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518648.739846:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2345:x1876445617380608:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8160us (8598us total) trans 30064771132 rc 0/0 00000100:00100000:1.0:1789518648.739857:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 159 00002000:00100000:1.0:1789518648.739864:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (18874368->19922943) req@ffff99fec25cd500 x1876445617380608/t30064771132(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.739872:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cd500 with x1876445617380608 ext(18874368->19922943) 00002000:00010000:1.0:1789518648.740300:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec25cd500 00000100:00100000:1.0:1789518648.747901:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2343:x1876445617380736:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8340us (8773us total) trans 30064771133 rc 0/0 00000100:00100000:1.0:1789518648.747918:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 160 00002000:00100000:1.0:1789518648.747934:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (19922944->20971519) req@ffff99fec1ec4a80 x1876445617380736/t30064771133(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518648.747946:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec4a80 with x1876445617380736 ext(19922944->20971519) 00002000:00010000:1.0:1789518648.747954:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec4a80 00000100:00100000:3.0:1789518648.750244:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.750302:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617380864 00000100:00100000:2.0:1789518648.750313:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617380864 00000100:00100000:2.0:1789518648.750451:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 304 00000100:00100000:2.0:1789518648.750475:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:35150:x1876445617380864:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789518648.782346:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771333 is committed 00000020:00080000:0.0:1789518648.782398:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc9184840 refcount 2 committed 0 result 0 batchid 25769803901 00000020:00080000:0.0:1789518648.782403:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff7ad5c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc9184480 00000020:00080000:0.0:1789518648.782407:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff7ad5100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec9fd0400 00000004:00080000:0.0:1789518648.782451:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:0.0:1789518648.782473:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:0.0:1789518648.782484:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771334 is committed 00000020:00080000:0.0:1789518648.782497:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803900 batchid updated 00000100:00100000:0.0:1789518648.782685:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627660032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789518648.782744:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518648.782801:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518648.782808:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627659904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518648.782832:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518648.782860:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627660032 00000100:00100000:0.0:1789518648.782867:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627660032 00000100:00100000:0.0:1789518648.782903:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627659904 00000100:00100000:0.0:1789518648.782906:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627659904 00000100:00100000:0.0:1789518648.782936:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789518648.782944:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627660032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789518648.783135:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627660032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (390us total) trans 30064771134 rc 0/0 00000100:00100000:0.0:1789518648.783143:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789518648.783159:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789518648.783166:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627659904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789518648.783250:0:36531:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:0.0:1789518648.783254:0:36531:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb mtime from disk: 1789518648 -> 1789518648 00002000:00010000:0.0:1789518648.783257:0:36531:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518648.783259:0:36531:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb ctime from disk: 1789518648 -> 1789518648 00002000:00010000:0.0:1789518648.783261:0:36531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb blocks from disk: 16391 -> 16391 00000100:00100000:0.0:1789518648.783288:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627659904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (455us total) trans 30064771179 rc 0/0 00000100:00100000:0.0:1789518648.783294:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789518648.783317:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518648.783343:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771143 gen 2 00000004:00080000:0.0:1789518648.783348:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771143 committed transno 30064771143 00000100:00100000:0.0:1789518648.783369:0:3283:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fec1ec4000 x1876445627659904/t30064771179(30064771179) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518664 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789518648.783379:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec1ec4000/2, rc 0, transno 30064771179 00000100:00100000:0.0:1789518648.783384:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627659904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518648.783395:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771112 gen 2 00000004:00080000:0.0:1789518648.783398:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771112 committed transno 30064771112 00000100:00100000:0.0:1789518648.783409:0:3283:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fec1ec6a00 x1876445627660032/t30064771134(30064771134) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518664 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789518648.783417:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec1ec6a00/2, rc 0, transno 30064771134 00000100:00100000:0.0:1789518648.783425:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627660032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789518648.783652:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:35150:x1876445617380864:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 33189us (33471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518648.783661:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 304 00000020:00080000:3.0:1789518648.783725:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803901 committed batchid 25769803900 00000020:00080000:3.0:1789518648.783869:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803900 00000100:00100000:2.0:1789518648.785871:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.785959:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617380992 00000100:00100000:1.0:1789518648.785968:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617380992 00000100:00100000:1.0:1789518648.786028:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1789518648.786038:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2342:x1876445617380992:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789518648.853933:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771134 is committed 00000001:00080000:0.0:1789518648.853957:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771116 is committed 00000001:00080000:0.0:1789518648.853969:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771133 is committed 00000100:00100000:1.0:1789518648.854292:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617380992:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 68248us (68421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518648.854328:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:0.0:1789518648.859368:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.859728:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617381248 00000100:00100000:3.0:1789518648.859738:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617381248 00000100:00100000:2.0:1789518648.860494:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 305 00000100:00100000:2.0:1789518648.860506:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:35150:x1876445617381248:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518648.860561:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518648.860587:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786897 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddb0 expref: 24 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.860609:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518648.860657:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518648.860687:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.860701:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.860710:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518648.860905:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc855d18 reply state 000000005cb3e5d9 transno 30064771335 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.860915:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518648.861019:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:35150:x1876445617381248:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 515us (1662us total) trans 30064771335 rc 0/0 00000100:00100000:2.0:1789518648.861027:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 305 00010000:00010000:3.0:1789518648.862915:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.862932:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.862941:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.863189:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518648.863193:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.863213:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.863227:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:3.0:1789518648.863230:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518648.863235:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.863241:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7868ac lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518648.863556:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.863645:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617381376 00000100:00100000:2.0:1789518648.863655:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617381376 00000100:00100000:2.0:1789518648.863707:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:2.0:1789518648.863718:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2343:x1876445617381376:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518648.863960:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:2.0:1789518648.863964:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb mtime from disk: 0 -> 1789518648 00002000:00010000:2.0:1789518648.863967:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb atime from disk: 0 -> 1789518648 00002000:00010000:2.0:1789518648.863970:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb ctime from disk: 1789518649 -> 1789518648 00002000:00010000:2.0:1789518648.863972:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 40967 00000100:00100000:2.0:1789518648.864085:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617381376:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 368us (531us total) trans 30064771135 rc 0/0 00000100:00100000:2.0:1789518648.864093:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:0.0:1789518648.870696:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.871351:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617381632 00000100:00100000:2.0:1789518648.871360:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617381632 00000100:00100000:2.0:1789518648.871428:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 306 00000100:00100000:2.0:1789518648.871439:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:35150:x1876445617381632:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789518648.871514:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.871545:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda2 expref: 24 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.871555:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.871590:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda2 expref: 24 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.871603:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda2 expref: 24 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.871642:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627660160:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518648.871743:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518648.874943:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518648.874998:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617381760 00000100:00100000:3.0:1789518648.875007:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617381760 00010000:00010000:3.0:1789518648.875044:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda2 expref: 25 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518648.875076:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1789518648.875086:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1082050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2343:x1876445617381760:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518648.875100:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518648.875107:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda2 expref: 25 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.875121:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda2 expref: 25 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.875143:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:3.0:1789518648.875148:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.875157:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c78687b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda2 expref: 25 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.875178:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627660160:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518648.875180:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.875191:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.875204:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.875210:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518648.875216:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.875229:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518648.875274:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1082050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2343:x1876445617381760:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 189us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518648.875282:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00010000:00010000:2.0:1789518648.875294:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.875315:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.875322:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.875328:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518648.875333:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.875341:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.875350:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518648.875353:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789518648.875357:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.875362:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868b3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.875399:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:35150:x1876445617381632:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 3961us (4712us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789518648.875407:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 306 00000100:00100000:0.0:1789518648.879332:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.879504:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617381888 00000100:00100000:2.0:1789518648.879514:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617381888 00000100:00100000:2.0:1789518648.879569:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:2.0:1789518648.879579:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617381888:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789518648.879672:0:37973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.879702:0:37973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 7 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.879710:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518648.879714:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518648.879719:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.879750:0:37973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 7 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.879762:0:37973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 7 pid: 36532 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.879775:0:37973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:37973:1876445627660288:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518648.879840:0:37973:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789518648.887077:0:37973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:37973:1876445627660288:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518648.887107:0:37973:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518648.909483:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.909656:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617382016 00000100:00100000:2.0:1789518648.909666:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617382016 00010000:00010000:2.0:1789518648.909708:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 8 pid: 36532 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518648.909812:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:3.0:1789518648.909825:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2343:x1876445617382016:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518648.909842:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518648.909865:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 8 pid: 36532 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.909881:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 8 pid: 36532 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.909903:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912b7800/0x631fd8698c7868a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddbe expref: 8 pid: 36532 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.909920:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518648.909924:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518648.909930:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.909958:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.909994:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518648.910054:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2343:x1876445617382016:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 232us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518648.910062:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00010000:00010000:0.0:1789518648.910245:0:37973:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.910256:0:37973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.910279:0:37973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.910288:0:37973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.910296:0:37973:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.910303:0:37973:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518648.910308:0:37973:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.910317:0:37973:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.910329:0:37973:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.910337:0:37973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f950f091/0x631fd8698c7868ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518648.910398:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:2342:x1876445617381888:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 30822us (31075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518648.910406:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:0.0:1789518648.911799:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.913792:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617382272 00000100:00100000:2.0:1789518648.913807:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617382272 00000100:00100000:2.0:1789518648.913934:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 307 00000100:00100000:2.0:1789518648.913946:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:35150:x1876445617382272:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789518648.914033:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.914051:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.914064:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.914259:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.914271:0:35846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda9 expref: 24 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.914280:0:35846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.914312:0:35846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda9 expref: 24 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.914324:0:35846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda9 expref: 24 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.914337:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627660416:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518648.914424:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518648.919728:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.920158:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617382400 00000100:00100000:0.0:1789518648.920168:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617382400 00010000:00010000:0.0:1789518648.920205:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda9 expref: 25 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518648.920300:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:0.0:1789518648.920312:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9670e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2343:x1876445617382400:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518648.920329:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518648.920336:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda9 expref: 25 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.920350:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda9 expref: 25 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.920370:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:0.0:1789518648.920376:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.920384:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.920391:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518648.920408:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518648.920480:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9670e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2343:x1876445617382400:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 171us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518648.920487:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00010000:00010000:2.0:1789518648.921588:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786889 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdda9 expref: 24 pid: 35847 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.922021:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627660416:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518648.922044:0:35846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.922054:0:35846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.922061:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518648.922279:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771336 00000001:00080000:2.0:1789518648.922421:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771337 00000001:00080000:2.0:1789518648.922478:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771338 00000100:00100000:2.0:1789518648.922561:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35846:1876445627660544:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789518648.924752:0:35846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518648.924810:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789518648.924971:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627660544 00000100:00100000:3.0:1789518648.924980:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627660544 00000100:00100000:3.0:1789518648.925040:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789518648.925050:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35846:x1876445627660544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789518648.925153:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35846:x1876445627660544:12345-0@lo:1000:mdt00_001.0 Request processed in 104us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518648.925161:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789518648.925309:0:35846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771134 gen 2 00000004:00080000:2.0:1789518648.925315:0:35846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec1ec6a00, transno 30064771134 00000100:00100000:2.0:1789518648.925333:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35846:1876445627660544:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789518648.926059:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771339 00000100:00100000:2.0:1789518648.927571:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35846:1876445627660672:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789518648.927651:0:35846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518648.927678:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6c240 going to sleep for 11 seconds 00000100:00100000:0.0:1789518648.927701:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627660672 00000100:00100000:0.0:1789518648.927709:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627660672 00000100:00100000:0.0:1789518648.927814:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518648.927826:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35846:x1876445627660672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789518648.928049:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35846:x1876445627660672:12345-0@lo:1000:mdt00_001.0 Request processed in 225us (397us total) trans 30064771136 rc 0/0 00000100:00100000:0.0:1789518648.928070:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789518648.928499:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35846:1876445627660672:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789518648.928538:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928566:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928575:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928763:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518648.928768:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928776:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928789:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518648.928792:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518648.928796:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928803:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868c8 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928831:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928837:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928843:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928848:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518648.928859:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928866:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928874:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:2.0:1789518648.928876:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518648.928883:0:35846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c786820 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd8d expref: 27 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928893:0:35846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c786820 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd8d expref: 27 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928902:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c786820 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd8d expref: 27 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.928930:0:35846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17000/0x631fd8698c786820 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdd8d expref: 27 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518648.928941:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3474700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627660800:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518648.929008:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518648.933561:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.935878:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3474700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627660800:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518648.935911:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518648.935922:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786819 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937287:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937308:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937321:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937334:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937341:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937364:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937370:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518648.937374:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937383:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937395:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:3.0:1789518648.937398:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518648.937402:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937408:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c7868cf lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937422:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937428:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937434:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937439:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518648.937441:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937458:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937483:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:3.0:1789518648.937486:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518648.937489:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518648.937495:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c7868c1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518648.937559:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617382528 00000100:00100000:0.0:1789518648.937570:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617382528 00000100:00100000:0.0:1789518648.937649:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1789518648.937661:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:35149:x1876445617382528:12345-192.168.206.51@tcp:49:dd.500 00000100:00100000:0.0:1789518648.938029:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:35149:x1876445617382528:12345-192.168.206.51@tcp:49:dd.500 Request processed in 369us (4474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518648.938038:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:3.0:1789518648.938427:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:35150:x1876445617382272:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 24481us (26630us total) trans 30064771340 rc 0/0 00000100:00100000:3.0:1789518648.938436:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 307 00000020:00080000:3.0:1789518648.938921:0:35846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789518648.939177:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518648.939183:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518648.940275:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 9 00000040:00080000:0.0:1789518648.940286:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518648.940768:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518648.940839:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617382656 00000100:00100000:1.0:1789518648.940848:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617382656 00000100:00100000:1.0:1789518648.940900:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1789518648.940911:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:35149:x1876445617382656:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518648.940928:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518648.940948:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c7868d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddc5 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518648.940976:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc8:0x0] initial LVB size: 20971520, mtime: 0x6aa9e338, atime: 0x6aa9e338, ctime: 0x6aa9e338, blocks: 0xa007 00010000:00010000:1.0:1789518648.940998:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=702s v=(0 0) 00010000:00010000:1.0:1789518648.941003:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518648.941012:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c7868d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddc5 expref: 7 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.941029:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b85e1c3/0x631fd8698c7868d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddc5 expref: 7 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518648.941042:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7200, rc 0) 00000100:00100000:1.0:1789518648.941094:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:35149:x1876445617382656:12345-192.168.206.51@tcp:101:dd.500 Request processed in 186us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518648.941102:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1789518648.958502:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518648.958686:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617382784 00000100:00100000:0.0:1789518648.958703:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617382784 00002000:00100000:1.0:1789518648.958856:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (20971520->22020095) req@ffff99fec9672300 x1876445617382784/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789518648.958867:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9672300 with x1876445617382784 ext(20971520->22020095) 00002000:00010000:1.0:1789518648.958873:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec9672300 00000100:00100000:1.0:1789518648.958950:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:1.0:1789518648.958959:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2342:x1876445617382784:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:2.0:1789518648.969957:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2342:x1876445617382784:12345-192.168.206.51@tcp:4:dd.500 Request processed in 10988us (11452us total) trans 30064771137 rc 0/0 00000100:00100000:2.0:1789518648.969985:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00002000:00100000:2.0:1789518648.969999:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (20971520->22020095) req@ffff99fec9672300 x1876445617382784/t30064771137(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518648.970010:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9672300 with x1876445617382784 ext(20971520->22020095) 00002000:00010000:2.0:1789518648.970017:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec9672300 00000100:00100000:1.0:1789518648.978060:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518648.978203:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617382912 00000100:00100000:2.0:1789518648.978213:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617382912 00002000:00100000:2.0:1789518648.978351:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (22020096->23068671) req@ffff99fec9670a80 x1876445617382912/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/0 e 0 to 0 dl 1789518659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518648.978367:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9670a80 with x1876445617382912 ext(22020096->23068671) 00002000:00010000:2.0:1789518648.978376:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec9670a80 00000100:00100000:2.0:1789518648.978446:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:2.0:1789518648.978456:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617382912:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:2.0:1789518648.999254:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617382912:12345-192.168.206.51@tcp:4:dd.500 Request processed in 20789us (21192us total) trans 30064771138 rc 0/0 00000100:00100000:2.0:1789518648.999268:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00002000:00100000:2.0:1789518648.999280:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (22020096->23068671) req@ffff99fec9670a80 x1876445617382912/t30064771138(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:294/0 lens 488/448 e 0 to 0 dl 1789518659 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518648.999290:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9670a80 with x1876445617382912 ext(22020096->23068671) 00002000:00010000:2.0:1789518648.999296:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec9670a80 00000100:00100000:1.0:1789518649.008773:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518649.008873:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617383040 00000100:00100000:2.0:1789518649.008882:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617383040 00002000:00100000:2.0:1789518649.008944:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (23068672->24117247) req@ffff99fec1b9f800 x1876445617383040/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/0 e 0 to 0 dl 1789518660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.008956:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9f800 with x1876445617383040 ext(23068672->24117247) 00002000:00010000:2.0:1789518649.008962:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1b9f800 00000100:00100000:2.0:1789518649.008996:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:2.0:1789518649.009006:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617383040:12345-192.168.206.51@tcp:4:dd.500 00000100:00080000:0.0:1789518649.009378:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518649.021526:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617383040:12345-192.168.206.51@tcp:4:dd.500 Request processed in 12513us (12753us total) trans 30064771139 rc 0/0 00000100:00100000:2.0:1789518649.021539:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 163 00002000:00100000:2.0:1789518649.021551:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (23068672->24117247) req@ffff99fec1b9f800 x1876445617383040/t30064771139(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/448 e 0 to 0 dl 1789518660 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.021561:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9f800 with x1876445617383040 ext(23068672->24117247) 00002000:00010000:2.0:1789518649.021568:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1b9f800 00000100:00100000:1.0:1789518649.029263:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518649.029304:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518649.029344:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617383168 00000100:00100000:2.0:1789518649.029357:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617383168 00002000:00100000:2.0:1789518649.029408:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (24117248->25165823) req@ffff99fec1b9ca80 x1876445617383168/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/0 e 0 to 0 dl 1789518660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.029430:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9ca80 with x1876445617383168 ext(24117248->25165823) 00002000:00010000:2.0:1789518649.029436:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1b9ca80 00000100:00100000:2.0:1789518649.029481:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:2.0:1789518649.029499:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617383168:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:0.0:1789518649.029811:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617383424 00000100:00100000:0.0:1789518649.029816:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617383424 00000100:00100000:0.0:1789518649.029848:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:0.0:1789518649.029854:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:35150:x1876445617383424:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789518649.031208:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789518649.031335:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771341 00010000:00010000:0.0:1789518649.031386:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518649.031406:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518649.031418:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518649.031426:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518649.031433:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518649.031439:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518649.031476:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518649.031520:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518649.031534:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.031542:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28da00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518649.031546:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.031554:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.031568:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff99ffc2d97200) 00000100:00100000:0.0:1789518649.031571:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35150:x1876445617383424:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1712us (2262us total) trans 30064771342 rc 0/0 00010000:00010000:2.0:1789518649.031573:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518649.031579:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518649.031586:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00010000:00010000:2.0:1789518649.031591:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c7868dd lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789518649.031594:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518649.031803:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518649.031807:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518649.031809:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518649.042970:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617383168:12345-192.168.206.51@tcp:4:dd.500 Request processed in 13463us (13717us total) trans 30064771140 rc 0/0 00000100:00100000:2.0:1789518649.042983:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 164 00002000:00100000:2.0:1789518649.042995:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (24117248->25165823) req@ffff99fec1b9ca80 x1876445617383168/t30064771140(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/448 e 0 to 0 dl 1789518660 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.043005:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9ca80 with x1876445617383168 ext(24117248->25165823) 00002000:00010000:2.0:1789518649.043011:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1b9ca80 00000100:00100000:1.0:1789518649.052291:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518649.052357:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617383552 00000100:00100000:2.0:1789518649.052367:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617383552 00002000:00100000:2.0:1789518649.052427:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (25165824->26214399) req@ffff99fffc5f0380 x1876445617383552/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/0 e 0 to 0 dl 1789518660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.052440:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f0380 with x1876445617383552 ext(25165824->26214399) 00002000:00010000:2.0:1789518649.052445:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffc5f0380 00000100:00100000:2.0:1789518649.052485:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:2.0:1789518649.052492:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2344:x1876445617383552:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:2.0:1789518649.059117:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2344:x1876445617383552:12345-192.168.206.51@tcp:4:dd.500 Request processed in 6613us (6824us total) trans 30064771141 rc 0/0 00000100:00100000:2.0:1789518649.059130:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00002000:00100000:2.0:1789518649.059143:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (25165824->26214399) req@ffff99fffc5f0380 x1876445617383552/t30064771141(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/448 e 0 to 0 dl 1789518660 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.059153:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f0380 with x1876445617383552 ext(25165824->26214399) 00002000:00010000:2.0:1789518649.059160:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffc5f0380 00000100:00100000:1.0:1789518649.066969:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518649.067162:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617383680 00000100:00100000:2.0:1789518649.067171:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617383680 00002000:00100000:2.0:1789518649.067214:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (26214400->27262975) req@ffff99fffbb83100 x1876445617383680/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/0 e 0 to 0 dl 1789518660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.067225:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb83100 with x1876445617383680 ext(26214400->27262975) 00002000:00010000:2.0:1789518649.067231:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb83100 00000100:00100000:2.0:1789518649.067924:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:2.0:1789518649.067936:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2345:x1876445617383680:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:2.0:1789518649.077675:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2345:x1876445617383680:12345-192.168.206.51@tcp:4:dd.500 Request processed in 9732us (10704us total) trans 30064771142 rc 0/0 00000100:00100000:2.0:1789518649.077708:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00002000:00100000:2.0:1789518649.077721:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (26214400->27262975) req@ffff99fffbb83100 x1876445617383680/t30064771142(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/448 e 0 to 0 dl 1789518660 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.077731:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb83100 with x1876445617383680 ext(26214400->27262975) 00002000:00010000:2.0:1789518649.077738:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb83100 00000100:00100000:1.0:1789518649.084987:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518649.085117:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617383808 00000100:00100000:2.0:1789518649.085127:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617383808 00002000:00100000:2.0:1789518649.085184:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (27262976->28311551) req@ffff99fffbb80380 x1876445617383808/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/0 e 0 to 0 dl 1789518660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.085196:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb80380 with x1876445617383808 ext(27262976->28311551) 00002000:00010000:2.0:1789518649.085202:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb80380 00000100:00100000:2.0:1789518649.085231:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:2.0:1789518649.085240:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2344:x1876445617383808:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:2.0:1789518649.097504:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2344:x1876445617383808:12345-192.168.206.51@tcp:4:dd.500 Request processed in 12254us (12515us total) trans 30064771143 rc 0/0 00000100:00100000:2.0:1789518649.097516:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00002000:00100000:2.0:1789518649.097527:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (27262976->28311551) req@ffff99fffbb80380 x1876445617383808/t30064771143(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/448 e 0 to 0 dl 1789518660 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.097639:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb80380 with x1876445617383808 ext(27262976->28311551) 00002000:00010000:2.0:1789518649.097647:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb80380 00000100:00100000:1.0:1789518649.099606:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518649.099764:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617383936 00000100:00100000:2.0:1789518649.099775:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617383936 00002000:00100000:2.0:1789518649.099819:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (28311552->29360127) req@ffff99fffbb80700 x1876445617383936/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/0 e 0 to 0 dl 1789518660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.099844:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb80700 with x1876445617383936 ext(28311552->29360127) 00002000:00010000:2.0:1789518649.099849:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb80700 00000100:00100000:2.0:1789518649.099878:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:2.0:1789518649.099886:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2345:x1876445617383936:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:2.0:1789518649.108204:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2345:x1876445617383936:12345-192.168.206.51@tcp:4:dd.500 Request processed in 8307us (8601us total) trans 30064771144 rc 0/0 00000100:00100000:2.0:1789518649.108218:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 168 00002000:00100000:2.0:1789518649.108231:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (28311552->29360127) req@ffff99fffbb80700 x1876445617383936/t30064771144(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/448 e 0 to 0 dl 1789518660 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.108241:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb80700 with x1876445617383936 ext(28311552->29360127) 00002000:00010000:2.0:1789518649.108247:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb80700 00000100:00100000:3.0:1789518649.119765:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518649.119895:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617384064 00000100:00100000:2.0:1789518649.119908:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617384064 00002000:00100000:2.0:1789518649.119977:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (29360128->30408703) req@ffff99ffedb2b480 x1876445617384064/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/0 e 0 to 0 dl 1789518660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.119990:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2b480 with x1876445617384064 ext(29360128->30408703) 00002000:00010000:2.0:1789518649.119998:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffedb2b480 00000100:00100000:2.0:1789518649.120032:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:2.0:1789518649.120043:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2343:x1876445617384064:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:2.0:1789518649.128296:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2343:x1876445617384064:12345-192.168.206.51@tcp:4:dd.500 Request processed in 8237us (8714us total) trans 30064771145 rc 0/0 00000100:00100000:2.0:1789518649.128313:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00002000:00100000:2.0:1789518649.128348:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (29360128->30408703) req@ffff99ffedb2b480 x1876445617384064/t30064771145(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/448 e 0 to 0 dl 1789518660 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518649.128360:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2b480 with x1876445617384064 ext(29360128->30408703) 00002000:00010000:2.0:1789518649.128367:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffedb2b480 00000100:00100000:1.0:1789518649.133489:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518649.133747:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617384448 00000100:00100000:2.0:1789518649.133763:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617384448 00000100:00100000:2.0:1789518649.133845:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1789518649.133858:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35149:x1876445617384448:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:1.0:1789518649.133903:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518649.133960:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617384192 00000100:00100000:3.0:1789518649.133965:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617384192 00002000:00100000:3.0:1789518649.134005:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (30408704->31457279) req@ffff99fec525ce00 x1876445617384192/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/0 e 0 to 0 dl 1789518660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789518649.134017:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525ce00 with x1876445617384192 ext(30408704->31457279) 00002000:00010000:3.0:1789518649.134026:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec525ce00 00000100:00100000:3.0:1789518649.134056:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:3.0:1789518649.134062:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2342:x1876445617384192:12345-192.168.206.51@tcp:4:dd.500 00000001:00080000:2.0:1789518649.134350:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771343 00000001:00080000:2.0:1789518649.134585:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771344 00000100:00100000:2.0:1789518649.134770:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35149:x1876445617384448:12345-192.168.206.51@tcp:35:dd.500 Request processed in 911us (1293us total) trans 30064771345 rc 0/0 00000100:00100000:2.0:1789518649.134780:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000020:00080000:2.0:1789518649.134786:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789518649.143668:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617384192:12345-192.168.206.51@tcp:4:dd.500 Request processed in 9590us (10085us total) trans 30064771146 rc 0/0 00000100:00100000:3.0:1789518649.143705:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 170 00002000:00100000:3.0:1789518649.143722:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (30408704->31457279) req@ffff99fec525ce00 x1876445617384192/t30064771146(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:295/0 lens 488/448 e 0 to 0 dl 1789518660 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1789518649.143733:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525ce00 with x1876445617384192 ext(30408704->31457279) 00002000:00010000:3.0:1789518649.143741:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec525ce00 00000100:00100000:1.0:1789518649.185548:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518649.185689:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617384576 00000100:00100000:2.0:1789518649.185701:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617384576 00000100:00100000:2.0:1789518649.185771:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 308 00000100:00100000:2.0:1789518649.185783:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35160:x1876445617384576:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518649.185889:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.185912:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.185926:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.185943:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.185968:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.185977:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186374:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186385:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186392:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518649.186442:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186457:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186477:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186485:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186492:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518649.186498:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186506:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186525:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff99ffc2d97c00) 00010000:00010000:2.0:1789518649.186528:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518649.186535:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186542:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7868e4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186556:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186564:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186570:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186577:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518649.186580:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186586:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186594:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff99fec3b12700) 00010000:00010000:2.0:1789518649.186597:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518649.186600:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186606:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7868eb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186741:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186748:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186755:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186760:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518649.186763:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186771:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186779:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff99ffc2d97900) 00010000:00010000:2.0:1789518649.186782:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518649.186785:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518649.186791:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7868f2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518649.186892:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35160:x1876445617384576:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1108us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518649.186901:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 308 00010000:00010000:1.0:1789518649.202767:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518650.227183:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789518650.482975:0:35868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704479358937ns, next at 705479356910ns, rc = 0 00000100:00100000:0.0:1789518650.482997:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518650.483014:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627660928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518650.483099:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518650.483155:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627660928 00000100:00100000:0.0:1789518650.483161:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627660928 00000100:00100000:0.0:1789518650.483208:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789518650.483217:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627660928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518650.483236:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 144769024 pending 17039360 free 3823108096 avail 3821010944 00000100:00100000:0.0:1789518650.483280:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627660928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518650.483286:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789518650.483306:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518650.483358:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627660928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518650.995249:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518650.995274:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627661056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518650.995359:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518650.995434:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627661440:0@lo:400:kworker.0 00000100:00100000:2.0:1789518650.995490:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518650.995491:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627661312:0@lo:400:kworker.0 00000100:00100000:1.0:1789518650.995499:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627661184:0@lo:400:kworker.0 00000100:00100000:2.0:1789518650.995529:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518650.995540:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627661568:0@lo:400:kworker.0 00000100:00100000:0.0:1789518650.995546:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518650.995565:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518650.995578:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518650.995607:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627661696:0@lo:400:kworker.0 00000100:00100000:0.0:1789518650.995650:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627661440 00000100:00100000:0.0:1789518650.995657:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627661440 00000100:00100000:1.0:1789518650.995690:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518650.995703:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627661568 00000100:00100000:0.0:1789518650.995707:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627661568 00000100:00100000:2.0:1789518650.995719:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627661056 00000100:00100000:2.0:1789518650.995725:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627661056 00000100:00100000:3.0:1789518650.995728:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627661696 00000100:00100000:0.0:1789518650.995741:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789518650.995743:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627661696 00000100:00100000:0.0:1789518650.995753:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627661440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518650.995754:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518650.995768:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627661568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518650.995782:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789518650.995789:0:35846:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789518650.995796:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627661056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518650.995801:0:35846:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00002000:00000024:2.0:1789518650.995830:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 190775296 pending 11927552 free 3780116480 avail 3778019328 00000100:00100000:0.0:1789518650.995830:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627661440:12345-0@lo:400:kworker.0 Request processed in 79us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518650.995839:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627661568:12345-0@lo:400:kworker.0 Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518650.995843:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518650.995855:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789518650.995867:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518650.995876:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627661696:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789518650.995901:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518650.995907:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518650.995918:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627661696:12345-0@lo:400:kworker.0 Request processed in 43us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518650.995925:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789518650.995943:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627661696:0@lo:400:kworker.0 00000100:00100000:0.0:1789518650.995968:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627661568:0@lo:400:kworker.0 00000100:00100000:1.0:1789518650.995981:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627661184 00000100:00100000:0.0:1789518650.995983:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627661440:0@lo:400:kworker.0 00000100:00100000:1.0:1789518650.995987:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627661184 00000100:00100000:0.0:1789518650.996025:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627661312 00000100:00100000:1.0:1789518650.996029:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789518650.996031:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627661312 00000100:00100000:1.0:1789518650.996039:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627661184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518650.996080:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627661184:12345-0@lo:400:kworker.0 Request processed in 44us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518650.996089:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518650.996090:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789518650.996102:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627661312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518650.996130:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627661056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 337us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518650.996138:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627661184:0@lo:400:kworker.0 00000100:00100000:2.0:1789518650.996143:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789518650.996149:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627661312:12345-0@lo:400:kworker.0 Request processed in 47us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518650.996157:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518650.996192:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627661312:0@lo:400:kworker.0 00000100:00100000:2.0:1789518650.996195:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627661056:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789518651.251701:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518651.853853:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518651.854020:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617384704 00000100:00100000:1.0:1789518651.854032:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617384704 00000100:00100000:1.0:1789518651.854405:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 309 00000100:00100000:1.0:1789518651.854429:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35091:x1876445617384704:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1789518651.854474:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518651.854558:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35091:x1876445617384704:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 141us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518651.854566:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 309 00000100:00100000:0.0:1789518651.861764:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518651.861975:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617384960 00000100:00100000:1.0:1789518651.861990:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617384960 00000100:00100000:1.0:1789518651.862070:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1789518651.862081:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35091:x1876445617384960:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518651.862511:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:35091:x1876445617384960:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 428us (758us total) trans 30064771346 rc 0/0 00000100:00100000:1.0:1789518651.862520:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00010000:00010000:1.0:1789518652.274863:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518652.302670:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518652.302787:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518652.302823:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518652.303059:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518652.303091:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617385088 00000100:00100000:2.0:1789518652.303106:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617385088 00000100:00100000:0.0:1789518652.303119:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617385472 00000100:00100000:0.0:1789518652.303130:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617385472 00000100:00100000:0.0:1789518652.303196:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:3.0:1789518652.303202:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617385344 00000100:00100000:0.0:1789518652.303210:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617385472:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518652.303211:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617385344 00000100:00100000:2.0:1789518652.303254:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:2.0:1789518652.303266:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617385088:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518652.303277:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617385216 00000100:00100000:3.0:1789518652.303283:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617385216 00000100:00100000:0.0:1789518652.303289:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617385472:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518652.303296:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617385088:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518652.303299:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1789518652.303309:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00080000:0.0:1789518652.303335:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518652.303337:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00080000:0.0:1789518652.303344:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518652.303353:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518652.303354:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518652.303362:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2343:x1876445617385344:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518652.303519:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2343:x1876445617385344:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 164us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518652.303853:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2343:x1876445617385216:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518652.303987:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2343:x1876445617385216:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 546us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518652.304055:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518652.304859:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000001:00080000:2.0:1789518652.582434:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771179 is committed 00000001:00080000:2.0:1789518652.582459:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771171 is committed 00000001:00080000:2.0:1789518652.582544:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771175 is committed 00000001:00080000:2.0:1789518652.582726:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771178 is committed 00000001:02000400:0.0:1789518652.922192:0:39245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10b: Test RW-PCC with group quota on loop PCC device ========================================================== 20:30:52 (1789518652) 00010000:00010000:2.0:1789518653.299390:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518653.831872:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518653.831966:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617385728 00000100:00100000:3.0:1789518653.831979:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617385728 00000100:00100000:3.0:1789518653.832087:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 310 00000100:00100000:3.0:1789518653.832099:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:35874:x1876445617385728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518653.832132:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518653.832158:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7868f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddcc expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832283:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832299:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832313:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832330:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832337:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832344:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789518653.832507:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518653.832823:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78690e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832836:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78690e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832843:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78690e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518653.832855:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789518653.832959:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832974:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832979:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832983:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518653.832988:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.832996:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833011:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:3.0:1789518653.833014:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518653.833020:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833027:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786900 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833038:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833042:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833046:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833049:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518653.833056:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833060:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833065:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518653.833067:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518653.833069:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833073:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786907 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833898:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c7868f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddcc expref: 36 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833923:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78690e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddcc expref: 35 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.833931:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:3.0:1789518653.833934:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518653.833937:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:3.0:1789518653.834016:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:35874:x1876445617385728:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1918us (2157us total) trans 30064771347 rc 0/0 00000100:00100000:3.0:1789518653.834025:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 310 00000100:00100000:0.0:1789518653.837915:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518653.837963:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518653.838254:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617385856 00000100:00100000:3.0:1789518653.838264:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617385856 00000100:00100000:3.0:1789518653.838367:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:3.0:1789518653.838377:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2344:x1876445617385856:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518653.838406:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518653.838429:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78690e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddcc expref: 35 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.838460:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:3.0:1789518653.838465:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518653.838526:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2344:x1876445617385856:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 151us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518653.838534:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1789518653.839403:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617385984 00000100:00100000:1.0:1789518653.839412:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617385984 00000100:00100000:1.0:1789518653.839478:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 311 00000100:00100000:1.0:1789518653.839488:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35874:x1876445617385984:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789518653.839574:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35874:x1876445617385984:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 88us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518653.839581:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 311 00000100:00100000:0.0:1789518653.910689:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518653.911137:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617386240 00000100:00100000:2.0:1789518653.911147:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617386240 00000100:00100000:2.0:1789518653.911341:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 312 00000100:00100000:2.0:1789518653.911352:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35890:x1876445617386240:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:2.0:1789518653.911405:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518653.911428:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786659 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdcfa expref: 34 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.911458:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:2.0:1789518653.911468:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518653.911830:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.911844:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.911854:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.911866:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.911873:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.911879:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518653.912691:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00010000:00010000:2.0:1789518653.912709:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.912717:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.912723:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.912729:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518653.912733:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.912741:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.912751:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12400) 00010000:00010000:2.0:1789518653.912754:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518653.912758:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.912764:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c78691c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518653.912780:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebf4bb4e reply state 0000000095ff6129 transno 30064771348 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518653.912789:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518653.912890:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:35890:x1876445617386240:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 1536us (2207us total) trans 30064771348 rc 0/0 00000100:00100000:2.0:1789518653.912899:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 312 00010000:00010000:1.0:1789518653.916137:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518653.916153:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518653.916161:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518653.916168:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518653.916190:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518653.916199:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518653.916213:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff99fec3b12700) 00010000:00010000:1.0:1789518653.916216:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518653.916221:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518653.916227:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c786923 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518653.924474:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518653.924756:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617386368 00000100:00100000:3.0:1789518653.924766:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617386368 00000100:00100000:3.0:1789518653.924820:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 313 00000100:00100000:3.0:1789518653.924831:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35891:x1876445617386368:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518653.924853:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518653.924875:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78692a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddd3 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.924993:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786931 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.925007:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.925019:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518653.925054:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518653.925058:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518653.925092:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.925116:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c78692a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddd3 expref: 36 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.925133:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786931 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddd3 expref: 35 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.925142:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518653.925144:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518653.925148:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:3.0:1789518653.925226:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:35891:x1876445617386368:12345-192.168.206.51@tcp:101:dd.0 Request processed in 396us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518653.925232:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 313 00000100:00100000:0.0:1789518653.928732:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518653.928939:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617386496 00000100:00100000:2.0:1789518653.928960:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617386496 00000100:00100000:2.0:1789518653.929117:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 314 00000100:00100000:2.0:1789518653.929140:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:35891:x1876445617386496:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518653.929158:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518653.929176:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddda expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929236:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929249:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929260:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929273:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929281:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929287:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929407:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78694d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929416:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78694d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929423:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78694d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518653.929472:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00000004:00200000:2.0:1789518653.929477:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518653.929496:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78694d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929508:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929514:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929521:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929527:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518653.929531:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929538:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929550:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518653.929553:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518653.929558:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929564:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c78693f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929578:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929595:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929602:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929607:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518653.929610:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929657:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929665:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff99fec3b12400) 00010000:00010000:2.0:1789518653.929667:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518653.929670:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929676:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929719:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddda expref: 37 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929733:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5400/0x631fd8698c78694d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddda expref: 36 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518653.929745:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:2.0:1789518653.929747:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789518653.929756:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5400, rc 0) 00000100:00100000:2.0:1789518653.930413:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:35891:x1876445617386496:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1283us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518653.930421:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 314 00000100:00100000:2.0:1789518653.934610:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518653.935227:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617386752 00000100:00100000:3.0:1789518653.935237:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617386752 00000100:00100000:3.0:1789518653.935298:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 315 00000100:00100000:3.0:1789518653.935307:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:35891:x1876445617386752:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518653.935326:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518653.935345:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786954 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdde1 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.935467:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.935481:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.935507:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.935522:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.935528:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.935535:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518653.936046:0:39157:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc8:0x0], index 1: 0 00010000:00010000:3.0:1789518653.936212:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786969 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936222:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786969 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936229:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786969 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936260:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936267:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936274:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936279:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518653.936291:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936299:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936310:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:3.0:1789518653.936313:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518653.936318:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936324:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78695b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518653.936336:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012c19ffd reply state 00000000b0fe5e7e transno 30064771349 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518653.936344:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518653.936374:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786954 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde1 expref: 39 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936387:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786969 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde1 expref: 38 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.936394:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:3.0:1789518653.936396:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518653.936398:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16a00, rc 0) 00000100:00100000:3.0:1789518653.936472:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:35891:x1876445617386752:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1165us (1876us total) trans 30064771349 rc 0/0 00000100:00100000:3.0:1789518653.936480:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 315 00010000:00010000:3.0:1789518653.937956:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.937969:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.937976:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.937982:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518653.937986:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.937993:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.938004:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff99ffeaa78200) 00010000:00010000:3.0:1789518653.938007:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518653.938011:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.938138:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786962 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518653.943858:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518653.943953:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617386880 00000100:00100000:3.0:1789518653.943961:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617386880 00000100:00100000:3.0:1789518653.944008:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:3.0:1789518653.944061:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:35891:x1876445617386880:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518653.944117:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518653.944136:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdde8 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518653.944175:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518653.944195:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1789518653.944199:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518653.944208:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde8 expref: 10 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.944327:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde8 expref: 10 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518653.944341:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:3.0:1789518653.944419:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:35891:x1876445617386880:12345-192.168.206.51@tcp:101:dd.0 Request processed in 403us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518653.944426:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:0.0:1789518653.956681:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518653.956953:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617387008 00000100:00100000:2.0:1789518653.956963:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617387008 00002000:00100000:2.0:1789518653.957013:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (0->1048575) req@ffff99fff78db800 x1876445617387008/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:299/0 lens 488/0 e 0 to 0 dl 1789518664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518653.957025:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78db800 with x1876445617387008 ext(0->1048575) 00002000:00010000:2.0:1789518653.957031:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78db800 00000100:00100000:2.0:1789518653.957066:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:2.0:1789518653.957076:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617387008:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518653.966049:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518653.966128:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617387136 00000100:00100000:1.0:1789518653.966137:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617387136 00002000:00100000:1.0:1789518653.966179:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (1048576->2097151) req@ffff99fec82fa300 x1876445617387136/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:299/0 lens 488/0 e 0 to 0 dl 1789518664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518653.966190:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82fa300 with x1876445617387136 ext(1048576->2097151) 00002000:00010000:1.0:1789518653.966196:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82fa300 00000100:00100000:1.0:1789518653.966278:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:1.0:1789518653.966288:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617387136:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518653.983995:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518653.984048:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617387264 00000100:00100000:0.0:1789518653.984059:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617387264 00000100:00100000:1.0:1789518653.984192:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617387008:12345-192.168.206.51@tcp:4:dd.0 Request processed in 27114us (27517us total) trans 30064771181 rc 0/0 00000100:00100000:1.0:1789518653.984204:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00002000:00100000:1.0:1789518653.984216:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (0->1048575) req@ffff99fff78db800 x1876445617387008/t30064771181(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:299/0 lens 488/448 e 0 to 0 dl 1789518664 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518653.984226:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78db800 with x1876445617387008 ext(0->1048575) 00002000:00010000:1.0:1789518653.984245:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78db800 00000100:00100000:2.0:1789518653.984247:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617387136:12345-192.168.206.51@tcp:4:dd.0 Request processed in 17958us (18206us total) trans 30064771180 rc 0/0 00000100:00100000:2.0:1789518653.984257:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 172 00002000:00100000:2.0:1789518653.984265:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (1048576->2097151) req@ffff99fec82fa300 x1876445617387136/t30064771180(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:299/0 lens 488/448 e 0 to 0 dl 1789518664 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518653.984274:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82fa300 with x1876445617387136 ext(1048576->2097151) 00002000:00010000:2.0:1789518653.984278:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82fa300 00002000:00100000:1.0:1789518653.986210:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (2097152->3145727) req@ffff99fff78db100 x1876445617387264/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:299/0 lens 488/0 e 0 to 0 dl 1789518664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518653.986222:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78db100 with x1876445617387264 ext(2097152->3145727) 00002000:00010000:1.0:1789518653.986228:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78db100 00000100:00100000:1.0:1789518653.986270:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:1.0:1789518653.986280:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2345:x1876445617387264:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518653.994869:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518653.994908:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617387392 00000100:00100000:0.0:1789518653.994918:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617387392 00002000:00100000:0.0:1789518653.994965:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (3145728->4194303) req@ffff99fff78d9180 x1876445617387392/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:299/0 lens 488/0 e 0 to 0 dl 1789518664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518653.994978:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d9180 with x1876445617387392 ext(3145728->4194303) 00002000:00010000:0.0:1789518653.994985:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d9180 00000100:00100000:0.0:1789518653.995024:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:0.0:1789518653.995035:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2345:x1876445617387392:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518653.995962:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2345:x1876445617387264:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9678us (11974us total) trans 30064771182 rc 0/0 00000100:00100000:1.0:1789518653.995971:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 173 00002000:00100000:1.0:1789518653.995980:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (2097152->3145727) req@ffff99fff78db100 x1876445617387264/t30064771182(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:299/0 lens 488/448 e 0 to 0 dl 1789518664 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518653.995988:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78db100 with x1876445617387264 ext(2097152->3145727) 00002000:00010000:1.0:1789518653.995993:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78db100 00000100:00100000:1.0:1789518654.004552:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2345:x1876445617387392:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9508us (9685us total) trans 30064771183 rc 0/0 00000100:00100000:1.0:1789518654.004565:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 174 00002000:00100000:1.0:1789518654.004579:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (3145728->4194303) req@ffff99fff78d9180 x1876445617387392/t30064771183(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:299/0 lens 488/448 e 0 to 0 dl 1789518664 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.004589:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d9180 with x1876445617387392 ext(3145728->4194303) 00002000:00010000:1.0:1789518654.004596:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d9180 00000100:00100000:3.0:1789518654.008504:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.008651:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617387520 00000100:00100000:2.0:1789518654.008660:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617387520 00002000:00100000:2.0:1789518654.008706:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (4194304->5242879) req@ffff99ffedb29500 x1876445617387520/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.008719:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29500 with x1876445617387520 ext(4194304->5242879) 00002000:00010000:2.0:1789518654.008724:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb29500 00000100:00080000:0.0:1789518654.008789:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518654.008830:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:2.0:1789518654.008840:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2344:x1876445617387520:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518654.018685:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2344:x1876445617387520:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9837us (10177us total) trans 30064771184 rc 0/0 00000100:00100000:2.0:1789518654.018699:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 175 00002000:00100000:2.0:1789518654.018712:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (4194304->5242879) req@ffff99ffedb29500 x1876445617387520/t30064771184(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.018723:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29500 with x1876445617387520 ext(4194304->5242879) 00002000:00010000:2.0:1789518654.018730:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb29500 00000100:00100000:0.0:1789518654.026816:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.026898:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617387648 00000100:00100000:3.0:1789518654.026907:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617387648 00002000:00100000:3.0:1789518654.026949:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (5242880->6291455) req@ffff99fff78d8700 x1876445617387648/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518654.026960:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d8700 with x1876445617387648 ext(5242880->6291455) 00002000:00010000:3.0:1789518654.026965:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d8700 00000100:00100000:3.0:1789518654.027045:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:3.0:1789518654.027055:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2345:x1876445617387648:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518654.036263:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2345:x1876445617387648:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9199us (9445us total) trans 30064771185 rc 0/0 00000100:00100000:3.0:1789518654.036289:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 176 00002000:00100000:3.0:1789518654.036303:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (5242880->6291455) req@ffff99fff78d8700 x1876445617387648/t30064771185(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518654.036314:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d8700 with x1876445617387648 ext(5242880->6291455) 00002000:00010000:3.0:1789518654.036320:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d8700 00000100:00100000:2.0:1789518654.043776:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.043886:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617387776 00000100:00100000:1.0:1789518654.043897:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617387776 00002000:00100000:1.0:1789518654.043940:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (6291456->7340031) req@ffff99fec82f8000 x1876445617387776/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.043963:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82f8000 with x1876445617387776 ext(6291456->7340031) 00002000:00010000:1.0:1789518654.043970:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82f8000 00000100:00100000:1.0:1789518654.044841:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 177 00000100:00100000:1.0:1789518654.044855:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2343:x1876445617387776:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.052770:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2343:x1876445617387776:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7909us (8992us total) trans 30064771186 rc 0/0 00000100:00100000:1.0:1789518654.052784:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 177 00002000:00100000:1.0:1789518654.052799:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (6291456->7340031) req@ffff99fec82f8000 x1876445617387776/t30064771186(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.052810:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82f8000 with x1876445617387776 ext(6291456->7340031) 00002000:00010000:1.0:1789518654.052817:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec82f8000 00000100:00100000:0.0:1789518654.059283:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.059382:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617387904 00000100:00100000:2.0:1789518654.059391:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617387904 00002000:00100000:2.0:1789518654.060170:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (7340032->8388607) req@ffff99fff78d8e00 x1876445617387904/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.060182:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d8e00 with x1876445617387904 ext(7340032->8388607) 00002000:00010000:2.0:1789518654.060188:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d8e00 00000100:00100000:2.0:1789518654.060348:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:2.0:1789518654.060360:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2342:x1876445617387904:12345-192.168.206.51@tcp:4:dd.0 00000040:00080000:0.0:1789518654.066889:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518654.066898:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518654.067549:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 9 00000040:00080000:0.0:1789518654.067561:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518654.068284:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2342:x1876445617387904:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7920us (9002us total) trans 30064771187 rc 0/0 00000100:00100000:0.0:1789518654.068297:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 178 00002000:00100000:0.0:1789518654.068311:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc8:0x0] (7340032->8388607) req@ffff99fff78d8e00 x1876445617387904/t30064771187(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518654.068327:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d8e00 with x1876445617387904 ext(7340032->8388607) 00002000:00010000:0.0:1789518654.068335:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d8e00 00000100:00100000:1.0:1789518654.075693:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.075725:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617388032 00000100:00100000:1.0:1789518654.075733:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617388032 00002000:00100000:1.0:1789518654.075768:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (8388608->9437183) req@ffff99fff6908700 x1876445617388032/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.075776:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff6908700 with x1876445617388032 ext(8388608->9437183) 00002000:00010000:1.0:1789518654.075781:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff6908700 00000100:00100000:1.0:1789518654.075870:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:1.0:1789518654.075882:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2343:x1876445617388032:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518654.084757:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.084826:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617388160 00000100:00100000:0.0:1789518654.084839:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617388160 00002000:00100000:0.0:1789518654.084889:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (9437184->10485759) req@ffff99ffedb28380 x1876445617388160/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518654.084901:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb28380 with x1876445617388160 ext(9437184->10485759) 00002000:00010000:0.0:1789518654.084906:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb28380 00000100:00100000:0.0:1789518654.084943:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:0.0:1789518654.084955:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2342:x1876445617388160:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518654.086415:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2343:x1876445617388032:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10531us (10723us total) trans 30064771188 rc 0/0 00000100:00100000:2.0:1789518654.086431:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 179 00002000:00100000:2.0:1789518654.086454:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (8388608->9437183) req@ffff99fff6908700 x1876445617388032/t30064771188(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.086464:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff6908700 with x1876445617388032 ext(8388608->9437183) 00002000:00010000:2.0:1789518654.086470:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff6908700 00000100:00100000:3.0:1789518654.097153:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.097226:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2342:x1876445617388160:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12264us (12476us total) trans 30064771189 rc 0/0 00000100:00100000:2.0:1789518654.097244:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 180 00002000:00100000:2.0:1789518654.098549:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (9437184->10485759) req@ffff99ffedb28380 x1876445617388160/t30064771189(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.098564:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb28380 with x1876445617388160 ext(9437184->10485759) 00002000:00010000:2.0:1789518654.098573:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb28380 00000100:00100000:2.0:1789518654.098655:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617388288 00000100:00100000:2.0:1789518654.098666:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617388288 00002000:00100000:2.0:1789518654.098716:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (10485760->11534335) req@ffff99ffedb29880 x1876445617388288/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.098726:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29880 with x1876445617388288 ext(10485760->11534335) 00002000:00010000:2.0:1789518654.098730:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb29880 00000100:00100000:2.0:1789518654.098760:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:2.0:1789518654.098772:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2343:x1876445617388288:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518654.109129:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2343:x1876445617388288:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10344us (11966us total) trans 30064771190 rc 0/0 00000100:00100000:3.0:1789518654.109145:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 181 00002000:00100000:3.0:1789518654.109161:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (10485760->11534335) req@ffff99ffedb29880 x1876445617388288/t30064771190(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518654.109174:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29880 with x1876445617388288 ext(10485760->11534335) 00002000:00010000:3.0:1789518654.109183:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb29880 00000100:00100000:3.0:1789518654.118946:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.119348:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617388416 00000100:00100000:2.0:1789518654.119361:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617388416 00002000:00100000:2.0:1789518654.119466:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (11534336->12582911) req@ffff99ffedb28700 x1876445617388416/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.119479:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb28700 with x1876445617388416 ext(11534336->12582911) 00002000:00010000:2.0:1789518654.119486:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb28700 00000100:00100000:2.0:1789518654.119519:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 182 00000100:00100000:2.0:1789518654.119714:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2344:x1876445617388416:12345-192.168.206.51@tcp:4:dd.0 00000001:00080000:1.0:1789518654.122599:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771136 is committed 00000001:00080000:1.0:1789518654.122644:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771145 is committed 00000001:00080000:1.0:1789518654.122720:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771146 is committed 00000100:00100000:2.0:1789518654.127400:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2344:x1876445617388416:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7682us (8459us total) trans 30064771191 rc 0/0 00000100:00100000:2.0:1789518654.127413:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 182 00002000:00100000:2.0:1789518654.127426:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (11534336->12582911) req@ffff99ffedb28700 x1876445617388416/t30064771191(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.127449:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb28700 with x1876445617388416 ext(11534336->12582911) 00002000:00010000:2.0:1789518654.127456:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb28700 00000004:00080000:3.0:1789518654.129540:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:3.0:1789518654.129577:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771342 is committed 00000100:00100000:1.0:1789518654.129698:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518654.129730:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627661824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789518654.129744:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627661952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789518654.129832:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518654.129874:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627661824 00000100:00100000:2.0:1789518654.129883:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627661824 00000100:00100000:1.0:1789518654.129930:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789518654.130242:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789518654.130295:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771346 is committed 00000001:00080000:3.0:1789518654.130306:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771348 is committed 00000020:00080000:3.0:1789518654.130336:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fec8f6c900 refcount 2 committed 0 result 0 batchid 25769803902 00000020:00080000:3.0:1789518654.130341:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff7337900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fec8f6c6c0 00000020:00080000:3.0:1789518654.130344:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff7337800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec8e85c00 00000001:00080000:3.0:1789518654.130378:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771349 is committed 00000020:00080000:3.0:1789518654.130390:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803901 batchid updated 00000020:00080000:0.0:1789518654.130461:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803902 committed batchid 25769803901 00000020:00080000:0.0:1789518654.130812:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803901 00000100:00100000:2.0:1789518654.132005:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627661952 00000100:00100000:2.0:1789518654.132018:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627661952 00000100:00100000:0.0:1789518654.132091:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789518654.132168:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627661824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789518654.132211:0:37973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:199 count 1 00002000:00010000:0.0:1789518654.132259:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc7:0x0] initial LVB size: 15728640, mtime: 0x6aa9e337, atime: 0x0, ctime: 0x6aa9e338, blocks: 0x7807 00010000:00010000:0.0:1789518654.132269:0:37973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.132289:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=708s v=(0 0) 00010000:00010000:0.0:1789518654.132294:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518654.132300:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.132321:0:37973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.132330:0:37973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.132335:0:37973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.132356:0:37973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789518654.132405:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789518654.132424:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627661952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789518654.132734:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb size from disk: 20971520 -> 31457280 00002000:00010000:2.0:1789518654.132739:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb mtime from disk: 1789518648 -> 1789518649 00002000:00010000:2.0:1789518654.132742:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb atime from disk: 1789518648 -> 1789518648 00002000:00010000:2.0:1789518654.132744:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb ctime from disk: 1789518648 -> 1789518649 00002000:00010000:2.0:1789518654.132747:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb blocks from disk: 40967 -> 61447 00010000:00010000:3.0:1789518654.133129:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518654.133140:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.133151:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518654.133158:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.133170:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518654.133180:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627661952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 759us (3247us total) trans 30064771147 rc 0/0 00000100:00100000:2.0:1789518654.133197:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:3.0:1789518654.133206:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.133217:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bd2510e/0x631fd8698c78697e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.133257:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518654.133261:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518654.133263:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518654.133338:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771136 gen 2 00000004:00080000:1.0:1789518654.133347:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771136 committed transno 30064771136 00000100:00100000:1.0:1789518654.133373:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fff79af480 x1876445627661952/t30064771147(30064771147) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518670 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789518654.133385:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff79af480/2, rc 0, transno 30064771147 00000100:00100000:1.0:1789518654.133390:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627661952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789518654.133454:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627661824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1291us (3622us total) trans 30064771148 rc 0/0 00000100:00100000:0.0:1789518654.133465:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789518654.133704:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000004:00080000:2.0:1789518654.133744:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff79af800/2, rc 0, transno 30064771148 00000100:00100000:2.0:1789518654.133752:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627661824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789518654.133779:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617388544 00000100:00100000:1.0:1789518654.133788:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617388544 00002000:00100000:1.0:1789518654.133824:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (12582912->13631487) req@ffff99ffedb28000 x1876445617388544/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.133834:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb28000 with x1876445617388544 ext(12582912->13631487) 00002000:00010000:1.0:1789518654.133838:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb28000 00000100:00100000:1.0:1789518654.133867:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 183 00000100:00100000:1.0:1789518654.133876:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2342:x1876445617388544:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.139762:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2342:x1876445617388544:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5876us (6049us total) trans 30064771192 rc 0/0 00000100:00100000:1.0:1789518654.139776:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 183 00002000:00100000:1.0:1789518654.139790:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (12582912->13631487) req@ffff99ffedb28000 x1876445617388544/t30064771192(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.139799:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb28000 with x1876445617388544 ext(12582912->13631487) 00002000:00010000:1.0:1789518654.139806:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb28000 00000100:00100000:0.0:1789518654.143598:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.144099:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617388672 00000100:00100000:3.0:1789518654.144112:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617388672 00002000:00100000:3.0:1789518654.144179:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (13631488->14680063) req@ffff99fff78d9500 x1876445617388672/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518654.144191:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d9500 with x1876445617388672 ext(13631488->14680063) 00002000:00010000:3.0:1789518654.144199:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d9500 00000100:00100000:0.0:1789518654.144304:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00100000:0.0:1789518654.144317:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2342:x1876445617388672:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518654.149609:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2342:x1876445617388672:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5284us (6014us total) trans 30064771193 rc 0/0 00000100:00100000:2.0:1789518654.149670:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 184 00002000:00100000:2.0:1789518654.149687:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (13631488->14680063) req@ffff99fff78d9500 x1876445617388672/t30064771193(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.149698:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d9500 with x1876445617388672 ext(13631488->14680063) 00002000:00010000:2.0:1789518654.149706:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d9500 00000100:00100000:0.0:1789518654.152662:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.152714:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.152831:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617389056 00000100:00100000:3.0:1789518654.152844:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617389056 00000100:00100000:2.0:1789518654.152915:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617388800 00000100:00100000:2.0:1789518654.152920:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617388800 00002000:00100000:2.0:1789518654.152997:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (14680064->15728639) req@ffff99ffc52be680 x1876445617388800/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.153011:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52be680 with x1876445617388800 ext(14680064->15728639) 00002000:00010000:2.0:1789518654.153017:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52be680 00000100:00100000:3.0:1789518654.153035:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:3.0:1789518654.153047:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:35891:x1876445617389056:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:2.0:1789518654.153086:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 185 00000100:00100000:2.0:1789518654.153094:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2342:x1876445617388800:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518654.153671:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:35891:x1876445617389056:12345-192.168.206.51@tcp:35:dd.0 Request processed in 624us (954us total) trans 30064771350 rc 0/0 00000100:00100000:3.0:1789518654.153683:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518654.162105:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2342:x1876445617388800:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8997us (9484us total) trans 30064771194 rc 0/0 00000100:00100000:2.0:1789518654.162122:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 185 00002000:00100000:2.0:1789518654.162137:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (14680064->15728639) req@ffff99ffc52be680 x1876445617388800/t30064771194(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.162150:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52be680 with x1876445617388800 ext(14680064->15728639) 00002000:00010000:2.0:1789518654.162158:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52be680 00000100:00100000:1.0:1789518654.165771:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.165941:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617389312 00000100:00100000:3.0:1789518654.165967:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617389312 00000100:00100000:3.0:1789518654.166061:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 316 00000100:00100000:3.0:1789518654.166073:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:35892:x1876445617389312:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518654.166105:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518654.166132:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786985 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddef expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.166642:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.166661:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.166678:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.166697:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.166705:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.166730:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518654.167514:0:35847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc9:0x0], index 0: 0 00010000:00010000:3.0:1789518654.167823:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78699a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.167837:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78699a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.167846:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78699a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.167885:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.167893:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.167901:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.167908:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518654.167913:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.167922:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.167935:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:3.0:1789518654.167938:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518654.167951:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.167958:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c78698c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518654.167973:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037b320d1 reply state 00000000899556e3 transno 30064771351 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518654.167983:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518654.168022:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786985 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddef expref: 27 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.168039:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78699a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddef expref: 26 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.168047:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:3.0:1789518654.168050:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518654.168052:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:3.0:1789518654.168138:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:35892:x1876445617389312:12345-192.168.206.51@tcp:101:dd.0 Request processed in 2067us (2380us total) trans 30064771351 rc 0/0 00000100:00100000:3.0:1789518654.168147:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 316 00010000:00010000:1.0:1789518654.169313:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.169327:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.169335:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.169341:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518654.169346:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.169353:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.169368:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff99ffd1b0c400) 00010000:00010000:1.0:1789518654.169371:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518654.169376:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.169382:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786993 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518654.172838:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.173013:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617389440 00000100:00100000:3.0:1789518654.173027:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617389440 00000100:00100000:3.0:1789518654.173170:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:3.0:1789518654.173180:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+6:35892:x1876445617389440:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518654.173199:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518654.173219:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c7869a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddf6 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518654.173263:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518654.173293:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1789518654.173299:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518654.173312:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c7869a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddf6 expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.173329:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8f0426e/0x631fd8698c7869a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddf6 expref: 7 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.173342:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16e00, rc 0) 00000100:00100000:3.0:1789518654.173407:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:35892:x1876445617389440:12345-192.168.206.51@tcp:101:dd.0 Request processed in 229us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518654.173415:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00080000:0.0:1789518654.173483:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518654.186858:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.186957:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617389568 00000100:00100000:1.0:1789518654.186972:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617389568 00002000:00100000:1.0:1789518654.187043:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (0->1048575) req@ffff99ffc52bf800 x1876445617389568/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.187055:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bf800 with x1876445617389568 ext(0->1048575) 00002000:00010000:1.0:1789518654.187080:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bf800 00000100:00100000:1.0:1789518654.187127:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00100000:1.0:1789518654.187138:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:2344:x1876445617389568:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.198456:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2344:x1876445617389568:12345-192.168.206.51@tcp:4:dd.0 Request processed in 11293us (11580us total) trans 30064771149 rc 0/0 00000100:00100000:1.0:1789518654.198473:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 186 00002000:00100000:1.0:1789518654.198488:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (0->1048575) req@ffff99ffc52bf800 x1876445617389568/t30064771149(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.198500:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bf800 with x1876445617389568 ext(0->1048575) 00002000:00010000:1.0:1789518654.198508:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bf800 00000100:00100000:0.0:1789518654.201291:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.201369:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617389696 00000100:00100000:2.0:1789518654.201381:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617389696 00002000:00100000:2.0:1789518654.201457:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (1048576->2097151) req@ffff99ffc52bf100 x1876445617389696/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.201470:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bf100 with x1876445617389696 ext(1048576->2097151) 00002000:00010000:2.0:1789518654.201478:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bf100 00000100:00100000:2.0:1789518654.201515:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:2.0:1789518654.201527:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2345:x1876445617389696:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518654.209778:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2345:x1876445617389696:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8234us (8483us total) trans 30064771150 rc 0/0 00000100:00100000:0.0:1789518654.209795:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 187 00002000:00100000:0.0:1789518654.209812:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (1048576->2097151) req@ffff99ffc52bf100 x1876445617389696/t30064771150(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518654.209824:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bf100 with x1876445617389696 ext(1048576->2097151) 00002000:00010000:0.0:1789518654.209833:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bf100 00000100:00100000:3.0:1789518654.214361:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.214447:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617389824 00000100:00100000:2.0:1789518654.214458:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617389824 00002000:00100000:2.0:1789518654.214516:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (2097152->3145727) req@ffff99fff7a27800 x1876445617389824/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.214528:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a27800 with x1876445617389824 ext(2097152->3145727) 00002000:00010000:2.0:1789518654.214534:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a27800 00000100:00100000:2.0:1789518654.214568:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 188 00000100:00100000:2.0:1789518654.214577:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2345:x1876445617389824:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518654.221795:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617389824:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7029us (7257us total) trans 30064771151 rc 0/0 00000100:00100000:0.0:1789518654.221811:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 188 00002000:00100000:0.0:1789518654.221828:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (2097152->3145727) req@ffff99fff7a27800 x1876445617389824/t30064771151(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518654.221839:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a27800 with x1876445617389824 ext(2097152->3145727) 00002000:00010000:0.0:1789518654.221849:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a27800 00000100:00100000:3.0:1789518654.226929:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.227004:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617389952 00000100:00100000:1.0:1789518654.227018:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617389952 00002000:00100000:1.0:1789518654.227096:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (3145728->4194303) req@ffff99fff7a26d80 x1876445617389952/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.227110:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a26d80 with x1876445617389952 ext(3145728->4194303) 00002000:00010000:1.0:1789518654.227116:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a26d80 00000100:00100000:1.0:1789518654.227153:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:1.0:1789518654.227165:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2344:x1876445617389952:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.233297:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2344:x1876445617389952:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6119us (6367us total) trans 30064771152 rc 0/0 00000100:00100000:1.0:1789518654.233327:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 189 00002000:00100000:1.0:1789518654.233343:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (3145728->4194303) req@ffff99fff7a26d80 x1876445617389952/t30064771152(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.233356:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a26d80 with x1876445617389952 ext(3145728->4194303) 00002000:00010000:1.0:1789518654.233378:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a26d80 00000100:00100000:0.0:1789518654.247925:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.248198:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617390080 00000100:00100000:1.0:1789518654.248211:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617390080 00002000:00100000:1.0:1789518654.248271:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (4194304->5242879) req@ffff99ffc52bd180 x1876445617390080/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.248284:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bd180 with x1876445617390080 ext(4194304->5242879) 00002000:00010000:1.0:1789518654.248292:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bd180 00000100:00100000:1.0:1789518654.248330:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:1.0:1789518654.248341:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617390080:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.254488:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2343:x1876445617390080:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6133us (6562us total) trans 30064771153 rc 0/0 00000100:00100000:1.0:1789518654.254504:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 190 00002000:00100000:1.0:1789518654.254521:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (4194304->5242879) req@ffff99ffc52bd180 x1876445617390080/t30064771153(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.254532:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bd180 with x1876445617390080 ext(4194304->5242879) 00002000:00010000:1.0:1789518654.254539:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bd180 00000100:00100000:2.0:1789518654.257816:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.257984:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617390208 00000100:00100000:0.0:1789518654.258007:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617390208 00002000:00100000:0.0:1789518654.258077:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (5242880->6291455) req@ffff99ffed933b80 x1876445617390208/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518654.258090:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed933b80 with x1876445617390208 ext(5242880->6291455) 00002000:00010000:0.0:1789518654.258096:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed933b80 00000100:00100000:0.0:1789518654.258134:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00100000:0.0:1789518654.258147:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617390208:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518654.266421:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.266512:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617390336 00000100:00100000:0.0:1789518654.266524:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617390336 00002000:00100000:0.0:1789518654.266582:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (6291456->7340031) req@ffff99fff7a26680 x1876445617390336/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518654.266604:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a26680 with x1876445617390336 ext(6291456->7340031) 00002000:00010000:0.0:1789518654.266628:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a26680 00000100:00100000:0.0:1789518654.266662:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 192 00000100:00100000:0.0:1789518654.266673:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2343:x1876445617390336:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.267228:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2342:x1876445617390208:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9082us (9423us total) trans 30064771154 rc 0/0 00000100:00100000:1.0:1789518654.267239:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 191 00002000:00100000:1.0:1789518654.267247:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (5242880->6291455) req@ffff99ffed933b80 x1876445617390208/t30064771154(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.267257:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed933b80 with x1876445617390208 ext(5242880->6291455) 00002000:00010000:1.0:1789518654.267262:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed933b80 00000100:00100000:1.0:1789518654.272017:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617390336:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5330us (5596us total) trans 30064771155 rc 0/0 00000100:00100000:1.0:1789518654.272048:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 192 00002000:00100000:1.0:1789518654.272065:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (6291456->7340031) req@ffff99fff7a26680 x1876445617390336/t30064771155(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.272077:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a26680 with x1876445617390336 ext(6291456->7340031) 00002000:00010000:1.0:1789518654.272086:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a26680 00000100:00100000:0.0:1789518654.280081:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.280372:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617390464 00000100:00100000:1.0:1789518654.280384:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617390464 00002000:00100000:1.0:1789518654.280460:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (7340032->8388607) req@ffff99ffc52bc700 x1876445617390464/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.280472:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bc700 with x1876445617390464 ext(7340032->8388607) 00002000:00010000:1.0:1789518654.280479:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bc700 00000100:00100000:1.0:1789518654.280519:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:1.0:1789518654.280531:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2344:x1876445617390464:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.286385:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2344:x1876445617390464:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5839us (6301us total) trans 30064771156 rc 0/0 00000100:00100000:1.0:1789518654.286403:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 193 00002000:00100000:1.0:1789518654.286421:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (7340032->8388607) req@ffff99ffc52bc700 x1876445617390464/t30064771156(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.286444:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bc700 with x1876445617390464 ext(7340032->8388607) 00002000:00010000:1.0:1789518654.286453:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bc700 00000100:00100000:2.0:1789518654.295869:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.295956:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617390592 00000100:00100000:3.0:1789518654.295969:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617390592 00002000:00100000:3.0:1789518654.296032:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (8388608->9437183) req@ffff99ffed932d80 x1876445617390592/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518654.296045:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed932d80 with x1876445617390592 ext(8388608->9437183) 00002000:00010000:3.0:1789518654.296053:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed932d80 00000100:00100000:3.0:1789518654.296087:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:3.0:1789518654.296099:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2342:x1876445617390592:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518654.303734:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.303905:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617390720 00000100:00100000:1.0:1789518654.303916:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617390720 00002000:00100000:1.0:1789518654.303978:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (9437184->10485759) req@ffff99ffc52bce00 x1876445617390720/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.304029:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bce00 with x1876445617390720 ext(9437184->10485759) 00002000:00010000:1.0:1789518654.304037:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bce00 00000100:00100000:1.0:1789518654.304079:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:1.0:1789518654.304091:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2342:x1876445617390720:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518654.304933:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617390592:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8830us (9073us total) trans 30064771157 rc 0/0 00000100:00100000:2.0:1789518654.304955:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 194 00002000:00100000:2.0:1789518654.304966:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (8388608->9437183) req@ffff99ffed932d80 x1876445617390592/t30064771157(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.304976:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed932d80 with x1876445617390592 ext(8388608->9437183) 00002000:00010000:2.0:1789518654.304981:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed932d80 00000100:00100000:1.0:1789518654.314090:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617390720:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9986us (10353us total) trans 30064771158 rc 0/0 00000100:00100000:1.0:1789518654.314108:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 195 00002000:00100000:1.0:1789518654.314123:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (9437184->10485759) req@ffff99ffc52bce00 x1876445617390720/t30064771158(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.314135:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bce00 with x1876445617390720 ext(9437184->10485759) 00002000:00010000:1.0:1789518654.314143:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bce00 00000100:00100000:3.0:1789518654.316319:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.316555:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617390848 00000100:00100000:1.0:1789518654.316568:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617390848 00002000:00100000:1.0:1789518654.316866:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (10485760->11534335) req@ffff99fec48d5c00 x1876445617390848/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.316880:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5c00 with x1876445617390848 ext(10485760->11534335) 00002000:00010000:1.0:1789518654.316888:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d5c00 00000100:00100000:1.0:1789518654.316983:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 196 00000100:00100000:1.0:1789518654.317004:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2344:x1876445617390848:12345-192.168.206.51@tcp:4:dd.0 00010000:00010000:1.0:1789518654.322805:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518654.328224:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.328852:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617390976 00000100:00100000:2.0:1789518654.328866:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617390976 00002000:00100000:2.0:1789518654.328941:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (11534336->12582911) req@ffff99ffc52bd500 x1876445617390976/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.328957:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bd500 with x1876445617390976 ext(11534336->12582911) 00002000:00010000:2.0:1789518654.328966:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bd500 00000100:00100000:2.0:1789518654.329015:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:2.0:1789518654.329029:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617390976:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.332142:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2344:x1876445617390848:12345-192.168.206.51@tcp:4:dd.0 Request processed in 15121us (15830us total) trans 30064771159 rc 0/0 00000100:00100000:1.0:1789518654.332185:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 196 00002000:00100000:1.0:1789518654.332206:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (10485760->11534335) req@ffff99fec48d5c00 x1876445617390848/t30064771159(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.332220:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5c00 with x1876445617390848 ext(10485760->11534335) 00002000:00010000:1.0:1789518654.332229:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d5c00 00000100:00100000:0.0:1789518654.338562:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2342:x1876445617390976:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9521us (10340us total) trans 30064771160 rc 0/0 00000100:00100000:0.0:1789518654.338580:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 197 00002000:00100000:0.0:1789518654.338596:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (11534336->12582911) req@ffff99ffc52bd500 x1876445617390976/t30064771160(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518654.338607:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bd500 with x1876445617390976 ext(11534336->12582911) 00002000:00010000:0.0:1789518654.338646:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bd500 00000100:00100000:2.0:1789518654.339809:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.339912:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617391104 00000100:00100000:1.0:1789518654.339924:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617391104 00002000:00100000:1.0:1789518654.339975:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (12582912->13631487) req@ffff99ffed932680 x1876445617391104/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.339987:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed932680 with x1876445617391104 ext(12582912->13631487) 00002000:00010000:1.0:1789518654.340052:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed932680 00000100:00100000:1.0:1789518654.340119:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 198 00000100:00100000:1.0:1789518654.340130:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2343:x1876445617391104:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518654.347168:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2343:x1876445617391104:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7022us (7350us total) trans 30064771161 rc 0/0 00000100:00100000:0.0:1789518654.347245:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 198 00002000:00100000:0.0:1789518654.347270:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (12582912->13631487) req@ffff99ffed932680 x1876445617391104/t30064771161(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518654.347282:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed932680 with x1876445617391104 ext(12582912->13631487) 00002000:00010000:0.0:1789518654.347290:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed932680 00000100:00100000:1.0:1789518654.354139:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.354239:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617391232 00000100:00100000:3.0:1789518654.354252:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617391232 00002000:00100000:3.0:1789518654.354314:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (13631488->14680063) req@ffff99fff6908a80 x1876445617391232/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518654.354327:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff6908a80 with x1876445617391232 ext(13631488->14680063) 00002000:00010000:3.0:1789518654.354335:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff6908a80 00000100:00100000:3.0:1789518654.354368:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:3.0:1789518654.354378:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2343:x1876445617391232:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.361587:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2343:x1876445617391232:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7195us (7447us total) trans 30064771162 rc 0/0 00000100:00100000:1.0:1789518654.361603:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 199 00002000:00100000:1.0:1789518654.361651:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (13631488->14680063) req@ffff99fff6908a80 x1876445617391232/t30064771162(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518654.361662:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff6908a80 with x1876445617391232 ext(13631488->14680063) 00002000:00010000:1.0:1789518654.361670:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff6908a80 00000100:00100000:2.0:1789518654.368669:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.368719:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.368825:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617391360 00000100:00100000:0.0:1789518654.368838:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617391360 00002000:00100000:0.0:1789518654.368905:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (14680064->15728639) req@ffff99ffed931f80 x1876445617391360/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/0 e 0 to 0 dl 1789518665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518654.368920:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931f80 with x1876445617391360 ext(14680064->15728639) 00002000:00010000:0.0:1789518654.368927:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed931f80 00000100:00100000:0.0:1789518654.368970:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:0.0:1789518654.368982:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2343:x1876445617391360:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518654.369301:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617391616 00000100:00100000:1.0:1789518654.369307:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617391616 00000100:00100000:1.0:1789518654.369362:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:1.0:1789518654.369370:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:35892:x1876445617391616:12345-192.168.206.51@tcp:35:dd.0 00000001:00080000:1.0:1789518654.369750:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771352 00000100:00100000:1.0:1789518654.369866:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:35892:x1876445617391616:12345-192.168.206.51@tcp:35:dd.0 Request processed in 495us (1145us total) trans 30064771353 rc 0/0 00000100:00100000:1.0:1789518654.369875:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000020:00080000:1.0:1789518654.369880:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789518654.379187:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2343:x1876445617391360:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10191us (10562us total) trans 30064771163 rc 0/0 00000100:00100000:2.0:1789518654.379204:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 200 00002000:00100000:2.0:1789518654.379221:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (14680064->15728639) req@ffff99ffed931f80 x1876445617391360/t30064771163(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:300/0 lens 488/448 e 0 to 0 dl 1789518665 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518654.379232:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931f80 with x1876445617391360 ext(14680064->15728639) 00002000:00010000:2.0:1789518654.379241:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed931f80 00000100:00100000:3.0:1789518654.388192:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.388316:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617391744 00000100:00100000:2.0:1789518654.388328:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617391744 00000100:00100000:2.0:1789518654.388523:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 317 00000100:00100000:2.0:1789518654.388536:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:35893:x1876445617391744:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518654.388567:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518654.388591:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7869af lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfddfd expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.388680:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.388696:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.388709:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.388842:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c7869af lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddfd expref: 30 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.388867:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddfd expref: 29 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.388874:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:2.0:1789518654.388876:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518654.388879:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4e00, rc 0) 00000100:00100000:2.0:1789518654.388958:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35893:x1876445617391744:12345-192.168.206.51@tcp:101:chown.0 Request processed in 425us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518654.388963:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 317 00000100:00100000:1.0:1789518654.392769:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.392882:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617392000 00000100:00100000:3.0:1789518654.392895:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617392000 00000100:00100000:3.0:1789518654.392968:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 318 00000100:00100000:3.0:1789518654.392981:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35893:x1876445617392000:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:0.0:1789518654.393199:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518654.393234:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786969 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde1 expref: 29 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.393255:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:0.0:1789518654.393260:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518654.393291:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.393305:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.393324:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518654.394128:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].10, 88 off9000 00000004:00080000:0.0:1789518654.394142:0:39157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 708390527636ns, next at 709390524769ns, rc = 0 00000004:00010000:0.0:1789518654.394242:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063f7d51e reply state 00000000c763181c transno 30064771354 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.394254:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518654.394385:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:35893:x1876445617392000:12345-192.168.206.51@tcp:36:chown.0 Request processed in 1405us (1626us total) trans 30064771354 rc 0/0 00000100:00100000:0.0:1789518654.394398:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 318 00000100:00100000:0.0:1789518654.399181:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.399254:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617392128 00000100:00100000:1.0:1789518654.399361:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617392128 00000100:00100000:1.0:1789518654.399430:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 319 00000100:00100000:1.0:1789518654.399451:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:35893:x1876445617392128:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:1.0:1789518654.399486:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518654.399515:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.399516:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde04 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.399538:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.399548:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.399555:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518654.399561:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.399590:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.399607:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde04 expref: 31 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.399737:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:3.0:1789518654.399742:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518654.399748:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.399755:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7869bd lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.399854:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde04 expref: 30 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.399879:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:1.0:1789518654.399882:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518654.399884:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7000, rc 0) 00000100:00100000:1.0:1789518654.399958:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:35893:x1876445617392128:12345-192.168.206.51@tcp:101:chown.0 Request processed in 509us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518654.399977:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 319 00000100:00100000:3.0:1789518654.403879:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.404128:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617392256 00000100:00100000:2.0:1789518654.404141:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617392256 00000100:00100000:2.0:1789518654.404241:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:2.0:1789518654.404254:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2345:x1876445617392256:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:2.0:1789518654.404532:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1789518654.404537:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb mtime from disk: 0 -> 1789518654 00002000:00010000:2.0:1789518654.404540:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518654.404542:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb ctime from disk: 0 -> 1789518655 00002000:00010000:2.0:1789518654.404544:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518654.404638:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2345:x1876445617392256:12345-192.168.206.51@tcp:2:chown.0 Request processed in 362us (748us total) trans 30064771195 rc 0/0 00000100:00100000:2.0:1789518654.404645:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:2.0:1789518654.430507:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.430980:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617392384 00000100:00100000:0.0:1789518654.430993:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617392384 00000100:00100000:0.0:1789518654.431063:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 320 00000100:00100000:0.0:1789518654.431075:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:35894:x1876445617392384:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:0.0:1789518654.431101:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518654.431128:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7869cb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde0b expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.431171:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c800/0x631fd8698c7869d2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.431189:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c800/0x631fd8698c7869d2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.431486:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c800/0x631fd8698c7869d2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.431667:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7869cb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde0b expref: 32 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.431691:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c800/0x631fd8698c7869d2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde0b expref: 31 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.431700:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:0.0:1789518654.431704:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518654.431707:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c800, rc 0) 00000100:00100000:1.0:1789518654.431933:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:35894:x1876445617392384:12345-192.168.206.51@tcp:101:chown.0 Request processed in 857us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518654.431943:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 320 00000100:00100000:0.0:1789518654.435413:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.435513:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617392640 00000100:00100000:2.0:1789518654.435527:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617392640 00000100:00100000:2.0:1789518654.435596:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 321 00000100:00100000:2.0:1789518654.435608:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:35894:x1876445617392640:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:2.0:1789518654.435976:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518654.436328:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c78699a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddef expref: 31 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.436353:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:2.0:1789518654.436359:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518654.436398:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.436415:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.436428:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518654.437451:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].12, 88 off9080 00000004:00080000:2.0:1789518654.437467:0:39157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708433852225ns, next at 709433848576ns, rc = 0 00000004:00010000:2.0:1789518654.437579:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d3690b4 reply state 00000000f0ba06bb transno 30064771355 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518654.437592:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518654.437918:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35894:x1876445617392640:12345-192.168.206.51@tcp:36:chown.0 Request processed in 2309us (2515us total) trans 30064771355 rc 0/0 00000100:00100000:2.0:1789518654.437929:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 321 00010000:00010000:1.0:1789518654.439386:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.439404:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.439413:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.439420:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518654.439425:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.439445:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.439463:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:1.0:1789518654.439466:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518654.439472:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.439479:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c7869d9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.441292:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.441358:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617392768 00000100:00100000:1.0:1789518654.441370:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617392768 00000100:00100000:1.0:1789518654.441809:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 322 00000100:00100000:1.0:1789518654.441822:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:35894:x1876445617392768:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:1.0:1789518654.441848:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518654.441868:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7869e0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde12 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.441931:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7869e0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde12 expref: 32 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.441943:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6c00/0x631fd8698c7869e0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde12 expref: 32 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.441958:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:1.0:1789518654.441960:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518654.441963:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6c00, rc 0) 00000100:00100000:1.0:1789518654.442032:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35894:x1876445617392768:12345-192.168.206.51@tcp:101:chown.0 Request processed in 214us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518654.442039:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 322 00000100:00100000:3.0:1789518654.445980:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.446248:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617392896 00000100:00100000:0.0:1789518654.446260:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617392896 00000100:00100000:0.0:1789518654.446370:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:0.0:1789518654.446383:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2343:x1876445617392896:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:0.0:1789518654.446679:0:37973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:0.0:1789518654.446683:0:37973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb mtime from disk: 0 -> 1789518655 00002000:00010000:0.0:1789518654.446687:0:37973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518654.446690:0:37973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb ctime from disk: 0 -> 1789518655 00002000:00010000:0.0:1789518654.446693:0:37973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518654.446773:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2343:x1876445617392896:12345-192.168.206.51@tcp:2:chown.0 Request processed in 392us (806us total) trans 30064771164 rc 0/0 00000100:00100000:0.0:1789518654.446781:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:0.0:1789518654.482314:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.483026:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617393024 00000100:00100000:1.0:1789518654.483177:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617393024 00000100:00100000:1.0:1789518654.483242:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 323 00000100:00100000:1.0:1789518654.483251:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:35900:x1876445617393024:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518654.483275:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518654.483302:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7869e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde19 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.483389:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7869ee lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.483497:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7869ee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.483513:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7869ee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518654.483577:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00000004:00200000:1.0:1789518654.483582:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518654.483604:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7869ee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.483668:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c7869e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde19 expref: 34 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.483693:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7869ee lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde19 expref: 33 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.483703:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:1.0:1789518654.483706:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518654.483711:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c7800, rc 0) 00000100:00100000:1.0:1789518654.483852:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:35900:x1876445617393024:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 600us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518654.483860:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 323 00000100:00100000:3.0:1789518654.488583:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.488915:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617393152 00000100:00100000:2.0:1789518654.488929:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617393152 00000100:00100000:2.0:1789518654.488998:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 324 00000100:00100000:2.0:1789518654.489369:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:35900:x1876445617393152:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518654.489399:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518654.489447:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7869f5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde20 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489534:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489550:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489562:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489579:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489591:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489597:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489788:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489796:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489803:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518654.489834:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00000004:00200000:2.0:1789518654.489839:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518654.489860:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489873:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489882:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489889:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489896:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489908:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518654.489913:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489921:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489934:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:2.0:1789518654.489937:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518654.489942:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489948:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c7869fc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489962:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489968:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489974:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489979:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518654.489981:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489986:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.489997:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff99fec3b12700) 00010000:00010000:2.0:1789518654.490000:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518654.490002:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.490019:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a03 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.490090:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c7869f5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde20 expref: 35 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.490106:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde20 expref: 34 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.490113:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:2.0:1789518654.490116:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518654.490118:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5600, rc 0) 00000100:00100000:2.0:1789518654.490199:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35900:x1876445617393152:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 1190us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518654.490206:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 324 00000100:00100000:3.0:1789518654.493210:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.493272:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617393408 00000100:00100000:1.0:1789518654.493287:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617393408 00000100:00100000:1.0:1789518654.493361:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 325 00000100:00100000:1.0:1789518654.493372:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35900:x1876445617393408:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518654.493399:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518654.493461:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a11 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde27 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.493600:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a18 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.493856:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a18 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.493872:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a18 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518654.493887:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:1.0:1789518654.494272:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a11 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde27 expref: 37 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.494294:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a18 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde27 expref: 36 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.494304:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:1.0:1789518654.494307:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518654.494311:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:1.0:1789518654.494399:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:35900:x1876445617393408:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 1027us (1196us total) trans 30064771356 rc 0/0 00000100:00100000:1.0:1789518654.494408:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 325 00000100:00100000:1.0:1789518654.498186:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.498223:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.498275:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617393792 00000100:00100000:2.0:1789518654.498278:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617393664 00000100:00100000:2.0:1789518654.498287:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617393664 00000100:00100000:0.0:1789518654.498287:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617393792 00000100:00100000:2.0:1789518654.498363:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 326 00000100:00100000:2.0:1789518654.498374:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:35900:x1876445617393664:12345-192.168.206.51@tcp:101:lfs.500 00000100:00100000:0.0:1789518654.498454:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1789518654.498463:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2342:x1876445617393792:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518654.498472:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518654.498478:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518654.498503:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786a26 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde2e expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.498503:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a18 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde27 expref: 37 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.498524:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:0.0:1789518654.498530:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518654.498596:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2342:x1876445617393792:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 135us (371us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518654.498636:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a2d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.498651:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a2d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.498662:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a2d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518654.498677:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:2.0:1789518654.498841:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786a26 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde2e expref: 39 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.498859:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00010000:00010000:2.0:1789518654.498864:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a2d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde2e expref: 38 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.498876:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:2.0:1789518654.498880:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518654.498883:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4600, rc 0) 00000100:00100000:2.0:1789518654.498913:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:35900:x1876445617393664:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 541us (737us total) trans 30064771357 rc 0/0 00000100:00100000:2.0:1789518654.498921:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 326 00000100:00100000:3.0:1789518654.587457:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.587564:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617393920 00000100:00100000:0.0:1789518654.587578:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617393920 00000100:00100000:0.0:1789518654.588506:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:0.0:1789518654.588519:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2345:x1876445617393920:12345-192.168.206.51@tcp:1:lfs.500 00010000:00010000:0.0:1789518654.588564:0:36531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.588933:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde8 expref: 41 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.588942:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789518654.588947:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518654.588952:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.588988:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde8 expref: 41 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.589003:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde8 expref: 41 pid: 36531 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.589017:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc52bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627662080:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518654.589121:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518654.592344:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc52bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627662080:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518654.592384:0:36531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518654.599963:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.600223:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617394048 00000100:00100000:0.0:1789518654.600235:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617394048 00010000:00010000:0.0:1789518654.600287:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde8 expref: 42 pid: 36531 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.600452:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:0.0:1789518654.600465:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2342:x1876445617394048:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518654.600497:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518654.600530:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde8 expref: 42 pid: 36531 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.600559:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde8 expref: 42 pid: 36531 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.600588:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdde8 expref: 42 pid: 36531 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.600611:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518654.600673:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518654.600679:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.600691:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.600726:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518654.600796:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2342:x1876445617394048:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 333us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518654.600804:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00010000:00010000:3.0:1789518654.600922:0:36531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.600933:0:36531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.600964:0:36531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.600975:0:36531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.601012:0:36531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.601020:0:36531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ca00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518654.601025:0:36531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.601035:0:36531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.601050:0:36531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.601059:0:36531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cfb7e14/0x631fd8698c786a3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518654.601140:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2345:x1876445617393920:12345-192.168.206.51@tcp:1:lfs.500 Request processed in 12625us (13707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518654.601150:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:3.0:1789518654.603780:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.604310:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617394304 00000100:00100000:1.0:1789518654.604324:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617394304 00000100:00100000:1.0:1789518654.604454:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1789518654.604483:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:35900:x1876445617394304:12345-192.168.206.51@tcp:35:lfs.500 00000004:00010000:1.0:1789518654.604580:0:35848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x20:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a2d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde2e expref: 37 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518654.605724:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771358 00000001:00080000:1.0:1789518654.605791:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771359 00000001:00080000:1.0:1789518654.607974:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771360 00010000:00010000:1.0:1789518654.608160:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.608186:0:35848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddfd expref: 41 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.608196:0:35848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde20 expref: 41 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.608204:0:35848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde04 expref: 41 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.608213:0:35848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 6/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.608259:0:35848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde04 expref: 41 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.608276:0:35848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde04 expref: 41 pid: 35846 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518654.608293:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff690aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627662208:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518654.608514:0:35848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde20 expref: 41 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.608525:0:35848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde20 expref: 41 pid: 39157 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518654.608535:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff6909c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627662336:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518654.608571:0:35848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddfd expref: 41 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.608579:0:35848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddfd expref: 41 pid: 35845 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518654.608594:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff690bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627662464:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518654.608643:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518654.614483:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.614499:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff690aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627662208:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518654.614671:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617394432 00000100:00100000:0.0:1789518654.614680:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617394432 00010000:00010000:0.0:1789518654.614728:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde04 expref: 42 pid: 35846 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.614833:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:0.0:1789518654.614845:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617394432:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518654.614862:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518654.614870:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde04 expref: 42 pid: 35846 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.614884:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde04 expref: 42 pid: 35846 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518654.614951:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff6909c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627662336:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518654.614961:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff690bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627662464:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518654.615021:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:0.0:1789518654.615049:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c7869c4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde04 expref: 42 pid: 35846 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.615071:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:0.0:1789518654.615078:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.615087:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.615095:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518654.615157:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2343:x1876445617394432:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 314us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518654.615165:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00010000:00010000:1.0:1789518654.615322:0:35848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518654.615382:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.615403:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617394560 00000100:00100000:0.0:1789518654.615408:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617394560 00010000:00010000:0.0:1789518654.615444:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde20 expref: 41 pid: 39157 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.615461:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1789518654.615468:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1083850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2344:x1876445617394560:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518654.615477:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518654.615481:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde20 expref: 41 pid: 39157 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.615491:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde20 expref: 41 pid: 39157 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.615506:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786a0a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde20 expref: 41 pid: 39157 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.615531:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:0.0:1789518654.615535:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.615542:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.615549:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518654.615577:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1083850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2344:x1876445617394560:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 109us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518654.615584:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:0.0:1789518654.616696:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617394688 00000100:00100000:0.0:1789518654.616708:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617394688 00010000:00010000:0.0:1789518654.616741:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddfd expref: 40 pid: 35845 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.616913:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:0.0:1789518654.616923:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2345:x1876445617394688:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518654.616936:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518654.616942:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddfd expref: 40 pid: 35845 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.616955:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddfd expref: 40 pid: 35845 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.616978:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c7869b6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddfd expref: 40 pid: 35845 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.617093:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:0.0:1789518654.617100:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.617109:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.617119:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.617153:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518654.617247:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2345:x1876445617394688:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 325us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518654.617255:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00010000:00010000:1.0:1789518654.617304:0:35848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.617312:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518654.617508:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771361 00000001:00080000:1.0:1789518654.617773:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771362 00000100:00100000:1.0:1789518654.617891:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff690bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627662592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518654.618169:0:35848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518654.618218:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789518654.618246:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627662592 00000100:00100000:3.0:1789518654.618255:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627662592 00000100:00100000:3.0:1789518654.618372:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518654.618382:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627662592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1789518654.618408:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518654.618696:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627662592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 315us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518654.618720:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789518654.618760:0:35848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771179 gen 2 00000004:00080000:1.0:1789518654.618767:0:35848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec1ec4000, transno 30064771179 00000100:00100000:1.0:1789518654.618783:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff690bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627662592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789518654.619377:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771363 00000100:00100000:1.0:1789518654.620458:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff690bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627662720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518654.620523:0:35848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518654.620556:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518654.620736:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627662720 00000100:00100000:2.0:1789518654.620751:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627662720 00000100:00100000:2.0:1789518654.620944:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518654.620960:0:35850:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789518654.620961:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627662720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518654.620975:0:35850:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789518654.621413:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35848:x1876445627662720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 457us (887us total) trans 30064771196 rc 0/0 00000100:00100000:2.0:1789518654.621422:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789518654.621517:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff690bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627662720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789518654.621607:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771364 00010000:00010000:1.0:1789518654.621697:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.621712:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.621723:0:35848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.621748:0:35848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518654.621755:0:35848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.621778:0:35848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.621799:0:35848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:1.0:1789518654.621804:0:35848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789518654.621810:0:35848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.621816:0:35848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a42 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518654.622192:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789518654.622287:0:35848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].11, 64 off9064 00000001:00080000:1.0:1789518654.622297:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771365 00010000:00010000:1.0:1789518654.622335:0:35848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:1.0:1789518654.622339:0:35848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518654.622347:0:35848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a2d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde2e expref: 43 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518654.622499:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:35900:x1876445617394304:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 18018us (18732us total) trans 30064771366 rc 0/0 00000100:00100000:1.0:1789518654.622510:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000020:00080000:1.0:1789518654.622516:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789518654.625907:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.626375:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617394816 00000100:00100000:0.0:1789518654.626388:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617394816 00000100:00100000:0.0:1789518654.626480:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 327 00000100:00100000:0.0:1789518654.626495:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:35900:x1876445617394816:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518654.626527:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518654.626556:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786a49 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde35 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.626667:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786a49 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde35 expref: 43 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.626686:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786a49 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde35 expref: 43 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.626709:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518654.626714:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518654.626719:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c000, rc 0) 00000100:00100000:0.0:1789518654.626857:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:35900:x1876445617394816:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 366us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518654.626870:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 327 00000100:00100000:0.0:1789518654.629804:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.629933:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617395072 00000100:00100000:3.0:1789518654.629948:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617395072 00000100:00100000:3.0:1789518654.630125:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1789518654.630141:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:35900:x1876445617395072:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:3.0:1789518654.630590:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:35900:x1876445617395072:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 451us (795us total) trans 30064771367 rc 0/0 00000100:00100000:3.0:1789518654.630600:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:3.0:1789518654.666347:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.667102:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617395200 00000100:00100000:1.0:1789518654.667113:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617395200 00000100:00100000:1.0:1789518654.667348:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 328 00000100:00100000:1.0:1789518654.667364:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:35906:x1876445617395200:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518654.667388:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518654.667420:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a50 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde3c expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667521:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667535:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667547:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667562:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667567:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667571:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667684:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a65 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667693:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a65 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667699:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a65 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518654.667793:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00000004:00200000:1.0:1789518654.667799:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518654.667818:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a65 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667837:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a65 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667845:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667852:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667858:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667864:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518654.667868:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667875:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667887:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:1.0:1789518654.667890:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518654.667895:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667901:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7000/0x631fd8698c786a57 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667915:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667921:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667933:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667938:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c6a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518654.667941:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667946:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667954:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff99ffc6733900) 00010000:00010000:1.0:1789518654.667956:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518654.667959:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667965:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786a5e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.667996:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786a50 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde3c expref: 46 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.668009:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6800/0x631fd8698c786a65 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde3c expref: 45 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.668016:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:1.0:1789518654.668018:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518654.668021:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6800, rc 0) 00000100:00100000:1.0:1789518654.668084:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:35906:x1876445617395200:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 726us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518654.668100:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 328 00000100:00100000:2.0:1789518654.672020:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.672479:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617395456 00000100:00100000:1.0:1789518654.672489:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617395456 00000100:00100000:1.0:1789518654.672549:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 329 00000100:00100000:1.0:1789518654.672559:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:35906:x1876445617395456:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518654.672577:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518654.672598:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786a6c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde43 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.672740:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786a73 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.672754:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786a73 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.672765:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786a73 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518654.672775:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00010000:00010000:1.0:1789518654.672895:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786a6c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde43 expref: 48 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.672916:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786a73 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde43 expref: 47 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.672923:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:1.0:1789518654.672926:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518654.672929:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1400, rc 0) 00000100:00100000:1.0:1789518654.673002:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35906:x1876445617395456:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 444us (989us total) trans 30064771368 rc 0/0 00000100:00100000:1.0:1789518654.673010:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 329 00000100:00100000:0.0:1789518654.676104:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.676207:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617395712 00000100:00100000:2.0:1789518654.676217:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617395712 00000100:00100000:2.0:1789518654.676264:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 330 00000100:00100000:2.0:1789518654.676273:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35906:x1876445617395712:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518654.676297:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518654.676316:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a81 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde4a expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.676406:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786a88 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.676421:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786a88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.676442:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786a88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518654.676454:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00000100:00100000:1.0:1789518654.676463:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:2.0:1789518654.676569:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786a81 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde4a expref: 50 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.676587:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786a88 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde4a expref: 49 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.676596:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:2.0:1789518654.676598:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518654.676602:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4e00, rc 0) 00000100:00100000:2.0:1789518654.676682:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35906:x1876445617395712:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 409us (584us total) trans 30064771369 rc 0/0 00000100:00100000:2.0:1789518654.676689:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 330 00000100:00100000:0.0:1789518654.676753:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617395840 00000100:00100000:0.0:1789518654.676758:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617395840 00000100:00100000:0.0:1789518654.676800:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1789518654.676807:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:2343:x1876445617395840:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518654.676816:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518654.676829:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786a73 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde43 expref: 49 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.676840:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:0.0:1789518654.676844:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518654.676864:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:2343:x1876445617395840:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 58us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518654.676870:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1789518654.714006:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.714064:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617395968 00000100:00100000:3.0:1789518654.714074:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617395968 00000100:00100000:3.0:1789518654.714133:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518654.714144:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35906:x1876445617395968:12345-192.168.206.51@tcp:103:lfs.500 00010000:00010000:3.0:1789518654.714157:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518654.714179:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786a88 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde4a expref: 48 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518654.714197:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff99ffd1b0c700) 00010000:00010000:3.0:1789518654.714202:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518654.714258:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35906:x1876445617395968:12345-192.168.206.51@tcp:103:lfs.500 Request processed in 116us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518654.714266:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1789518654.716909:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.716992:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617396224 00000100:00100000:1.0:1789518654.717001:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617396224 00000100:00100000:1.0:1789518654.717080:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1789518654.717091:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:35906:x1876445617396224:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:1.0:1789518654.717312:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35906:x1876445617396224:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 222us (409us total) trans 30064771370 rc 0/0 00000100:00100000:1.0:1789518654.717320:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1789518654.735363:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518654.735515:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617396480 00000100:00100000:3.0:1789518654.735529:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617396480 00000100:00100000:3.0:1789518654.735651:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1789518654.735681:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:35906:x1876445617396480:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:2.0:1789518654.736649:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35906:x1876445617396480:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 965us (1303us total) trans 30064771371 rc 0/0 00000100:00100000:2.0:1789518654.736660:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:0.0:1789518654.786539:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.786665:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617396736 00000100:00100000:1.0:1789518654.786679:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617396736 00000100:00100000:1.0:1789518654.786754:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 331 00000100:00100000:1.0:1789518654.786767:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:35916:x1876445617396736:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518654.786804:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518654.786830:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786a96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde51 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518654.786949:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00010000:00010000:1.0:1789518654.787101:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786a96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde51 expref: 51 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.787117:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:1.0:1789518654.787120:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518654.787144:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786a96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde51 expref: 51 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.787162:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1600, rc 0) 00000100:00100000:1.0:1789518654.787241:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:35916:x1876445617396736:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 476us (716us total) trans 30064771372 rc 301/301 00000100:00100000:1.0:1789518654.787249:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 331 00000100:00100000:3.0:1789518654.790370:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.791093:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617396864 00000100:00100000:0.0:1789518654.791105:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617396864 00000100:00100000:0.0:1789518654.791175:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 332 00000100:00100000:0.0:1789518654.791446:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:35916:x1876445617396864:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518654.791549:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791570:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791585:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791604:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791729:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791739:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791851:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791859:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791867:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518654.791927:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791942:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791948:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791955:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.791967:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518654.791973:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792054:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792071:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:0.0:1789518654.792075:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518654.792081:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792088:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786aa4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792104:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792110:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792116:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792121:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518654.792123:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792129:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792141:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff99ffc2d97100) 00010000:00010000:0.0:1789518654.792143:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518654.792146:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792152:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786aab lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792170:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792176:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792181:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792186:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518654.792189:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792195:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792202:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518654.792204:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518654.792207:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.792213:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ab2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.792367:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:35916:x1876445617396864:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1181us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518654.792377:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 332 00000100:00100000:2.0:1789518654.796385:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.796476:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617397120 00000100:00100000:1.0:1789518654.796489:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617397120 00000100:00100000:1.0:1789518654.796593:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518654.796604:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:35916:x1876445617397120:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518654.796945:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:35916:x1876445617397120:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 341us (573us total) trans 30064771373 rc 0/0 00000100:00100000:1.0:1789518654.796954:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:3.0:1789518654.847323:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518654.847827:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617397376 00000100:00100000:2.0:1789518654.847840:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617397376 00000100:00100000:2.0:1789518654.848900:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 333 00000100:00100000:2.0:1789518654.848921:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:35926:x1876445617397376:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518654.848958:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518654.848986:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786ab9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde58 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.849114:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786ac0 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.849269:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786ac0 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.849284:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786ac0 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518654.849303:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 16384 00010000:00010000:2.0:1789518654.849758:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786ab9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde58 expref: 54 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.849785:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5600/0x631fd8698c786ac0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde58 expref: 53 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518654.849795:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:2.0:1789518654.849798:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518654.849802:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5600, rc 0) 00000100:00100000:2.0:1789518654.849890:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:35926:x1876445617397376:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 977us (2579us total) trans 30064771374 rc 0/0 00000100:00100000:2.0:1789518654.849899:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 333 00000100:00100000:2.0:1789518654.888777:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518654.888913:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617397632 00000100:00100000:1.0:1789518654.888925:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617397632 00000100:00100000:1.0:1789518654.889088:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 334 00000100:00100000:1.0:1789518654.889104:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:35932:x1876445617397632:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518654.889140:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518654.889163:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786ace lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde5f expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889236:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889251:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889295:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889308:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889313:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889317:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889460:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786ae3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889470:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786ae3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889486:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786ae3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518654.889497:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:1.0:1789518654.889655:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889664:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889671:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889678:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518654.889690:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889699:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889713:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:1.0:1789518654.889721:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518654.889736:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889747:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ad5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889766:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889772:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889777:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889783:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518654.889786:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889793:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889800:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff99ffc6733900) 00010000:00010000:1.0:1789518654.889803:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518654.889813:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889819:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786adc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889878:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786ace lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde5f expref: 56 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889890:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786ae3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde5f expref: 55 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518654.889895:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518654.889897:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518654.889899:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0e00, rc 0) 00000100:00100000:1.0:1789518654.889965:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:35932:x1876445617397632:12345-192.168.206.51@tcp:101:dd.500 Request processed in 866us (1204us total) trans 30064771375 rc 0/0 00000100:00100000:1.0:1789518654.889973:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 334 00000100:00100000:1.0:1789518654.893333:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518654.893443:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617397888 00000100:00100000:0.0:1789518654.893454:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617397888 00000100:00100000:0.0:1789518654.893550:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 335 00000100:00100000:0.0:1789518654.893561:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:35932:x1876445617397888:12345-192.168.206.51@tcp:36:dd.500 00010000:00010000:0.0:1789518654.893682:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518654.893714:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786ae3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde5f expref: 55 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.893733:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518654.893737:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518654.893967:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.893980:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.893989:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518654.894058:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771376 00000004:00010000:0.0:1789518654.894086:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e3e8adc reply state 00000000ead915f5 transno 30064771377 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518654.894096:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518654.894190:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:35932:x1876445617397888:12345-192.168.206.51@tcp:36:dd.500 Request processed in 631us (871us total) trans 30064771377 rc 0/0 00000100:00100000:0.0:1789518654.894197:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 335 00000020:00080000:0.0:1789518654.894202:0:37723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789518654.895888:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.895907:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.895915:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.895921:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518654.895926:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.895934:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.895949:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518654.895952:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518654.895957:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518654.895963:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786af1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.045563:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.045951:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617398144 00000100:00100000:3.0:1789518655.045965:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617398144 00000100:00100000:3.0:1789518655.046065:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1789518655.046077:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:35932:x1876445617398144:12345-192.168.206.51@tcp:103:dd.500 00010000:00010000:3.0:1789518655.046097:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518655.046130:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786a49 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde35 expref: 56 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.046155:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:3.0:1789518655.046167:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518655.046241:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:35932:x1876445617398144:12345-192.168.206.51@tcp:103:dd.500 Request processed in 166us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518655.046250:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00080000:0.0:1789518655.046386:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518655.048534:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.048658:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617398272 00000100:00100000:2.0:1789518655.048671:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617398272 00000100:00100000:2.0:1789518655.048733:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 336 00000100:00100000:2.0:1789518655.048744:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:35932:x1876445617398272:12345-192.168.206.51@tcp:58:dd.500 00010000:00010000:2.0:1789518655.048883:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.048902:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.048915:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518655.049393:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].9, 136 off9416 00000100:00100000:2.0:1789518655.049500:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:35932:x1876445617398272:12345-192.168.206.51@tcp:58:dd.500 Request processed in 757us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518655.049513:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 336 00000100:00100000:2.0:1789518655.052604:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.052728:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617398400 00000100:00100000:1.0:1789518655.052741:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617398400 00000100:00100000:1.0:1789518655.052848:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 337 00000100:00100000:1.0:1789518655.052860:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:35932:x1876445617398400:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518655.052885:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518655.052911:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786aff lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde66 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.052987:0:35846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.053016:0:35846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786aff lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde66 expref: 56 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.053039:0:35846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.053058:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786aff lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde66 expref: 56 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.053074:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:1.0:1789518655.053077:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518655.053082:0:35846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786aff lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde66 expref: 56 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.053091:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1600, rc 0) 00000100:00100000:1.0:1789518655.053165:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:35932:x1876445617398400:12345-192.168.206.51@tcp:101:dd.500 Request processed in 307us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518655.053173:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 337 00000040:00080000:0.0:1789518655.091025:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518655.091038:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518655.091083:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 10 00000040:00080000:0.0:1789518655.091090:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518655.091255:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc52bdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627662848:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518655.091399:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518655.096741:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.096906:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc52bdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627662848:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518655.097137:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617398528 00000100:00100000:1.0:1789518655.097146:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617398528 00000100:00100000:1.0:1789518655.097809:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 338 00000100:00100000:1.0:1789518655.097822:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:35933:x1876445617398528:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518655.097861:0:37723:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518655.097995:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:35933:x1876445617398528:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 175us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518655.098002:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 338 00000100:00100000:1.0:1789518655.102335:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.102923:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617398656 00000100:00100000:2.0:1789518655.102938:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617398656 00000100:00100000:2.0:1789518655.103095:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 339 00000100:00100000:2.0:1789518655.103108:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:35933:x1876445617398656:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789518655.103182:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103207:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103220:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103238:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103245:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103252:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103669:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103680:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103688:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518655.103725:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 0 00000004:00200000:2.0:1789518655.103729:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518655.103742:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103752:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103758:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103764:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103770:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518655.103774:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103782:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103794:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:2.0:1789518655.103797:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518655.103801:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103811:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786b06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103826:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103832:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103838:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103843:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518655.103846:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103852:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103872:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xcbfe478c (ffff99fec3b12b00) 00010000:00010000:2.0:1789518655.103874:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518655.103877:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103882:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786b0d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103899:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103905:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103910:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103915:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d5200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518655.103918:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103924:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103933:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518655.103935:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518655.103938:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.103944:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786b14 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518655.104040:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:35933:x1876445617398656:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 930us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518655.104052:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 339 00000100:00100000:0.0:1789518655.109525:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.109722:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617398912 00000100:00100000:1.0:1789518655.109735:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617398912 00000100:00100000:1.0:1789518655.109821:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 340 00000100:00100000:1.0:1789518655.109833:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:35933:x1876445617398912:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518655.109859:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518655.109886:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786b1b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde6d expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110012:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110031:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110045:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518655.110059:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 0 00010000:00010000:1.0:1789518655.110204:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110213:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110220:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110227:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518655.110232:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110262:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110276:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:1.0:1789518655.110280:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518655.110286:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110293:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786b22 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110347:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786b1b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde6d expref: 58 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110358:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518655.110360:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518655.110364:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786b1b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde6d expref: 58 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.110375:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1400, rc 0) 00000100:00100000:1.0:1789518655.110462:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:35933:x1876445617398912:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 631us (952us total) trans 30064771378 rc 301/301 00000100:00100000:1.0:1789518655.110471:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 340 00000100:00100000:3.0:1789518655.113310:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.113405:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617399040 00000100:00100000:1.0:1789518655.113416:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617399040 00000100:00100000:1.0:1789518655.113493:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 341 00000100:00100000:1.0:1789518655.113505:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:35933:x1876445617399040:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518655.113571:0:37723:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518655.113707:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:35933:x1876445617399040:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 204us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518655.113715:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 341 00000100:00100000:2.0:1789518655.118229:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.118403:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617399296 00000100:00100000:0.0:1789518655.118413:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617399296 00000100:00100000:0.0:1789518655.118485:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 342 00000100:00100000:0.0:1789518655.118496:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:35933:x1876445617399296:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518655.118516:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518655.118519:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518655.118542:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c7869ee lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde19 expref: 57 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.118563:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:0.0:1789518655.118568:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518655.118597:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786b30 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde74 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518655.119019:0:39157:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc9:0x0], index 1: 0 00010000:00010000:0.0:1789518655.119209:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786b37 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.119234:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786b37 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.119245:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786b37 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.119423:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786b30 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde74 expref: 59 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.119455:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786b37 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde74 expref: 58 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.119464:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99ffc2d97100) 00010000:00010000:0.0:1789518655.119467:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518655.119469:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28dc00, rc 0) 00000100:00100000:0.0:1789518655.119605:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:35933:x1876445617399296:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1109us (1382us total) trans 30064771379 rc 0/0 00000100:00100000:0.0:1789518655.119631:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 342 00000100:00100000:0.0:1789518655.125081:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.125168:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617399552 00000100:00100000:3.0:1789518655.125178:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617399552 00000100:00100000:3.0:1789518655.125321:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 343 00000100:00100000:3.0:1789518655.125333:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:35933:x1876445617399552:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518655.125392:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518655.125418:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786b37 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde74 expref: 58 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.125814:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99ffc2d97100) 00010000:00010000:3.0:1789518655.125825:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518655.125845:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.125858:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.125868:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.125882:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.125888:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.125894:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.125952:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126146:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126154:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126160:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518655.126164:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126179:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126189:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:3.0:1789518655.126192:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518655.126271:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126279:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786b45 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126290:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126296:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126302:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126307:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518655.126310:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126315:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126323:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x15d92120 (ffff99ffd1b0c900) 00010000:00010000:3.0:1789518655.126325:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518655.126328:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.126341:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b4c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x15d92120 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518655.126593:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:35933:x1876445617399552:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1260us (1635us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789518655.126601:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 343 00000100:00100000:3.0:1789518655.128342:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.128520:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617399680 00000100:00100000:2.0:1789518655.128534:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617399680 00000100:00100000:2.0:1789518655.128585:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 344 00000100:00100000:2.0:1789518655.128593:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:35933:x1876445617399680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518655.128611:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518655.128664:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786b53 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde7b expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.128699:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.128712:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.128722:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.128816:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786b53 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde7b expref: 59 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.128830:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde7b expref: 58 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.128839:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:2.0:1789518655.128842:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518655.128845:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c600, rc 0) 00000100:00100000:2.0:1789518655.128900:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:35933:x1876445617399680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 306us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518655.128911:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 344 00000100:00100000:2.0:1789518655.131956:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.132539:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617399936 00000100:00100000:0.0:1789518655.132548:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617399936 00000100:00100000:0.0:1789518655.132916:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 345 00000100:00100000:0.0:1789518655.132927:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:35933:x1876445617399936:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518655.133021:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.133036:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.133046:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518655.133372:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].12, 88 off9152 00000004:00010000:0.0:1789518655.133469:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b70cd10 reply state 00000000c0853659 transno 30064771380 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518655.133479:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518655.133582:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:35933:x1876445617399936:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 656us (1639us total) trans 30064771380 rc 0/0 00000100:00100000:0.0:1789518655.133589:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 345 00010000:00010000:1.0:1789518655.135257:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.135270:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.135278:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.135284:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518655.135289:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.135297:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.135312:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:1.0:1789518655.135314:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518655.135319:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.135325:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786b61 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518655.138551:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.139014:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617400064 00000100:00100000:3.0:1789518655.139142:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617400064 00000100:00100000:3.0:1789518655.139201:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 346 00000100:00100000:3.0:1789518655.139211:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:35933:x1876445617400064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518655.139234:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518655.139253:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde82 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.139363:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde82 expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.139379:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde82 expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.139400:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:3.0:1789518655.139404:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518655.139407:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:3.0:1789518655.139596:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:35933:x1876445617400064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 376us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518655.139650:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 346 00000100:00100000:0.0:1789518655.142318:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.142379:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617400192 00000100:00100000:2.0:1789518655.142389:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617400192 00000100:00100000:2.0:1789518655.142454:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:2.0:1789518655.142463:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2344:x1876445617400192:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789518655.142850:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2344:x1876445617400192:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 386us (538us total) trans 30064771197 rc 0/0 00000100:00100000:2.0:1789518655.142858:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:2.0:1789518655.145452:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.145762:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617400448 00000100:00100000:3.0:1789518655.145772:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617400448 00000100:00100000:3.0:1789518655.145828:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1789518655.145838:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:35933:x1876445617400448:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789518655.146723:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:35933:x1876445617400448:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 882us (1273us total) trans 30064771381 rc 0/0 00000100:00100000:3.0:1789518655.146733:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1789518655.149765:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.149890:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617400704 00000100:00100000:2.0:1789518655.149899:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617400704 00000100:00100000:2.0:1789518655.150011:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 347 00000100:00100000:2.0:1789518655.150021:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:35933:x1876445617400704:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518655.150297:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:35933:x1876445617400704:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 277us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518655.150305:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 347 00000100:00100000:0.0:1789518655.153865:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.154098:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617400832 00000100:00100000:2.0:1789518655.154107:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617400832 00000100:00100000:2.0:1789518655.154232:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 348 00000100:00100000:2.0:1789518655.154243:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:35933:x1876445617400832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518655.154262:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518655.154292:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786b6f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde89 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.154373:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c786b76 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.154387:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c786b76 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.154396:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c786b76 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518655.154439:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518655.154456:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c786b76 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.154479:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786b6f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde89 expref: 63 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.154497:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c786b76 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde89 expref: 62 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.154505:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:2.0:1789518655.154508:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518655.154511:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c000, rc 0) 00000100:00100000:2.0:1789518655.154574:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:35933:x1876445617400832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 333us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518655.154580:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 348 00000100:00100000:3.0:1789518655.159903:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.159976:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617400960 00000100:00100000:0.0:1789518655.159993:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617400960 00000100:00100000:0.0:1789518655.160047:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:0.0:1789518655.160057:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2343:x1876445617400960:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518655.160074:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518655.160093:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde90 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518655.160395:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e33f, blocks: 0x1 00010000:00010000:0.0:1789518655.160419:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1789518655.160424:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518655.160444:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde90 expref: 42 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.160524:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde90 expref: 42 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.160537:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28da00, rc 0) 00000100:00100000:0.0:1789518655.161604:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617400960:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1544us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518655.161626:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:3.0:1789518655.165519:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.166914:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617401216 00000100:00100000:2.0:1789518655.166926:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617401216 00000100:00100000:2.0:1789518655.166979:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 349 00000100:00100000:2.0:1789518655.166985:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:35933:x1876445617401216:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789518655.167071:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:35933:x1876445617401216:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 87us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518655.167076:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 349 00000100:00100000:3.0:1789518655.172547:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.172704:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617401344 00000100:00100000:0.0:1789518655.172714:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617401344 00000100:00100000:0.0:1789518655.172773:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:0.0:1789518655.172784:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:35933:x1876445617401344:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518655.172800:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518655.172818:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde97 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.172849:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde90 expref: 43 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.172858:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518655.172863:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518655.172868:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 43 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.172898:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde90 expref: 43 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.172910:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde90 expref: 43 pid: 37973 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518655.172922:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffffe58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627662976:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518655.173001:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518655.175371:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.175449:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617401472 00000100:00100000:1.0:1789518655.175458:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617401472 00010000:00010000:1.0:1789518655.175494:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde90 expref: 44 pid: 37973 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.175551:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:1.0:1789518655.175560:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2342:x1876445617401472:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518655.175574:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518655.175595:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde90 expref: 44 pid: 37973 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.175609:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde90 expref: 44 pid: 37973 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.175671:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518655.175677:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518655.175686:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 44 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.175696:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 44 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.175729:0:35832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 44 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.175742:0:35832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff6909880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35832:1876445627663104:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518655.175818:0:35832:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518655.177116:0:35832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff6909880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35832:1876445627663104:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518655.177145:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518655.177183:0:36531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba6beeb8/0x631fd8698c786b7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde90 expref: 44 pid: 37973 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.177192:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2342:x1876445617401472:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 1630us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518655.177204:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffffe58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627662976:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518655.177224:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 43 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.177235:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d600, rc 0) 00000100:00100000:0.0:1789518655.177260:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:35933:x1876445617401344:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 4478us (4721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518655.177269:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:1.0:1789518655.177438:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:2.0:1789518655.195850:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.196095:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617401600 00000100:00100000:0.0:1789518655.196105:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617401600 00002000:00100000:0.0:1789518655.196164:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (0->1048575) req@ffff99ffed933800 x1876445617401600/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.196175:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed933800 with x1876445617401600 ext(0->1048575) 00002000:00010000:0.0:1789518655.196181:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed933800 00000100:00100000:0.0:1789518655.196216:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:0.0:1789518655.196224:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617401600:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518655.213561:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2343:x1876445617401600:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 17326us (17709us total) trans 30064771198 rc 0/0 00000100:00100000:0.0:1789518655.213574:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 201 00002000:00100000:0.0:1789518655.213586:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (0->1048575) req@ffff99ffed933800 x1876445617401600/t30064771198(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.213597:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed933800 with x1876445617401600 ext(0->1048575) 00002000:00010000:0.0:1789518655.213604:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed933800 00000100:00100000:2.0:1789518655.216518:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.217211:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617401728 00000100:00100000:1.0:1789518655.217221:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617401728 00002000:00100000:1.0:1789518655.217266:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (1048576->2097151) req@ffff99ffed931180 x1876445617401728/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.217277:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931180 with x1876445617401728 ext(1048576->2097151) 00002000:00010000:1.0:1789518655.217282:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed931180 00000100:00100000:1.0:1789518655.217310:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 202 00000100:00100000:1.0:1789518655.217320:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2343:x1876445617401728:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518655.237630:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2343:x1876445617401728:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 20284us (21093us total) trans 30064771199 rc 0/0 00000100:00100000:1.0:1789518655.237644:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 202 00002000:00100000:1.0:1789518655.237656:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (1048576->2097151) req@ffff99ffed931180 x1876445617401728/t30064771199(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.237667:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931180 with x1876445617401728 ext(1048576->2097151) 00002000:00010000:1.0:1789518655.237674:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed931180 00000100:00100000:3.0:1789518655.243747:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.243816:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617401856 00000100:00100000:2.0:1789518655.243826:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617401856 00002000:00100000:2.0:1789518655.243870:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (2097152->3145727) req@ffff99ffd03d9c00 x1876445617401856/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518655.243881:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d9c00 with x1876445617401856 ext(2097152->3145727) 00002000:00010000:2.0:1789518655.243886:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd03d9c00 00000100:00100000:2.0:1789518655.243920:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:2.0:1789518655.243929:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2344:x1876445617401856:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789518655.253957:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:2344:x1876445617401856:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 10019us (10209us total) trans 30064771200 rc 0/0 00000100:00100000:3.0:1789518655.253976:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 203 00002000:00100000:3.0:1789518655.254394:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (2097152->3145727) req@ffff99ffd03d9c00 x1876445617401856/t30064771200(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518655.254407:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d9c00 with x1876445617401856 ext(2097152->3145727) 00002000:00010000:3.0:1789518655.254413:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd03d9c00 00000100:00100000:0.0:1789518655.258467:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.258540:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617401984 00000100:00100000:1.0:1789518655.258549:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617401984 00002000:00100000:1.0:1789518655.258596:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (3145728->4194303) req@ffff99ffffe58000 x1876445617401984/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.258608:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58000 with x1876445617401984 ext(3145728->4194303) 00002000:00010000:1.0:1789518655.258652:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffffe58000 00000100:00100000:1.0:1789518655.258685:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:1.0:1789518655.258695:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:2342:x1876445617401984:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518655.268038:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:2342:x1876445617401984:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9335us (9570us total) trans 30064771201 rc 0/0 00000100:00100000:0.0:1789518655.268051:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 204 00002000:00100000:0.0:1789518655.268062:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (3145728->4194303) req@ffff99ffffe58000 x1876445617401984/t30064771201(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.268072:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58000 with x1876445617401984 ext(3145728->4194303) 00002000:00010000:0.0:1789518655.268078:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffffe58000 00000100:00100000:1.0:1789518655.278947:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.279033:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617402112 00000100:00100000:3.0:1789518655.279043:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617402112 00002000:00100000:3.0:1789518655.279086:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (4194304->5242879) req@ffff99fff6909880 x1876445617402112/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518655.279110:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff6909880 with x1876445617402112 ext(4194304->5242879) 00002000:00010000:3.0:1789518655.279116:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff6909880 00000100:00100000:3.0:1789518655.279141:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:3.0:1789518655.279147:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:2342:x1876445617402112:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789518655.284762:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:2342:x1876445617402112:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 5604us (5814us total) trans 30064771202 rc 0/0 00000100:00100000:3.0:1789518655.284775:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 205 00002000:00100000:3.0:1789518655.284787:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (4194304->5242879) req@ffff99fff6909880 x1876445617402112/t30064771202(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518655.284797:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff6909880 with x1876445617402112 ext(4194304->5242879) 00002000:00010000:3.0:1789518655.284804:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff6909880 00000100:00100000:1.0:1789518655.297530:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.297733:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617402240 00000100:00100000:3.0:1789518655.297742:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617402240 00002000:00100000:2.0:1789518655.298194:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (5242880->6291455) req@ffff99fff4b1d180 x1876445617402240/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518655.298204:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1d180 with x1876445617402240 ext(5242880->6291455) 00002000:00010000:2.0:1789518655.298210:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1d180 00000100:00100000:2.0:1789518655.298465:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 206 00000100:00100000:2.0:1789518655.298476:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:2343:x1876445617402240:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518655.311440:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.311563:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617402368 00000100:00100000:0.0:1789518655.311574:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617402368 00002000:00100000:0.0:1789518655.312154:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (6291456->7340031) req@ffff99fec81b5f80 x1876445617402368/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.312165:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b5f80 with x1876445617402368 ext(6291456->7340031) 00002000:00010000:0.0:1789518655.312171:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b5f80 00000100:00100000:0.0:1789518655.312386:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:0.0:1789518655.312395:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2344:x1876445617402368:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518655.312469:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:2343:x1876445617402240:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 13994us (14946us total) trans 30064771203 rc 0/0 00000100:00100000:1.0:1789518655.312476:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 206 00002000:00100000:1.0:1789518655.312483:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (5242880->6291455) req@ffff99fff4b1d180 x1876445617402240/t30064771203(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.312491:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1d180 with x1876445617402240 ext(5242880->6291455) 00002000:00010000:1.0:1789518655.312494:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff4b1d180 00000100:00100000:0.0:1789518655.319480:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2344:x1876445617402368:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7075us (8049us total) trans 30064771204 rc 0/0 00000100:00100000:0.0:1789518655.319494:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 207 00002000:00100000:0.0:1789518655.319506:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (6291456->7340031) req@ffff99fec81b5f80 x1876445617402368/t30064771204(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.319534:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec81b5f80 with x1876445617402368 ext(6291456->7340031) 00002000:00010000:0.0:1789518655.319540:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec81b5f80 00000100:00100000:3.0:1789518655.320466:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.320990:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617402496 00000100:00100000:1.0:1789518655.320999:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617402496 00002000:00100000:1.0:1789518655.321039:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (7340032->8388607) req@ffff99ffd03db800 x1876445617402496/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.321049:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03db800 with x1876445617402496 ext(7340032->8388607) 00002000:00010000:1.0:1789518655.321055:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd03db800 00000100:00100000:1.0:1789518655.321122:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 208 00000100:00100000:1.0:1789518655.321132:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617402496:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518655.328982:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2345:x1876445617402496:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 7841us (8508us total) trans 30064771205 rc 0/0 00000100:00100000:1.0:1789518655.328994:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 208 00002000:00100000:1.0:1789518655.329020:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (7340032->8388607) req@ffff99ffd03db800 x1876445617402496/t30064771205(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.329030:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03db800 with x1876445617402496 ext(7340032->8388607) 00002000:00010000:1.0:1789518655.329036:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd03db800 00000100:00100000:2.0:1789518655.339557:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.339739:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617402624 00000100:00100000:1.0:1789518655.339748:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617402624 00002000:00100000:1.0:1789518655.339792:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (8388608->9437183) req@ffff99fecb2a4000 x1876445617402624/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.339804:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a4000 with x1876445617402624 ext(8388608->9437183) 00002000:00010000:1.0:1789518655.339809:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a4000 00000100:00100000:1.0:1789518655.339875:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:1.0:1789518655.339889:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2345:x1876445617402624:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00010000:00010000:2.0:1789518655.347378:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518655.350564:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.350672:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617402752 00000100:00100000:0.0:1789518655.350687:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617402752 00002000:00100000:0.0:1789518655.350738:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (9437184->10485759) req@ffff99fecb0e9180 x1876445617402752/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.350750:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e9180 with x1876445617402752 ext(9437184->10485759) 00002000:00010000:0.0:1789518655.350756:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e9180 00000100:00100000:0.0:1789518655.350799:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:0.0:1789518655.350810:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:2342:x1876445617402752:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518655.352311:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:2345:x1876445617402624:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 12417us (12755us total) trans 30064771206 rc 0/0 00000100:00100000:0.0:1789518655.352321:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 209 00002000:00100000:0.0:1789518655.352332:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (8388608->9437183) req@ffff99fecb2a4000 x1876445617402624/t30064771206(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.352341:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a4000 with x1876445617402624 ext(8388608->9437183) 00002000:00010000:0.0:1789518655.352346:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a4000 00000100:00100000:0.0:1789518655.359916:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:2342:x1876445617402752:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9099us (9356us total) trans 30064771207 rc 0/0 00000100:00100000:0.0:1789518655.359929:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 210 00002000:00100000:0.0:1789518655.359942:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (9437184->10485759) req@ffff99fecb0e9180 x1876445617402752/t30064771207(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.359959:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e9180 with x1876445617402752 ext(9437184->10485759) 00002000:00010000:0.0:1789518655.359965:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e9180 00000100:00100000:2.0:1789518655.364701:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.364963:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617402880 00000100:00100000:1.0:1789518655.364972:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617402880 00002000:00100000:1.0:1789518655.365023:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (10485760->11534335) req@ffff99fecb2a5880 x1876445617402880/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.365034:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a5880 with x1876445617402880 ext(10485760->11534335) 00002000:00010000:1.0:1789518655.365040:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a5880 00000100:00100000:1.0:1789518655.365071:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:1.0:1789518655.365080:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:2343:x1876445617402880:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789518655.383860:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.385212:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617403008 00000100:00100000:1.0:1789518655.385224:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617403008 00002000:00100000:1.0:1789518655.385272:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (11534336->12582911) req@ffff99fecb0e8700 x1876445617403008/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.385306:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8700 with x1876445617403008 ext(11534336->12582911) 00002000:00010000:1.0:1789518655.385313:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e8700 00000100:00100000:1.0:1789518655.385338:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 212 00000100:00100000:1.0:1789518655.385348:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:2342:x1876445617403008:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518655.387648:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:2343:x1876445617402880:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 22561us (22948us total) trans 30064771208 rc 0/0 00000100:00100000:1.0:1789518655.387660:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 211 00002000:00100000:1.0:1789518655.387671:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (10485760->11534335) req@ffff99fecb2a5880 x1876445617402880/t30064771208(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.387682:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a5880 with x1876445617402880 ext(10485760->11534335) 00002000:00010000:1.0:1789518655.387688:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a5880 00000100:00100000:3.0:1789518655.396465:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.401426:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617403136 00000100:00100000:0.0:1789518655.401448:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617403136 00002000:00100000:0.0:1789518655.401500:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (12582912->13631487) req@ffff99fecb0e8e00 x1876445617403136/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.401512:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8e00 with x1876445617403136 ext(12582912->13631487) 00002000:00010000:0.0:1789518655.401518:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e8e00 00000100:00100000:0.0:1789518655.401559:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:0.0:1789518655.401569:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:2343:x1876445617403136:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518655.405194:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:2342:x1876445617403008:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 19837us (21332us total) trans 30064771209 rc 0/0 00000100:00100000:0.0:1789518655.405206:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 212 00002000:00100000:0.0:1789518655.405218:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (11534336->12582911) req@ffff99fecb0e8700 x1876445617403008/t30064771209(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.405227:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8700 with x1876445617403008 ext(11534336->12582911) 00002000:00010000:0.0:1789518655.405234:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e8700 00000100:00100000:0.0:1789518655.413412:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:2343:x1876445617403136:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 11834us (16946us total) trans 30064771210 rc 0/0 00000100:00100000:0.0:1789518655.413425:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 213 00002000:00100000:0.0:1789518655.413446:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (12582912->13631487) req@ffff99fecb0e8e00 x1876445617403136/t30064771210(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.413463:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8e00 with x1876445617403136 ext(12582912->13631487) 00002000:00010000:0.0:1789518655.413470:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e8e00 00000100:00100000:2.0:1789518655.418100:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.418190:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617403264 00000100:00100000:0.0:1789518655.418200:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617403264 00002000:00100000:0.0:1789518655.418249:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (13631488->14680063) req@ffff99fecb2a6a00 x1876445617403264/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.418326:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a6a00 with x1876445617403264 ext(13631488->14680063) 00002000:00010000:0.0:1789518655.418333:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a6a00 00000100:00100000:0.0:1789518655.418419:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 214 00000100:00100000:0.0:1789518655.418439:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:2342:x1876445617403264:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518655.427750:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:2342:x1876445617403264:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 9313us (9650us total) trans 30064771211 rc 0/0 00000100:00100000:0.0:1789518655.427763:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 214 00002000:00100000:0.0:1789518655.427775:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (13631488->14680063) req@ffff99fecb2a6a00 x1876445617403264/t30064771211(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.427785:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a6a00 with x1876445617403264 ext(13631488->14680063) 00002000:00010000:0.0:1789518655.427791:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a6a00 00000100:00100000:3.0:1789518655.433785:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.433972:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617403392 00000100:00100000:1.0:1789518655.433982:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617403392 00002000:00100000:1.0:1789518655.434087:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (14680064->15728639) req@ffff99fecb0e9500 x1876445617403392/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.434100:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e9500 with x1876445617403392 ext(14680064->15728639) 00002000:00010000:1.0:1789518655.434105:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e9500 00000100:00100000:1.0:1789518655.434139:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:1.0:1789518655.434149:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:2343:x1876445617403392:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518655.447311:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:2343:x1876445617403392:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 13154us (13525us total) trans 30064771212 rc 0/0 00000100:00100000:1.0:1789518655.447325:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 215 00002000:00100000:1.0:1789518655.447352:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (14680064->15728639) req@ffff99fecb0e9500 x1876445617403392/t30064771212(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518655.447363:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e9500 with x1876445617403392 ext(14680064->15728639) 00002000:00010000:1.0:1789518655.447370:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e9500 00000100:00100000:3.0:1789518655.448109:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.448257:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617403520 00000100:00100000:0.0:1789518655.448265:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617403520 00002000:00100000:0.0:1789518655.448301:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (15728640->16777215) req@ffff99fecb0ea300 x1876445617403520/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.448310:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0ea300 with x1876445617403520 ext(15728640->16777215) 00002000:00010000:0.0:1789518655.448315:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0ea300 00000100:00100000:0.0:1789518655.448344:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 216 00000100:00100000:0.0:1789518655.448353:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:2344:x1876445617403520:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518655.456587:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:2344:x1876445617403520:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 8226us (8471us total) trans 30064771213 rc 0/0 00000100:00100000:0.0:1789518655.456600:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 216 00002000:00100000:0.0:1789518655.456630:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (15728640->16777215) req@ffff99fecb0ea300 x1876445617403520/t30064771213(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.456641:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0ea300 with x1876445617403520 ext(15728640->16777215) 00002000:00010000:0.0:1789518655.456648:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0ea300 00000100:00100000:1.0:1789518655.463747:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.466276:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617403648 00000100:00100000:0.0:1789518655.466289:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617403648 00002000:00100000:0.0:1789518655.466346:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (16777216->17825791) req@ffff99fec1ec4000 x1876445617403648/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.466357:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec4000 with x1876445617403648 ext(16777216->17825791) 00002000:00010000:0.0:1789518655.466364:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1ec4000 00000100:00100000:0.0:1789518655.466463:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:0.0:1789518655.466473:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:2342:x1876445617403648:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518655.475989:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.477088:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617403776 00000100:00100000:3.0:1789518655.477106:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617403776 00002000:00100000:3.0:1789518655.477171:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (17825792->18874367) req@ffff99fecb2a5c00 x1876445617403776/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518655.477185:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a5c00 with x1876445617403776 ext(17825792->18874367) 00002000:00010000:3.0:1789518655.477203:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a5c00 00000100:00100000:3.0:1789518655.477247:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 218 00000100:00100000:3.0:1789518655.477259:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:2342:x1876445617403776:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518655.479538:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:2342:x1876445617403648:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 13056us (15790us total) trans 30064771214 rc 0/0 00000100:00100000:0.0:1789518655.479552:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 217 00002000:00100000:0.0:1789518655.479565:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (16777216->17825791) req@ffff99fec1ec4000 x1876445617403648/t30064771214(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.479582:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec4000 with x1876445617403648 ext(16777216->17825791) 00002000:00010000:0.0:1789518655.479588:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1ec4000 00000100:00100000:1.0:1789518655.490102:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.490169:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617403904 00000100:00100000:0.0:1789518655.490181:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617403904 00002000:00100000:0.0:1789518655.490237:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (18874368->19922943) req@ffff99fec1ec6a00 x1876445617403904/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.490249:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec6a00 with x1876445617403904 ext(18874368->19922943) 00002000:00010000:0.0:1789518655.490256:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1ec6a00 00000100:00100000:0.0:1789518655.490289:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:0.0:1789518655.490298:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:2345:x1876445617403904:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518655.495887:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+80:2342:x1876445617403776:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 18614us (19890us total) trans 30064771215 rc 0/0 00000100:00100000:2.0:1789518655.495906:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 218 00002000:00100000:2.0:1789518655.495921:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (17825792->18874367) req@ffff99fecb2a5c00 x1876445617403776/t30064771215(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518655.495933:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a5c00 with x1876445617403776 ext(17825792->18874367) 00002000:00010000:2.0:1789518655.495943:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a5c00 00000100:00100000:0.0:1789518655.504571:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.504647:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617404032 00000100:00100000:0.0:1789518655.504659:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617404032 00002000:00100000:0.0:1789518655.504717:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (19922944->20971519) req@ffff99fec9670e00 x1876445617404032/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518655.504730:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9670e00 with x1876445617404032 ext(19922944->20971519) 00002000:00010000:0.0:1789518655.504737:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9670e00 00000100:00100000:0.0:1789518655.504768:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:0.0:1789518655.504778:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+80:2345:x1876445617404032:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789518655.519912:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+82:2345:x1876445617403904:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 29272us (29482us total) trans 30064771216 rc 0/0 00000100:00100000:2.0:1789518655.519928:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 219 00002000:00100000:2.0:1789518655.519946:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (18874368->19922943) req@ffff99fec1ec6a00 x1876445617403904/t30064771216(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518655.519957:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec6a00 with x1876445617403904 ext(18874368->19922943) 00002000:00010000:2.0:1789518655.519965:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1ec6a00 00000100:00100000:2.0:1789518655.525743:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+82:2345:x1876445617404032:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 20951us (21171us total) trans 30064771217 rc 0/0 00000100:00100000:2.0:1789518655.525759:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 220 00002000:00100000:2.0:1789518655.525777:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (19922944->20971519) req@ffff99fec9670e00 x1876445617404032/t30064771217(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518655.525788:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9670e00 with x1876445617404032 ext(19922944->20971519) 00002000:00010000:2.0:1789518655.525797:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9670e00 00000100:00100000:0.0:1789518655.527474:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.527686:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617404160 00000100:00100000:2.0:1789518655.527698:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617404160 00000100:00100000:2.0:1789518655.527752:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 350 00000100:00100000:2.0:1789518655.527760:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:35933:x1876445617404160:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789518655.572770:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:35933:x1876445617404160:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 45000us (45300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518655.572782:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 350 00000001:00080000:3.0:1789518655.572880:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771380 is committed 00000004:00080000:3.0:1789518655.572906:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1789518655.572923:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803902 batchid updated 00000020:00080000:1.0:1789518655.572944:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00000020:00080000:3.0:1789518655.572952:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fec846d840 refcount 2 committed 0 result 0 batchid 25769803903 00000020:00080000:1.0:1789518655.572956:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00000020:00080000:3.0:1789518655.572957:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fffc2fd300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fec846d540 00000020:00080000:3.0:1789518655.572963:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fffc2fd400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec828c000 00000020:00080000:1.0:1789518655.572993:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803903 committed batchid 25769803902 00000004:00080000:3.0:1789518655.573010:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000001:00080000:3.0:1789518655.573022:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771381 is committed 00000100:00100000:3.0:1789518655.573134:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627663232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789518655.573185:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789518655.573192:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00000100:00100000:3.0:1789518655.573424:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627663232 00000100:00100000:3.0:1789518655.573441:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627663232 00000100:00100000:1.0:1789518655.573712:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627663360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518655.573740:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518655.578664:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627663360 00000100:00100000:3.0:1789518655.578740:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627663360 00000100:00100000:2.0:1789518655.578787:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789518655.578800:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627663232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789518655.578977:0:36735:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:2.0:1789518655.578981:0:36735:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb mtime from disk: 1789518655 -> 1789518655 00002000:00010000:2.0:1789518655.578983:0:36735:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518655.578986:0:36735:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb ctime from disk: 1789518655 -> 1789518655 00002000:00010000:2.0:1789518655.578988:0:36735:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789518655.579117:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789518655.579126:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627663360:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1789518655.579291:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff78d9c00/2, rc 0, transno 30064771218 00000100:00100000:0.0:1789518655.579303:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627663360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518655.579329:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627663360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (5586us total) trans 30064771218 rc 0/0 00000100:00100000:3.0:1789518655.579337:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789518655.579571:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3281:x1876445627663232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 774us (6385us total) trans 30064771165 rc 0/0 00000100:00100000:2.0:1789518655.579578:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000004:00080000:1.0:1789518655.579761:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fecb0e8380/2, rc 0, transno 30064771165 00000100:00100000:1.0:1789518655.579768:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627663232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789518655.581404:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.581835:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617404288 00000100:00100000:0.0:1789518655.581845:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617404288 00000100:00100000:0.0:1789518655.581892:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:0.0:1789518655.581901:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+82:2342:x1876445617404288:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789518655.604112:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627663488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518655.604199:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518655.604286:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627663488 00000100:00100000:3.0:1789518655.604295:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627663488 00000100:00100000:3.0:1789518655.604729:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518655.604740:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3283:x1876445627663488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518655.604765:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 178847744 pending 25559040 free 3812622336 avail 3810525184 00000100:00100000:3.0:1789518655.604814:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3283:x1876445627663488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518655.604821:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789518655.604875:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627663488:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789518655.686644:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771216 is committed 00000001:00080000:2.0:1789518655.686734:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771217 is committed 00000001:00080000:2.0:1789518655.686745:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771196 is committed 00000001:00080000:2.0:1789518655.686774:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771218 is committed 00000100:00100000:0.0:1789518655.687146:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617404288:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 105172us (105674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518655.687160:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:3.0:1789518655.714407:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.714491:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617404544 00000100:00100000:2.0:1789518655.714501:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617404544 00000100:00100000:2.0:1789518655.714611:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 351 00000100:00100000:2.0:1789518655.714657:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:35933:x1876445617404544:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789518655.714705:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518655.714730:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c786b76 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde89 expref: 30 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.714747:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:2.0:1789518655.714753:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518655.714780:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.714794:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.714803:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518655.714948:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004eb30308 reply state 00000000d35514c6 transno 30064771382 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518655.714957:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518655.715049:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:35933:x1876445617404544:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 395us (651us total) trans 30064771382 rc 0/0 00000100:00100000:2.0:1789518655.715057:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 351 00010000:00010000:0.0:1789518655.717485:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.717500:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.717508:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.717515:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14ce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518655.717519:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.717527:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.717542:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:0.0:1789518655.717545:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518655.717549:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.717559:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c786b8b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518655.718776:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.718846:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617404672 00000100:00100000:2.0:1789518655.718857:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617404672 00000100:00100000:2.0:1789518655.718924:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:2.0:1789518655.718934:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617404672:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789518655.719178:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:2.0:1789518655.719182:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb mtime from disk: 0 -> 1789518655 00002000:00010000:2.0:1789518655.719185:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb atime from disk: 0 -> 1789518655 00002000:00010000:2.0:1789518655.719188:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb ctime from disk: 1789518655 -> 1789518655 00002000:00010000:2.0:1789518655.719190:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 40967 00000100:00100000:2.0:1789518655.719322:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617404672:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 388us (557us total) trans 30064771219 rc 0/0 00000100:00100000:2.0:1789518655.719331:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:2.0:1789518655.720846:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.720916:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617404928 00000100:00100000:3.0:1789518655.720923:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617404928 00000100:00100000:3.0:1789518655.720975:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 352 00000100:00100000:3.0:1789518655.720984:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:35933:x1876445617404928:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789518655.721041:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.721058:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde7b expref: 30 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.721068:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.721113:0:35847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde7b expref: 30 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.721127:0:35847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde7b expref: 30 pid: 35845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518655.721157:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627663616:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518655.721247:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff406e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789518655.723555:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627663616:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518655.723581:0:35847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518655.724174:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.724363:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617405056 00000100:00100000:1.0:1789518655.724371:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617405056 00010000:00010000:1.0:1789518655.724412:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde7b expref: 31 pid: 35845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.724456:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:1.0:1789518655.724466:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2343:x1876445617405056:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518655.724479:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518655.724485:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde7b expref: 31 pid: 35845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.724503:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde7b expref: 31 pid: 35845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.724539:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c786b5a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde7b expref: 31 pid: 35845 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.724555:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:1.0:1789518655.724559:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.724568:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.724576:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.724609:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518655.724687:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2343:x1876445617405056:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 222us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518655.724696:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00010000:00010000:3.0:1789518655.724706:0:35847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.724714:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.724742:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.724749:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.724756:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.724762:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518655.724767:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.724774:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.724783:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:3.0:1789518655.724793:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789518655.724798:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.724804:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17200/0x631fd8698c786b92 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518655.724845:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35933:x1876445617404928:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 3861us (4004us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789518655.724853:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 352 00000100:00100000:3.0:1789518655.726591:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.726744:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617405184 00000100:00100000:2.0:1789518655.726751:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617405184 00000100:00100000:2.0:1789518655.726799:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:2.0:1789518655.726808:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2345:x1876445617405184:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789518655.726846:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.726869:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 11 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.726878:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518655.726883:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518655.726887:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.726919:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 11 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.726932:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 11 pid: 36531 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518655.726945:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:36532:1876445627663744:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518655.727799:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf840 going to sleep for 11 seconds 00000100:00100000:1.0:1789518655.732858:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:36532:1876445627663744:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518655.732886:0:36532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518655.756779:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.757485:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617405312 00000100:00100000:1.0:1789518655.757495:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617405312 00010000:00010000:1.0:1789518655.757533:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 12 pid: 36531 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.757580:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1789518655.757601:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2343:x1876445617405312:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518655.757633:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518655.757656:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 12 pid: 36531 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.757671:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 12 pid: 36531 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.757692:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c28065d/0x631fd8698c786b84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde97 expref: 12 pid: 36531 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.757707:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518655.757711:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518655.757717:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.757727:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.757765:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518655.757823:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617405312:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 222us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518655.757831:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00010000:00010000:2.0:1789518655.758049:0:36532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.758060:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.758083:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.758098:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.758107:0:36532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.758114:0:36532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518655.758118:0:36532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.758127:0:36532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.758139:0:36532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.758146:0:36532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb277711/0x631fd8698c786b99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518655.758186:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617405184:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 31379us (31601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518655.758193:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:2.0:1789518655.760774:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.760860:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617405568 00000100:00100000:0.0:1789518655.760868:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617405568 00000100:00100000:0.0:1789518655.760926:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 353 00000100:00100000:0.0:1789518655.760936:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:35933:x1876445617405568:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518655.761009:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.761026:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.761037:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.761275:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.761287:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde82 expref: 30 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.761295:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.761342:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde82 expref: 30 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.761355:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde82 expref: 30 pid: 35847 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518655.761369:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627663872:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518655.761464:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4c413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518655.763870:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.763997:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627663872:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518655.764024:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.764057:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617405696 00000100:00100000:1.0:1789518655.764065:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617405696 00010000:00010000:1.0:1789518655.764100:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde82 expref: 31 pid: 35847 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.764161:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1789518655.764171:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2343:x1876445617405696:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518655.764186:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518655.764193:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde82 expref: 31 pid: 35847 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.764204:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde82 expref: 31 pid: 35847 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.764226:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786b68 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde82 expref: 31 pid: 35847 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.764240:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:1.0:1789518655.764244:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.764262:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.764269:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.764298:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518655.764320:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.764327:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.764347:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2343:x1876445617405696:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 177us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518655.764355:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000001:00080000:2.0:1789518655.764545:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771383 00000001:00080000:2.0:1789518655.764722:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771384 00000001:00080000:2.0:1789518655.764768:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771385 00000100:00100000:2.0:1789518655.764842:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35845:1876445627664000:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789518655.764887:0:35845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518655.764923:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc687bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518655.764970:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627664000 00000100:00100000:1.0:1789518655.764983:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627664000 00000100:00100000:1.0:1789518655.765019:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789518655.765026:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35845:x1876445627664000:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789518655.765100:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35845:x1876445627664000:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518655.765107:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789518655.765152:0:35845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771218 gen 2 00000004:00080000:0.0:1789518655.765158:0:35845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771196 committed transno 30064771218 00000004:00080000:0.0:1789518655.765176:0:35845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff78d9c00, transno 30064771218 00000100:00100000:0.0:1789518655.765198:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35845:1876445627664000:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789518655.765830:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771386 00000100:00100000:0.0:1789518655.765886:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35845:1876445627664128:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789518655.765926:0:35845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518655.765948:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4c41480 going to sleep for 11 seconds 00000100:00100000:3.0:1789518655.766072:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627664128 00000100:00100000:3.0:1789518655.766078:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627664128 00000100:00100000:3.0:1789518655.766122:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789518655.766131:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35845:x1876445627664128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789518655.766333:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35845:x1876445627664128:12345-0@lo:1000:mdt00_000.0 Request processed in 203us (405us total) trans 30064771220 rc 0/0 00000100:00100000:3.0:1789518655.766340:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789518655.767929:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35845:1876445627664128:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789518655.767975:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.767985:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.767993:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.767999:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518655.768003:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768011:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768026:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:0.0:1789518655.768029:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518655.768034:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768040:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ba7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768072:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768079:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768085:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768091:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fec26d4e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518655.768094:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768100:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768108:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:0.0:1789518655.768110:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518655.768117:0:35845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786aff lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde66 expref: 33 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768127:0:35845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786aff lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde66 expref: 33 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768137:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786aff lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde66 expref: 33 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518655.768173:0:35845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1600/0x631fd8698c786aff lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde66 expref: 33 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518655.768187:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627664256:192.168.206.51@tcp:105: 00000100:00100000:0.0:1789518655.768255:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd81bf780 going to sleep for 11 seconds 00000100:00100000:0.0:1789518655.772746:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.772909:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627664256:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518655.772943:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.772954:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4e00/0x631fd8698c786af8 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.772968:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617405824 00000100:00100000:1.0:1789518655.772975:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617405824 00010000:00010000:2.0:1789518655.772984:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.772997:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773008:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773021:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773028:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.773030:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00010000:00010000:2.0:1789518655.773034:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773040:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c200 already unused, calling callback (ffffffffc1f3e4f0) 00000100:00100000:1.0:1789518655.773040:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35932:x1876445617405824:12345-192.168.206.51@tcp:49:dd.500 00010000:00010000:2.0:1789518655.773044:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773050:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773060:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518655.773063:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518655.773067:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773071:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c786bae lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773079:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773084:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773089:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773094:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28da00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518655.773097:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773102:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773108:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518655.773110:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518655.773112:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518655.773117:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ba0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518655.773156:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:35932:x1876445617405824:12345-192.168.206.51@tcp:49:dd.500 Request processed in 117us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518655.773163:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:2.0:1789518655.774063:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:35933:x1876445617405568:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 13123us (13296us total) trans 30064771387 rc 0/0 00000100:00100000:2.0:1789518655.774072:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 353 00000020:00080000:2.0:1789518655.774077:0:35845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789518655.774236:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518655.774242:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518655.774761:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 10 00000040:00080000:0.0:1789518655.774770:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518655.776388:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.776514:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617405952 00000100:00100000:3.0:1789518655.776522:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617405952 00000100:00100000:3.0:1789518655.776647:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:3.0:1789518655.776658:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:35932:x1876445617405952:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:3.0:1789518655.776675:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518655.776695:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786bb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfde9e expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518655.776720:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc9:0x0] initial LVB size: 20971520, mtime: 0x6aa9e33f, atime: 0x6aa9e33f, ctime: 0x6aa9e33f, blocks: 0xa007 00010000:00010000:3.0:1789518655.776752:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1789518655.776757:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518655.776766:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786bb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde9e expref: 11 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.776782:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7645bd4/0x631fd8698c786bb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfde9e expref: 11 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.776805:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17200, rc 0) 00000100:00100000:3.0:1789518655.776856:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:35932:x1876445617405952:12345-192.168.206.51@tcp:101:dd.500 Request processed in 200us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518655.776863:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:1.0:1789518655.800564:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.802572:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617406080 00000100:00100000:2.0:1789518655.802586:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617406080 00002000:00100000:2.0:1789518655.802748:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (20971520->22020095) req@ffff99fec8343100 x1876445617406080/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518655.802761:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8343100 with x1876445617406080 ext(20971520->22020095) 00002000:00010000:2.0:1789518655.802768:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8343100 00000100:00100000:2.0:1789518655.802856:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:2.0:1789518655.802867:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617406080:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:2.0:1789518655.813758:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617406080:12345-192.168.206.51@tcp:4:dd.500 Request processed in 10883us (13193us total) trans 30064771221 rc 0/0 00000100:00100000:2.0:1789518655.813771:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 221 00002000:00100000:2.0:1789518655.813782:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (20971520->22020095) req@ffff99fec8343100 x1876445617406080/t30064771221(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518655.813792:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8343100 with x1876445617406080 ext(20971520->22020095) 00002000:00010000:2.0:1789518655.813799:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8343100 00000100:00100000:1.0:1789518655.819851:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.819949:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617406208 00000100:00100000:0.0:1789518655.819960:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617406208 00002000:00100000:0.0:1789518655.820021:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (22020096->23068671) req@ffff99fec8341c00 x1876445617406208/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.820033:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8341c00 with x1876445617406208 ext(22020096->23068671) 00002000:00010000:0.0:1789518655.820039:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8341c00 00000100:00100000:0.0:1789518655.820078:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 222 00000100:00100000:0.0:1789518655.820088:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617406208:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:1.0:1789518655.831124:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617406208:12345-192.168.206.51@tcp:4:dd.500 Request processed in 11031us (11276us total) trans 30064771222 rc 0/0 00000100:00100000:1.0:1789518655.831133:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 222 00002000:00100000:1.0:1789518655.831143:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (22020096->23068671) req@ffff99fec8341c00 x1876445617406208/t30064771222(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1789518655.831151:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8341c00 with x1876445617406208 ext(22020096->23068671) 00002000:00010000:1.0:1789518655.831156:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8341c00 00000100:00100000:1.0:1789518655.841042:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.841123:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617406336 00000100:00100000:2.0:1789518655.841134:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617406336 00002000:00100000:2.0:1789518655.841182:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (23068672->24117247) req@ffff99fff78d9c00 x1876445617406336/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518655.841198:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d9c00 with x1876445617406336 ext(23068672->24117247) 00002000:00010000:2.0:1789518655.841204:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d9c00 00000100:00100000:2.0:1789518655.841275:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:2.0:1789518655.841286:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617406336:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:0.0:1789518655.843813:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.844140:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617406464 00000100:00100000:2.0:1789518655.844150:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617406464 00002000:00100000:2.0:1789518655.844193:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (24117248->25165823) req@ffff99fed35f1f80 x1876445617406464/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1789518655.844204:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f1f80 with x1876445617406464 ext(24117248->25165823) 00002000:00010000:2.0:1789518655.844210:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fed35f1f80 00000100:00100000:2.0:1789518655.844296:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:2.0:1789518655.844307:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617406464:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:0.0:1789518655.855070:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2343:x1876445617406336:12345-192.168.206.51@tcp:4:dd.500 Request processed in 13776us (14026us total) trans 30064771223 rc 0/0 00000100:00100000:0.0:1789518655.855085:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 223 00002000:00100000:0.0:1789518655.855099:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (23068672->24117247) req@ffff99fff78d9c00 x1876445617406336/t30064771223(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.855109:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78d9c00 with x1876445617406336 ext(23068672->24117247) 00002000:00010000:0.0:1789518655.855116:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78d9c00 00000100:00100000:0.0:1789518655.862286:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2342:x1876445617406464:12345-192.168.206.51@tcp:4:dd.500 Request processed in 17971us (18471us total) trans 30064771224 rc 0/0 00000100:00100000:0.0:1789518655.862299:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 224 00002000:00100000:0.0:1789518655.862311:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (24117248->25165823) req@ffff99fed35f1f80 x1876445617406464/t30064771224(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.862321:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f1f80 with x1876445617406464 ext(24117248->25165823) 00002000:00010000:0.0:1789518655.862328:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fed35f1f80 00000100:00100000:3.0:1789518655.864696:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.864917:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617406592 00000100:00100000:0.0:1789518655.864928:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617406592 00002000:00100000:0.0:1789518655.864975:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (25165824->26214399) req@ffff99fecb0ebb80 x1876445617406592/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.864987:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0ebb80 with x1876445617406592 ext(25165824->26214399) 00002000:00010000:0.0:1789518655.864991:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0ebb80 00000100:00100000:0.0:1789518655.865023:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:0.0:1789518655.865033:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2342:x1876445617406592:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:0.0:1789518655.876526:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2342:x1876445617406592:12345-192.168.206.51@tcp:4:dd.500 Request processed in 11487us (11831us total) trans 30064771225 rc 0/0 00000100:00100000:0.0:1789518655.876546:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 225 00002000:00100000:0.0:1789518655.876558:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (25165824->26214399) req@ffff99fecb0ebb80 x1876445617406592/t30064771225(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.876567:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0ebb80 with x1876445617406592 ext(25165824->26214399) 00002000:00010000:0.0:1789518655.876573:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0ebb80 00000100:00100000:2.0:1789518655.878774:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518655.878856:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617406848 00000100:00100000:1.0:1789518655.878865:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617406848 00000100:00100000:1.0:1789518655.878918:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1789518655.878946:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:35933:x1876445617406848:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789518655.880020:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x23:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789518655.880138:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771388 00010000:00010000:1.0:1789518655.880190:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.880205:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.880216:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.880224:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.880230:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.880236:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518655.880366:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789518655.880477:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:35933:x1876445617406848:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1531us (1707us total) trans 30064771389 rc 0/0 00000100:00100000:1.0:1789518655.880487:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000020:00080000:1.0:1789518655.880492:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518655.880730:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518655.880738:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.880745:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518655.880749:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.880756:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.880770:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:3.0:1789518655.880773:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518655.880778:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.880798:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786bbc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518655.880817:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518655.880819:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518655.880893:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518655.889002:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.889152:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617406976 00000100:00100000:0.0:1789518655.889161:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617406976 00002000:00100000:0.0:1789518655.889225:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (26214400->27262975) req@ffff99ffed932300 x1876445617406976/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.889237:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed932300 with x1876445617406976 ext(26214400->27262975) 00002000:00010000:0.0:1789518655.889242:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed932300 00000100:00100000:0.0:1789518655.889284:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 226 00000100:00100000:0.0:1789518655.889294:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2342:x1876445617406976:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:0.0:1789518655.899405:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2342:x1876445617406976:12345-192.168.206.51@tcp:4:dd.500 Request processed in 10103us (10403us total) trans 30064771226 rc 0/0 00000100:00100000:0.0:1789518655.899416:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 226 00002000:00100000:0.0:1789518655.899441:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (26214400->27262975) req@ffff99ffed932300 x1876445617406976/t30064771226(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.899452:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed932300 with x1876445617406976 ext(26214400->27262975) 00002000:00010000:0.0:1789518655.899458:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed932300 00000100:00100000:1.0:1789518655.906096:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.906789:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617407104 00000100:00100000:0.0:1789518655.906800:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617407104 00002000:00100000:0.0:1789518655.906852:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (27262976->28311551) req@ffff99ffed931c00 x1876445617407104/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.906862:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931c00 with x1876445617407104 ext(27262976->28311551) 00002000:00010000:0.0:1789518655.906868:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed931c00 00000100:00100000:0.0:1789518655.906943:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:0.0:1789518655.906953:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2345:x1876445617407104:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:0.0:1789518655.916381:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2345:x1876445617407104:12345-192.168.206.51@tcp:4:dd.500 Request processed in 9420us (10285us total) trans 30064771227 rc 0/0 00000100:00100000:0.0:1789518655.916395:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 227 00002000:00100000:0.0:1789518655.916408:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (27262976->28311551) req@ffff99ffed931c00 x1876445617407104/t30064771227(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.916422:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931c00 with x1876445617407104 ext(27262976->28311551) 00002000:00010000:0.0:1789518655.916438:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed931c00 00000100:00100000:2.0:1789518655.927739:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.928208:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617407232 00000100:00100000:0.0:1789518655.928227:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617407232 00002000:00100000:0.0:1789518655.928275:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (28311552->29360127) req@ffff99fecb2a5180 x1876445617407232/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.928287:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a5180 with x1876445617407232 ext(28311552->29360127) 00002000:00010000:0.0:1789518655.928293:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a5180 00000100:00100000:0.0:1789518655.928325:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 228 00000100:00100000:0.0:1789518655.928334:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2343:x1876445617407232:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:0.0:1789518655.935220:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2343:x1876445617407232:12345-192.168.206.51@tcp:4:dd.500 Request processed in 6876us (7478us total) trans 30064771228 rc 0/0 00000100:00100000:0.0:1789518655.935232:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 228 00002000:00100000:0.0:1789518655.935244:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (28311552->29360127) req@ffff99fecb2a5180 x1876445617407232/t30064771228(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.935261:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a5180 with x1876445617407232 ext(28311552->29360127) 00002000:00010000:0.0:1789518655.935267:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a5180 00000100:00100000:1.0:1789518655.939835:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518655.940002:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617407360 00000100:00100000:0.0:1789518655.940120:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617407360 00002000:00100000:0.0:1789518655.940177:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (29360128->30408703) req@ffff99ffed930700 x1876445617407360/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.940189:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed930700 with x1876445617407360 ext(29360128->30408703) 00002000:00010000:0.0:1789518655.940195:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed930700 00000100:00100000:0.0:1789518655.940301:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:0.0:1789518655.940312:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2343:x1876445617407360:12345-192.168.206.51@tcp:4:dd.500 00000100:00100000:0.0:1789518655.945342:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2343:x1876445617407360:12345-192.168.206.51@tcp:4:dd.500 Request processed in 5022us (5511us total) trans 30064771229 rc 0/0 00000100:00100000:0.0:1789518655.945355:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 229 00002000:00100000:0.0:1789518655.945368:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (29360128->30408703) req@ffff99ffed930700 x1876445617407360/t30064771229(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.945378:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed930700 with x1876445617407360 ext(29360128->30408703) 00002000:00010000:0.0:1789518655.945385:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed930700 00000100:00100000:2.0:1789518655.953606:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518655.953798:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518655.953838:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617407744 00000100:00100000:3.0:1789518655.953847:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617407744 00000100:00100000:3.0:1789518655.953959:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:3.0:1789518655.953972:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:35932:x1876445617407744:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:0.0:1789518655.954137:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617407488 00000100:00100000:0.0:1789518655.954142:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617407488 00002000:00100000:0.0:1789518655.954180:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (30408704->31457279) req@ffff99fecb2a4e00 x1876445617407488/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/0 e 0 to 0 dl 1789518666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.954191:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a4e00 with x1876445617407488 ext(30408704->31457279) 00002000:00010000:0.0:1789518655.954197:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a4e00 00000100:00100000:0.0:1789518655.954224:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:0.0:1789518655.954233:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2344:x1876445617407488:12345-192.168.206.51@tcp:4:dd.500 00000001:00080000:3.0:1789518655.954301:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771390 00000001:00080000:3.0:1789518655.954363:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771391 00000100:00100000:3.0:1789518655.954478:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:35932:x1876445617407744:12345-192.168.206.51@tcp:35:dd.500 Request processed in 509us (882us total) trans 30064771392 rc 0/0 00000100:00100000:3.0:1789518655.954486:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000020:00080000:3.0:1789518655.954491:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789518655.967718:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2344:x1876445617407488:12345-192.168.206.51@tcp:4:dd.500 Request processed in 13476us (13909us total) trans 30064771230 rc 0/0 00000100:00100000:0.0:1789518655.967731:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 230 00002000:00100000:0.0:1789518655.967743:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (30408704->31457279) req@ffff99fecb2a4e00 x1876445617407488/t30064771230(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:301/0 lens 488/448 e 0 to 0 dl 1789518666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1789518655.967754:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a4e00 with x1876445617407488 ext(30408704->31457279) 00002000:00010000:0.0:1789518655.967759:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a4e00 00000100:00100000:1.0:1789518656.021228:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518656.021456:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617407872 00000100:00100000:2.0:1789518656.021466:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617407872 00000100:00100000:2.0:1789518656.021526:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 354 00000100:00100000:2.0:1789518656.021536:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:35943:x1876445617407872:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518656.021606:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.021867:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.021881:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.021898:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.021905:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.021911:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022315:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022324:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022332:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518656.022731:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022745:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022751:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022757:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022764:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518656.022767:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022774:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022785:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff99fec3b12200) 00010000:00010000:2.0:1789518656.022788:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518656.022793:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022800:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c786bc3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022811:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022817:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022823:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022827:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518656.022830:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022835:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022841:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff99fec3b12900) 00010000:00010000:2.0:1789518656.022843:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518656.022846:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022851:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c786bca lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022864:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022870:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022875:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022880:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14de00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518656.022883:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022889:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022896:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff99fec3b12700) 00010000:00010000:2.0:1789518656.022898:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518656.022901:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518656.022907:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c786bd1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518656.022996:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:35943:x1876445617407872:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1460us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518656.023005:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 354 00000004:00080000:0.0:1789518656.114807:0:35870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 710111189595ns, next at 711111187875ns, rc = 0 00000100:00100000:2.0:1789518656.114884:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518656.114904:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627664384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518656.114971:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518656.115028:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627664896:0@lo:400:kworker.0 00000100:00100000:2.0:1789518656.115029:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627664512:0@lo:400:kworker.0 00000100:00100000:2.0:1789518656.115057:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518656.115079:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627665024:0@lo:400:kworker.0 00000100:00100000:2.0:1789518656.115099:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518656.115111:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627664512 00000100:00100000:1.0:1789518656.115118:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627664512 00000100:00100000:3.0:1789518656.115122:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627664640:0@lo:400:kworker.0 00000100:00100000:2.0:1789518656.115145:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627664384 00000100:00100000:2.0:1789518656.115151:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627664384 00000100:00100000:3.0:1789518656.115164:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518656.115175:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789518656.115185:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627664512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518656.115186:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518656.115191:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627665152:0@lo:400:kworker.0 00000100:00100000:2.0:1789518656.115196:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627664384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518656.115226:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789518656.115228:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 272564224 pending 17039360 free 3772776448 avail 3733979136 00000100:00100000:1.0:1789518656.115246:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627664512:12345-0@lo:400:kworker.0 Request processed in 62us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518656.115254:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789518656.115259:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518656.115267:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627664384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518656.115276:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789518656.115281:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627664768:0@lo:400:kworker.0 00000100:00100000:1.0:1789518656.115300:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518656.115308:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627664640 00000100:00100000:2.0:1789518656.115313:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627664640 00000100:00100000:3.0:1789518656.115318:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518656.115344:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627664768 00000100:00100000:2.0:1789518656.115348:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627664768 00000100:00100000:1.0:1789518656.115350:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789518656.115357:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3282:x1876445627664640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518656.115368:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789518656.115375:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627664768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518656.115377:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627665024 00000100:00100000:3.0:1789518656.115383:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627665024 00000100:00100000:1.0:1789518656.115397:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3282:x1876445627664640:12345-0@lo:400:kworker.0 Request processed in 40us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518656.115404:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518656.115405:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627664768:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518656.115410:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518656.115423:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627665152 00000100:00100000:1.0:1789518656.115443:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627664896 00000100:00100000:3.0:1789518656.115450:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627665152 00000100:00100000:1.0:1789518656.115450:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627664896 00000100:00100000:2.0:1789518656.115475:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627664512:0@lo:400:kworker.0 00000100:00100000:1.0:1789518656.115476:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789518656.115485:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627665024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518656.115497:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518656.115498:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627664384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518656.115509:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627664896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518656.115519:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627665024:12345-0@lo:400:kworker.0 Request processed in 34us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518656.115524:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627665024:0@lo:400:kworker.0 00000100:00100000:1.0:1789518656.115526:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789518656.115546:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518656.115556:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627665152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518656.115564:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627664896:12345-0@lo:400:kworker.0 Request processed in 57us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518656.115572:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627664768:0@lo:400:kworker.0 00000100:00100000:3.0:1789518656.115573:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789518656.115591:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627664640:0@lo:400:kworker.0 00000100:00100000:2.0:1789518656.115592:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627665152:12345-0@lo:400:kworker.0 Request processed in 39us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518656.115598:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789518656.115648:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627665152:0@lo:400:kworker.0 00000100:00080000:0.0:1789518656.115652:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518656.115657:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518656.115658:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518656.116907:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627664896:0@lo:400:kworker.0 00010000:00010000:1.0:1789518656.371095:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518656.818807:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518656.818818:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518656.818852:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 10 00000040:00080000:0.0:1789518656.818874:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518657.395486:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518657.422546:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518657.422812:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518657.422833:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518657.422865:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518657.422885:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518657.422920:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617408128 00000100:00100000:3.0:1789518657.422932:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617408128 00000100:00100000:3.0:1789518657.423017:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617408512 00000100:00100000:3.0:1789518657.423021:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617408512 00000100:00100000:3.0:1789518657.423047:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:3.0:1789518657.423057:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2344:x1876445617408128:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518657.423154:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2344:x1876445617408128:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 97us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518657.423162:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:3.0:1789518657.423182:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1789518657.423189:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617408512:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518657.423218:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617408512:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518657.423226:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1789518657.423229:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617408256 00000100:00100000:2.0:1789518657.423246:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617408256 00000100:00100000:2.0:1789518657.423329:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617408384 00000100:00100000:2.0:1789518657.423333:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617408384 00000100:00100000:2.0:1789518657.423368:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1789518657.423382:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2345:x1876445617408256:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518657.423443:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:3.0:1789518657.423474:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2344:x1876445617408384:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518657.423486:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2345:x1876445617408256:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 101us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518657.423496:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:0.0:1789518657.423762:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617408000 00000100:00100000:0.0:1789518657.423770:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617408000 00000100:00100000:0.0:1789518657.423810:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:0.0:1789518657.423817:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617408000:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518657.424293:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617408000:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 474us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518657.424302:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00080000:0.0:1789518657.424340:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518657.424346:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518657.424352:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518657.424394:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2344:x1876445617408384:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 919us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518657.424404:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00010000:00010000:3.0:1789518658.418955:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518658.710836:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518658.710919:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617408640 00000100:00100000:2.0:1789518658.710929:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617408640 00000100:00100000:2.0:1789518658.710999:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 355 00000100:00100000:2.0:1789518658.711101:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:35874:x1876445617408640:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789518658.712093:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:35874:x1876445617408640:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 1081us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518658.712105:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 355 00000100:00100000:0.0:1789518658.715821:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518658.715984:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617408896 00000100:00100000:1.0:1789518658.715994:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617408896 00000100:00100000:1.0:1789518658.716064:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:1.0:1789518658.716076:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:35874:x1876445617408896:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518658.716305:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:35874:x1876445617408896:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 230us (504us total) trans 30064771393 rc 0/0 00000100:00100000:1.0:1789518658.716313:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000001:00080000:1.0:1789518659.247791:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771164 is committed 00000001:00080000:1.0:1789518659.247831:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771148 is committed 00000001:00080000:1.0:1789518659.247902:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771165 is committed 00010000:00010000:1.0:1789518659.442776:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518659.719211:0:39446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10c: Test RO-PCC with user quota on loop PCC device ========================================================== 20:30:59 (1789518659) 00010000:00010000:2.0:1789518660.467684:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518660.711357:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518660.712356:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617409152 00000100:00100000:3.0:1789518660.712367:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617409152 00000100:00100000:3.0:1789518660.712458:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 356 00000100:00100000:3.0:1789518660.712469:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:36658:x1876445617409152:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518660.712492:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518660.712510:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786bd8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdea5 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.712578:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.712590:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.712601:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.712639:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.712646:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.712653:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789518660.712765:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518660.712970:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786bed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.712988:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786bed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713003:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786bed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518660.713014:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789518660.713108:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713116:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713122:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713128:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518660.713132:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713141:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713152:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:3.0:1789518660.713155:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518660.713159:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713165:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786bdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713176:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713189:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713196:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713201:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518660.713204:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713210:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713218:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffeaa78100) 00010000:00010000:3.0:1789518660.713221:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518660.713224:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713230:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786be6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713797:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786bd8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdea5 expref: 42 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713814:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786bed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdea5 expref: 41 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.713821:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:3.0:1789518660.713824:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518660.713832:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16a00, rc 0) 00000100:00100000:3.0:1789518660.714425:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:36658:x1876445617409152:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1956us (3076us total) trans 30064771394 rc 0/0 00000100:00100000:3.0:1789518660.714435:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 356 00000100:00100000:3.0:1789518660.718539:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518660.718597:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518660.718809:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617409280 00000100:00100000:0.0:1789518660.718823:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617409280 00000100:00100000:0.0:1789518660.718900:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 357 00000100:00100000:0.0:1789518660.718913:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:36658:x1876445617409280:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789518660.719057:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:36658:x1876445617409280:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 144us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518660.719065:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 357 00000100:00100000:1.0:1789518660.719468:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617409408 00000100:00100000:1.0:1789518660.719483:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617409408 00000100:00100000:1.0:1789518660.719589:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:1.0:1789518660.719598:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2345:x1876445617409408:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518660.719635:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518660.719660:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786bed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdea5 expref: 41 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.719681:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518660.719686:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518660.719749:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2345:x1876445617409408:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 151us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518660.719756:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1789518660.723888:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518660.723906:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627665280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518660.724010:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518660.724097:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627665280 00000100:00100000:2.0:1789518660.724105:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627665280 00000100:00100000:2.0:1789518660.724158:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518660.724172:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627665280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518660.724204:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 153288704 pending 0 free 3812622336 avail 3810525184 00000100:00100000:2.0:1789518660.724245:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627665280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518660.724252:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789518660.724292:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771165 gen 2 00000004:00080000:2.0:1789518660.724297:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff79af480, transno 30064771147 00000004:00080000:2.0:1789518660.724306:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff79af800, transno 30064771148 00000004:00080000:2.0:1789518660.724309:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fecb0e8380, transno 30064771165 00000100:00100000:2.0:1789518660.724319:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627665280:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789518660.724792:0:35867:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00080000:0.0:1789518660.727057:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789518660.762746:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:3.0:1789518660.762777:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771387 is committed 00000020:00080000:3.0:1789518660.762787:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc4c413c0 refcount 2 committed 0 result 0 batchid 25769803904 00000020:00080000:3.0:1789518660.762792:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffdfd4ab00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc4c41d80 00000020:00080000:3.0:1789518660.762796:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffdfd4a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ffe6110c00 00000001:00080000:3.0:1789518660.762811:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771393 is committed 00000020:00080000:3.0:1789518660.762820:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803903 batchid updated 00000001:00080000:3.0:1789518660.762837:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771394 is committed 00000020:00080000:3.0:1789518660.762942:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803904 committed batchid 25769803903 00000020:00080000:3.0:1789518660.763658:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803903 00000100:00100000:3.0:1789518660.763691:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627665408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789518660.763770:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518660.763934:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518660.763946:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627665536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518660.763990:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518660.764202:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627665408 00000100:00100000:3.0:1789518660.764211:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627665408 00000100:00100000:3.0:1789518660.764315:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627665536 00000100:00100000:3.0:1789518660.764320:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627665536 00000100:00100000:3.0:1789518660.764374:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789518660.764392:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627665408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789518660.764481:0:36532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:200 count 1 00002000:00010000:3.0:1789518660.764523:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc8:0x0] initial LVB size: 15728640, mtime: 0x6aa9e33e, atime: 0x0, ctime: 0x6aa9e33f, blocks: 0x7807 00010000:00010000:3.0:1789518660.764535:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.764553:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1789518660.764558:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518660.764565:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.764581:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.764592:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.764601:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.764656:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518660.764667:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518660.764680:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.764694:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518660.764700:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.764713:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.764742:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.764751:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002379b8dd/0x631fd8698c786bfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.764784:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518660.764787:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518660.764790:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518660.765926:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3280:x1876445627665408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1540us (2156us total) trans 30064771231 rc 0/0 00000100:00100000:3.0:1789518660.765938:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789518660.765972:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789518660.765993:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627665536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789518660.766125:0:36532:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb size from disk: 20971520 -> 31457280 00002000:00010000:3.0:1789518660.766137:0:36532:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb mtime from disk: 1789518655 -> 1789518656 00002000:00010000:3.0:1789518660.766139:0:36532:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb atime from disk: 1789518655 -> 1789518655 00002000:00010000:3.0:1789518660.766142:0:36532:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb ctime from disk: 1789518655 -> 1789518656 00002000:00010000:3.0:1789518660.766145:0:36532:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb blocks from disk: 40967 -> 61447 00000004:00080000:2.0:1789518660.766176:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec8340a80/2, rc 0, transno 30064771231 00000100:00100000:2.0:1789518660.766193:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627665408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789518660.766195:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3280:x1876445627665536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (2217us total) trans 30064771232 rc 0/0 00000100:00100000:3.0:1789518660.766210:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1789518660.766252:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789518660.766338:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec8343480/2, rc 0, transno 30064771232 00000100:00100000:2.0:1789518660.766348:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627665536:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1789518660.772889:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771230 is committed 00000001:00080000:2.0:1789518660.773098:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771220 is committed 00000100:00100000:3.0:1789518660.812426:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518660.812526:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617409664 00000100:00100000:2.0:1789518660.812539:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617409664 00000100:00100000:2.0:1789518660.812648:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 358 00000100:00100000:2.0:1789518660.812657:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:36673:x1876445617409664:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:2.0:1789518660.812724:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518660.812754:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786931 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfddd3 expref: 27 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.812777:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518660.812791:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518660.813159:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.813171:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.813183:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.813193:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.813197:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.813201:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518660.814306:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00010000:00010000:2.0:1789518660.814323:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.814334:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.814341:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.814346:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14dc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518660.814351:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.814359:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.814373:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518660.814376:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518660.814382:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518660.814389:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c786c02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518660.814427:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014bc49da reply state 00000000783d8b62 transno 30064771395 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518660.814437:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518660.814563:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:36673:x1876445617409664:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 1900us (2153us total) trans 30064771395 rc 0/0 00000100:00100000:2.0:1789518660.814572:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 358 00010000:00010000:1.0:1789518660.817563:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.817581:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.817590:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.817596:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518660.817601:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.817608:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.817655:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff99fec3b12400) 00010000:00010000:1.0:1789518660.817659:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518660.817664:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.817671:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c786c09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518660.821961:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518660.822035:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617409792 00000100:00100000:1.0:1789518660.822065:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617409792 00000100:00100000:1.0:1789518660.822137:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 359 00000100:00100000:1.0:1789518660.822148:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:36674:x1876445617409792:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1789518660.822173:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518660.822198:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786c10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdeac expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.822286:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786c17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.822300:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.822312:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518660.822347:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518660.822351:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518660.822367:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786c17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.822392:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786c10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeac expref: 29 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.822427:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786c17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeac expref: 28 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.822436:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518660.822440:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518660.822443:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0800, rc 0) 00000100:00100000:1.0:1789518660.822511:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:36674:x1876445617409792:12345-192.168.206.51@tcp:101:dd.0 Request processed in 364us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518660.822519:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 359 00000100:00100000:2.0:1789518660.824554:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518660.824683:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617409920 00000100:00100000:3.0:1789518660.824695:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617409920 00000100:00100000:3.0:1789518660.824751:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 360 00000100:00100000:3.0:1789518660.824768:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:36674:x1876445617409920:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518660.824791:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518660.824815:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdeb3 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.824890:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.824906:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.824918:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.824935:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.824982:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.824990:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825251:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786c33 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825272:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786c33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825284:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786c33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518660.825324:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00000004:00200000:3.0:1789518660.825328:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518660.825347:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786c33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825360:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825368:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825375:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825380:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b17400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518660.825399:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825433:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825446:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518660.825449:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518660.825454:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825460:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17400/0x631fd8698c786c25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825475:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825481:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825486:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825491:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518660.825494:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825500:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825507:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff99ffeaa78200) 00010000:00010000:3.0:1789518660.825509:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518660.825512:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825529:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786c2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825567:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeb3 expref: 30 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825580:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b17e00/0x631fd8698c786c33 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeb3 expref: 29 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518660.825587:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:3.0:1789518660.825589:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789518660.825592:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17e00, rc 0) 00000100:00100000:3.0:1789518660.825686:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:36674:x1876445617409920:12345-192.168.206.51@tcp:101:dd.0 Request processed in 924us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518660.825695:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 360 00000100:00100000:2.0:1789518660.828432:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518660.828573:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617410176 00000100:00100000:1.0:1789518660.828586:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617410176 00000100:00100000:1.0:1789518660.828704:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 361 00000100:00100000:1.0:1789518660.828716:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:36674:x1876445617410176:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:1.0:1789518660.828743:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518660.828768:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786c3a lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdeba expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.828924:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.828942:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.828956:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.828973:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.828980:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.828988:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518660.829889:0:37723:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xca:0x0], index 0: 0 00010000:00010000:1.0:1789518660.830219:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786c4f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830235:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786c4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830245:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786c4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830536:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830545:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830551:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830556:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518660.830561:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830569:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830582:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:1.0:1789518660.830586:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518660.830592:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830597:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786c41 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518660.830660:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000668bc176 reply state 00000000cbea0bda transno 30064771396 ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518660.830672:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518660.830879:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786c3a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeba expref: 32 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830913:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786c4f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeba expref: 31 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518660.830920:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:1.0:1789518660.830923:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518660.830925:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6400, rc 0) 00000100:00100000:1.0:1789518660.831091:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:36674:x1876445617410176:12345-192.168.206.51@tcp:101:dd.0 Request processed in 2375us (2670us total) trans 30064771396 rc 0/0 00000100:00100000:1.0:1789518660.831101:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 361 00010000:00010000:0.0:1789518660.832857:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.832877:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.832885:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.832891:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a00021c7800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518660.832897:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.832907:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.832925:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518660.832928:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518660.832933:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.832940:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786c48 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518660.835944:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518660.836070:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617410304 00000100:00100000:0.0:1789518660.836083:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617410304 00000100:00100000:0.0:1789518660.836173:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:0.0:1789518660.836186:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+7:36674:x1876445617410304:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1789518660.836211:0:36735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518660.836237:0:36735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aed742a/0x631fd8698c786c5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdec1 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518660.836366:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518660.836396:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xca:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1789518660.836462:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518660.836476:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aed742a/0x631fd8698c786c5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdec1 expref: 8 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.836497:0:36735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aed742a/0x631fd8698c786c5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdec1 expref: 8 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518660.836512:0:36735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d400, rc 0) 00000100:00100000:0.0:1789518660.836594:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:36674:x1876445617410304:12345-192.168.206.51@tcp:101:dd.0 Request processed in 410us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518660.836603:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00080000:3.0:1789518660.836736:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518660.856631:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518660.858176:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617410432 00000100:00100000:0.0:1789518660.858189:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617410432 00002000:00100000:0.0:1789518660.858246:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff99ffed930380 x1876445617410432/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.858256:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed930380 with x1876445617410432 ext(0->1048575) 00002000:00010000:0.0:1789518660.858262:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed930380 00000100:00100000:0.0:1789518660.858303:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:0.0:1789518660.858313:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:2342:x1876445617410432:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518660.876853:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518660.876974:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617410560 00000100:00100000:3.0:1789518660.876988:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617410560 00002000:00100000:3.0:1789518660.877061:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff99fecb2a7480 x1876445617410560/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518660.877075:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a7480 with x1876445617410560 ext(1048576->2097151) 00002000:00010000:3.0:1789518660.877082:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb2a7480 00000100:00100000:3.0:1789518660.877118:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 232 00000100:00100000:3.0:1789518660.877130:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617410560:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518660.891172:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617410432:12345-192.168.206.51@tcp:4:dd.0 Request processed in 32850us (34555us total) trans 30064771166 rc 0/0 00000100:00100000:1.0:1789518660.891186:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 231 00002000:00100000:1.0:1789518660.891199:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff99ffed930380 x1876445617410432/t30064771166(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518660.891210:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed930380 with x1876445617410432 ext(0->1048575) 00002000:00010000:1.0:1789518660.891216:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed930380 00000100:00100000:3.0:1789518660.893115:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518660.893582:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617410688 00000100:00100000:0.0:1789518660.893593:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617410688 00002000:00100000:0.0:1789518660.893663:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff99fff4002680 x1876445617410688/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.893674:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4002680 with x1876445617410688 ext(2097152->3145727) 00002000:00010000:0.0:1789518660.893680:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4002680 00000100:00100000:0.0:1789518660.893710:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:0.0:1789518660.893720:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2345:x1876445617410688:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518660.898640:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617410560:12345-192.168.206.51@tcp:4:dd.0 Request processed in 21484us (21775us total) trans 30064771167 rc 0/0 00000100:00100000:0.0:1789518660.898652:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 232 00002000:00100000:0.0:1789518660.898663:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff99fecb2a7480 x1876445617410560/t30064771167(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.898673:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a7480 with x1876445617410560 ext(1048576->2097151) 00002000:00010000:0.0:1789518660.898680:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb2a7480 00000040:00080000:0.0:1789518660.915145:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518660.915154:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518660.915689:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 10 00000040:00080000:0.0:1789518660.915698:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518660.916516:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2345:x1876445617410688:12345-192.168.206.51@tcp:4:dd.0 Request processed in 22791us (23403us total) trans 30064771168 rc 0/0 00000100:00100000:0.0:1789518660.916528:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 233 00002000:00100000:0.0:1789518660.916540:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff99fff4002680 x1876445617410688/t30064771168(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.916557:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4002680 with x1876445617410688 ext(2097152->3145727) 00002000:00010000:0.0:1789518660.916564:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4002680 00000100:00100000:0.0:1789518660.916677:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518660.916818:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617410816 00000100:00100000:2.0:1789518660.916834:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617410816 00002000:00100000:2.0:1789518660.916892:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff99fed35f1180 x1876445617410816/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518660.916904:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f1180 with x1876445617410816 ext(3145728->4194303) 00002000:00010000:2.0:1789518660.916910:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f1180 00000100:00100000:2.0:1789518660.916935:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:2.0:1789518660.916946:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617410816:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518660.927138:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2343:x1876445617410816:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10180us (10446us total) trans 30064771169 rc 0/0 00000100:00100000:2.0:1789518660.927154:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 234 00002000:00100000:2.0:1789518660.927171:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff99fed35f1180 x1876445617410816/t30064771169(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518660.927183:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f1180 with x1876445617410816 ext(3145728->4194303) 00002000:00010000:2.0:1789518660.927191:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f1180 00000100:00100000:3.0:1789518660.929349:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518660.929563:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617410944 00000100:00100000:2.0:1789518660.929576:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617410944 00002000:00100000:2.0:1789518660.929674:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff99fff4000380 x1876445617410944/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518660.929687:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4000380 with x1876445617410944 ext(4194304->5242879) 00002000:00010000:2.0:1789518660.929695:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4000380 00000100:00100000:2.0:1789518660.929723:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:2.0:1789518660.929734:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2343:x1876445617410944:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518660.937836:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2343:x1876445617410944:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8087us (8483us total) trans 30064771170 rc 0/0 00000100:00100000:0.0:1789518660.937853:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 235 00002000:00100000:0.0:1789518660.937870:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff99fff4000380 x1876445617410944/t30064771170(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.937883:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4000380 with x1876445617410944 ext(4194304->5242879) 00002000:00010000:0.0:1789518660.937891:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4000380 00000100:00100000:3.0:1789518660.941581:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518660.941903:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617411072 00000100:00100000:0.0:1789518660.941918:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617411072 00002000:00100000:0.0:1789518660.941975:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff99fff4003100 x1876445617411072/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.941987:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4003100 with x1876445617411072 ext(5242880->6291455) 00002000:00010000:0.0:1789518660.941993:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4003100 00000100:00100000:0.0:1789518660.942026:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 236 00000100:00100000:0.0:1789518660.942037:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2342:x1876445617411072:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518660.954262:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2342:x1876445617411072:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12209us (12677us total) trans 30064771171 rc 0/0 00000100:00100000:0.0:1789518660.954279:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 236 00002000:00100000:0.0:1789518660.954295:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff99fff4003100 x1876445617411072/t30064771171(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.954312:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4003100 with x1876445617411072 ext(5242880->6291455) 00002000:00010000:0.0:1789518660.954321:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4003100 00000100:00100000:3.0:1789518660.954425:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518660.954719:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617411200 00000100:00100000:2.0:1789518660.954731:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617411200 00002000:00100000:2.0:1789518660.954778:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff99fff4001f80 x1876445617411200/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518660.954789:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001f80 with x1876445617411200 ext(6291456->7340031) 00002000:00010000:2.0:1789518660.954793:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001f80 00000100:00100000:2.0:1789518660.954825:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 237 00000100:00100000:2.0:1789518660.954835:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2342:x1876445617411200:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518660.960568:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2342:x1876445617411200:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5715us (6126us total) trans 30064771172 rc 0/0 00000100:00100000:2.0:1789518660.960596:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 237 00002000:00100000:2.0:1789518660.960630:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff99fff4001f80 x1876445617411200/t30064771172(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518660.960644:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001f80 with x1876445617411200 ext(6291456->7340031) 00002000:00010000:2.0:1789518660.960652:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001f80 00000100:00100000:2.0:1789518660.966235:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518660.966476:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617411328 00000100:00100000:0.0:1789518660.966488:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617411328 00002000:00100000:0.0:1789518660.966552:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff99fecb2a7800 x1876445617411328/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.966565:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a7800 with x1876445617411328 ext(7340032->8388607) 00002000:00010000:0.0:1789518660.966572:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb2a7800 00000100:00100000:0.0:1789518660.966723:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 238 00000100:00100000:0.0:1789518660.966736:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2343:x1876445617411328:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518660.975255:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2343:x1876445617411328:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8506us (9019us total) trans 30064771173 rc 0/0 00000100:00100000:0.0:1789518660.975272:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 238 00002000:00100000:0.0:1789518660.975289:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff99fecb2a7800 x1876445617411328/t30064771173(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.975302:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a7800 with x1876445617411328 ext(7340032->8388607) 00002000:00010000:0.0:1789518660.975310:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb2a7800 00000100:00100000:2.0:1789518660.981960:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518660.982105:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617411456 00000100:00100000:0.0:1789518660.982118:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617411456 00002000:00100000:0.0:1789518660.982185:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff99fecb2a6d80 x1876445617411456/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.982199:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a6d80 with x1876445617411456 ext(8388608->9437183) 00002000:00010000:0.0:1789518660.982205:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb2a6d80 00000100:00100000:0.0:1789518660.982253:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 239 00000100:00100000:0.0:1789518660.982264:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2342:x1876445617411456:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518660.991381:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2342:x1876445617411456:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9103us (9417us total) trans 30064771174 rc 0/0 00000100:00100000:0.0:1789518660.991397:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 239 00002000:00100000:0.0:1789518660.991422:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff99fecb2a6d80 x1876445617411456/t30064771174(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518660.991433:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a6d80 with x1876445617411456 ext(8388608->9437183) 00002000:00010000:0.0:1789518660.991440:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb2a6d80 00000100:00100000:1.0:1789518660.998221:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518660.998482:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617411584 00000100:00100000:2.0:1789518660.998495:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617411584 00002000:00100000:2.0:1789518660.998565:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff99ffed930a80 x1876445617411584/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/0 e 0 to 0 dl 1789518671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518660.998578:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed930a80 with x1876445617411584 ext(9437184->10485759) 00002000:00010000:2.0:1789518660.998585:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed930a80 00000100:00100000:2.0:1789518660.998694:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00100000:2.0:1789518660.998706:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2343:x1876445617411584:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.008940:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2343:x1876445617411584:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10222us (10719us total) trans 30064771175 rc 0/0 00000100:00100000:0.0:1789518661.008957:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 240 00002000:00100000:0.0:1789518661.008973:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff99ffed930a80 x1876445617411584/t30064771175(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:306/0 lens 488/448 e 0 to 0 dl 1789518671 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.008985:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed930a80 with x1876445617411584 ext(9437184->10485759) 00002000:00010000:0.0:1789518661.008993:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed930a80 00000100:00100000:3.0:1789518661.011952:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.012023:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617411712 00000100:00100000:0.0:1789518661.012036:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617411712 00002000:00100000:0.0:1789518661.012710:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff99fff4001c00 x1876445617411712/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.012725:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001c00 with x1876445617411712 ext(10485760->11534335) 00002000:00010000:0.0:1789518661.012734:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001c00 00000100:00100000:0.0:1789518661.012839:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 241 00000100:00100000:0.0:1789518661.012854:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2345:x1876445617411712:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.024034:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2345:x1876445617411712:12345-192.168.206.51@tcp:4:dd.0 Request processed in 11172us (12083us total) trans 30064771176 rc 0/0 00000100:00100000:0.0:1789518661.024050:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 241 00002000:00100000:0.0:1789518661.024067:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff99fff4001c00 x1876445617411712/t30064771176(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.024079:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4001c00 with x1876445617411712 ext(10485760->11534335) 00002000:00010000:0.0:1789518661.024088:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4001c00 00000100:00100000:2.0:1789518661.025294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.025411:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617411840 00000100:00100000:0.0:1789518661.025423:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617411840 00002000:00100000:0.0:1789518661.025476:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff99fecb2a6680 x1876445617411840/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.025499:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a6680 with x1876445617411840 ext(11534336->12582911) 00002000:00010000:0.0:1789518661.025506:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb2a6680 00000100:00100000:0.0:1789518661.025593:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 242 00000100:00100000:0.0:1789518661.025604:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2342:x1876445617411840:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.034777:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2342:x1876445617411840:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9163us (9479us total) trans 30064771177 rc 0/0 00000100:00100000:0.0:1789518661.034790:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 242 00002000:00100000:0.0:1789518661.034804:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff99fecb2a6680 x1876445617411840/t30064771177(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.034813:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a6680 with x1876445617411840 ext(11534336->12582911) 00002000:00010000:0.0:1789518661.034820:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb2a6680 00000100:00100000:2.0:1789518661.035944:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.036057:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617411968 00000100:00100000:0.0:1789518661.036069:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617411968 00002000:00100000:0.0:1789518661.036117:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff99fecb0e8380 x1876445617411968/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.036127:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8380 with x1876445617411968 ext(12582912->13631487) 00002000:00010000:0.0:1789518661.036133:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb0e8380 00000100:00100000:0.0:1789518661.036201:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 243 00000100:00100000:0.0:1789518661.036212:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2342:x1876445617411968:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.042791:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2342:x1876445617411968:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6565us (6840us total) trans 30064771178 rc 0/0 00000100:00100000:0.0:1789518661.042807:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 243 00002000:00100000:0.0:1789518661.042823:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff99fecb0e8380 x1876445617411968/t30064771178(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.042834:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8380 with x1876445617411968 ext(12582912->13631487) 00002000:00010000:0.0:1789518661.042843:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb0e8380 00000100:00100000:1.0:1789518661.048092:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.048209:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617412096 00000100:00100000:0.0:1789518661.048222:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617412096 00002000:00100000:0.0:1789518661.048277:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff99ffed933480 x1876445617412096/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.048286:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed933480 with x1876445617412096 ext(13631488->14680063) 00002000:00010000:0.0:1789518661.048292:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed933480 00000100:00100000:0.0:1789518661.048434:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 244 00000100:00100000:0.0:1789518661.048446:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2342:x1876445617412096:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.054881:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2342:x1876445617412096:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6423us (6789us total) trans 30064771179 rc 0/0 00000100:00100000:0.0:1789518661.054903:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 244 00002000:00100000:0.0:1789518661.054919:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff99ffed933480 x1876445617412096/t30064771179(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.054931:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed933480 with x1876445617412096 ext(13631488->14680063) 00002000:00010000:0.0:1789518661.054940:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed933480 00000100:00100000:2.0:1789518661.057799:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.057904:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.057989:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617412224 00000100:00100000:3.0:1789518661.057996:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617412480 00000100:00100000:0.0:1789518661.058003:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617412224 00000100:00100000:3.0:1789518661.058004:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617412480 00002000:00100000:0.0:1789518661.058065:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff99fecb0e8000 x1876445617412224/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1789518661.058068:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00002000:00100000:0.0:1789518661.058078:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8000 with x1876445617412224 ext(14680064->15728639) 00000100:00100000:3.0:1789518661.058079:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:36674:x1876445617412480:12345-192.168.206.51@tcp:35:dd.0 00002000:00010000:0.0:1789518661.058084:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb0e8000 00000100:00100000:0.0:1789518661.058149:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 245 00000100:00100000:0.0:1789518661.058157:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2343:x1876445617412224:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518661.058880:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:36674:x1876445617412480:12345-192.168.206.51@tcp:35:dd.0 Request processed in 799us (1089us total) trans 30064771397 rc 0/0 00000100:00100000:2.0:1789518661.058890:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:0.0:1789518661.064137:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2343:x1876445617412224:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5965us (6218us total) trans 30064771180 rc 0/0 00000100:00100000:0.0:1789518661.064153:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 245 00002000:00100000:0.0:1789518661.064170:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff99fecb0e8000 x1876445617412224/t30064771180(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.064182:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8000 with x1876445617412224 ext(14680064->15728639) 00002000:00010000:0.0:1789518661.064190:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fecb0e8000 00000100:00100000:1.0:1789518661.067130:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.067225:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617412736 00000100:00100000:0.0:1789518661.067241:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617412736 00000100:00100000:0.0:1789518661.067311:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 362 00000100:00100000:0.0:1789518661.067321:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:36676:x1876445617412736:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1789518661.067365:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518661.067393:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c786c64 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdec8 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.067555:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.067572:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.067587:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.067603:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.067611:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.067652:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518661.068190:0:35845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xca:0x0], index 1: 0 00010000:00010000:0.0:1789518661.068354:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786c79 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068365:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786c79 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068372:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786c79 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068418:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068426:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068433:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068439:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28c600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518661.068444:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068451:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068463:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:0.0:1789518661.068466:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518661.068471:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068476:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c786c6b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518661.068491:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f2ef7da reply state 00000000a44df50d transno 30064771398 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518661.068500:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518661.068530:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c786c64 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdec8 expref: 35 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068549:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786c79 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdec8 expref: 34 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.068556:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:0.0:1789518661.068559:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518661.068561:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28dc00, rc 0) 00000100:00100000:0.0:1789518661.068679:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:36676:x1876445617412736:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1359us (1561us total) trans 30064771398 rc 0/0 00000100:00100000:0.0:1789518661.068687:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 362 00010000:00010000:1.0:1789518661.071474:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.071741:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.071772:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.071779:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518661.071785:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.071793:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.071810:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff99ffc2d97d00) 00010000:00010000:1.0:1789518661.071814:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518661.071820:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.071827:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c786c72 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518661.074086:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518661.074198:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617412864 00000100:00100000:3.0:1789518661.074211:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617412864 00000100:00080000:0.0:1789518661.074371:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518661.074441:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1789518661.074453:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:36676:x1876445617412864:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518661.074477:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518661.074503:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c786c87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdecf expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789518661.074536:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789518661.074563:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xca:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1789518661.074568:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518661.074580:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c786c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdecf expref: 11 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518661.074600:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008db14de8/0x631fd8698c786c87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdecf expref: 11 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518661.074652:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b17400, rc 0) 00000100:00100000:3.0:1789518661.074724:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:36676:x1876445617412864:12345-192.168.206.51@tcp:101:dd.0 Request processed in 273us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518661.074749:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:2.0:1789518661.090187:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.090521:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617412992 00000100:00100000:0.0:1789518661.090534:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617412992 00002000:00100000:0.0:1789518661.090600:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff99fecb0ea680 x1876445617412992/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.090667:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0ea680 with x1876445617412992 ext(0->1048575) 00002000:00010000:0.0:1789518661.090675:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0ea680 00000100:00100000:0.0:1789518661.090705:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 246 00000100:00100000:0.0:1789518661.090716:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617412992:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518661.101474:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518661.101658:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617413120 00000100:00100000:3.0:1789518661.101669:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617413120 00002000:00100000:3.0:1789518661.101720:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff99ffed932a00 x1876445617413120/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.101730:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed932a00 with x1876445617413120 ext(1048576->2097151) 00002000:00010000:3.0:1789518661.101736:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed932a00 00000100:00100000:3.0:1789518661.101771:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 247 00000100:00100000:3.0:1789518661.101780:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617413120:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.104944:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617412992:12345-192.168.206.51@tcp:4:dd.0 Request processed in 14215us (14756us total) trans 30064771233 rc 0/0 00000100:00100000:0.0:1789518661.104962:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 246 00002000:00100000:0.0:1789518661.104979:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff99fecb0ea680 x1876445617412992/t30064771233(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.104992:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0ea680 with x1876445617412992 ext(0->1048575) 00002000:00010000:0.0:1789518661.105002:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0ea680 00000100:00100000:0.0:1789518661.107471:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617413120:12345-192.168.206.51@tcp:4:dd.0 Request processed in 5678us (5997us total) trans 30064771234 rc 0/0 00000100:00100000:0.0:1789518661.107496:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 247 00002000:00100000:0.0:1789518661.107561:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff99ffed932a00 x1876445617413120/t30064771234(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.107574:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed932a00 with x1876445617413120 ext(1048576->2097151) 00002000:00010000:0.0:1789518661.107581:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed932a00 00000100:00100000:2.0:1789518661.112895:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.113041:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617413248 00000100:00100000:0.0:1789518661.113054:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617413248 00002000:00100000:0.0:1789518661.113119:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff99fecb0e9f80 x1876445617413248/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.113132:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e9f80 with x1876445617413248 ext(2097152->3145727) 00002000:00010000:0.0:1789518661.113139:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e9f80 00000100:00100000:1.0:1789518661.113219:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 248 00000100:00100000:1.0:1789518661.113233:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617413248:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.119872:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617413248:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6628us (6975us total) trans 30064771235 rc 0/0 00000100:00100000:0.0:1789518661.119888:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 248 00002000:00100000:0.0:1789518661.119903:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff99fecb0e9f80 x1876445617413248/t30064771235(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.119914:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e9f80 with x1876445617413248 ext(2097152->3145727) 00002000:00010000:0.0:1789518661.119922:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e9f80 00000100:00100000:1.0:1789518661.125170:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.125284:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617413376 00000100:00100000:2.0:1789518661.125295:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617413376 00002000:00100000:2.0:1789518661.125352:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff99ffed931500 x1876445617413376/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.125372:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931500 with x1876445617413376 ext(3145728->4194303) 00002000:00010000:2.0:1789518661.125379:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed931500 00000100:00100000:2.0:1789518661.125742:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 249 00000100:00100000:2.0:1789518661.125756:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617413376:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.134344:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2342:x1876445617413376:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8569us (9166us total) trans 30064771236 rc 0/0 00000100:00100000:0.0:1789518661.134365:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 249 00002000:00100000:0.0:1789518661.134384:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff99ffed931500 x1876445617413376/t30064771236(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.134395:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931500 with x1876445617413376 ext(3145728->4194303) 00002000:00010000:0.0:1789518661.134415:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed931500 00000100:00100000:2.0:1789518661.137096:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.137350:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617413504 00000100:00100000:0.0:1789518661.137364:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617413504 00002000:00100000:0.0:1789518661.137441:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff99fecb0eb100 x1876445617413504/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.137454:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0eb100 with x1876445617413504 ext(4194304->5242879) 00002000:00010000:0.0:1789518661.137461:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0eb100 00000100:00100000:0.0:1789518661.137506:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00100000:0.0:1789518661.137520:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2343:x1876445617413504:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.148261:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617413504:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10726us (11160us total) trans 30064771237 rc 0/0 00000100:00100000:0.0:1789518661.148281:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 250 00002000:00100000:0.0:1789518661.148299:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff99fecb0eb100 x1876445617413504/t30064771237(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.148311:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0eb100 with x1876445617413504 ext(4194304->5242879) 00002000:00010000:0.0:1789518661.148321:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0eb100 00000100:00100000:3.0:1789518661.148323:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.148368:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617413632 00000100:00100000:0.0:1789518661.148378:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617413632 00002000:00100000:0.0:1789518661.148431:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff99fffc5f0a80 x1876445617413632/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.148441:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f0a80 with x1876445617413632 ext(5242880->6291455) 00002000:00010000:0.0:1789518661.148446:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f0a80 00000100:00100000:0.0:1789518661.148474:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 251 00000100:00100000:0.0:1789518661.148485:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617413632:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.159053:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2343:x1876445617413632:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10554us (10717us total) trans 30064771238 rc 0/0 00000100:00100000:0.0:1789518661.159069:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 251 00002000:00100000:0.0:1789518661.159085:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff99fffc5f0a80 x1876445617413632/t30064771238(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.159097:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffc5f0a80 with x1876445617413632 ext(5242880->6291455) 00002000:00010000:0.0:1789518661.159105:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fffc5f0a80 00000100:00100000:2.0:1789518661.160178:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.160420:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617413760 00000100:00100000:0.0:1789518661.160433:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617413760 00002000:00100000:0.0:1789518661.160489:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff99fecb0ead80 x1876445617413760/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.160501:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0ead80 with x1876445617413760 ext(6291456->7340031) 00002000:00010000:0.0:1789518661.160507:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0ead80 00000100:00100000:0.0:1789518661.160779:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 252 00000100:00100000:0.0:1789518661.160792:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2344:x1876445617413760:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.167720:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2344:x1876445617413760:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6915us (7587us total) trans 30064771239 rc 0/0 00000100:00100000:0.0:1789518661.167738:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 252 00002000:00100000:0.0:1789518661.167754:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff99fecb0ead80 x1876445617413760/t30064771239(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.167772:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0ead80 with x1876445617413760 ext(6291456->7340031) 00002000:00010000:0.0:1789518661.167780:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0ead80 00000100:00100000:1.0:1789518661.171513:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.171666:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617413888 00000100:00100000:0.0:1789518661.171678:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617413888 00002000:00100000:0.0:1789518661.172102:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff99ffc52be300 x1876445617413888/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.172116:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52be300 with x1876445617413888 ext(7340032->8388607) 00002000:00010000:0.0:1789518661.172124:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52be300 00000100:00100000:0.0:1789518661.172212:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 253 00000100:00100000:0.0:1789518661.172224:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2343:x1876445617413888:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.183314:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2343:x1876445617413888:12345-192.168.206.51@tcp:4:dd.0 Request processed in 11076us (11798us total) trans 30064771240 rc 0/0 00000100:00100000:0.0:1789518661.183339:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 253 00002000:00100000:0.0:1789518661.183356:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff99ffc52be300 x1876445617413888/t30064771240(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.183367:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52be300 with x1876445617413888 ext(7340032->8388607) 00002000:00010000:0.0:1789518661.183375:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52be300 00000100:00100000:2.0:1789518661.187870:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.187980:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617414016 00000100:00100000:0.0:1789518661.187992:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617414016 00002000:00100000:0.0:1789518661.188058:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff99ffed744000 x1876445617414016/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.188070:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744000 with x1876445617414016 ext(8388608->9437183) 00002000:00010000:0.0:1789518661.188078:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed744000 00000100:00100000:0.0:1789518661.188231:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 254 00000100:00100000:0.0:1789518661.188244:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2343:x1876445617414016:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.196562:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2343:x1876445617414016:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8308us (8696us total) trans 30064771241 rc 0/0 00000100:00100000:0.0:1789518661.196574:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 254 00002000:00100000:0.0:1789518661.196782:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff99ffed744000 x1876445617414016/t30064771241(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.196791:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744000 with x1876445617414016 ext(8388608->9437183) 00002000:00010000:0.0:1789518661.196798:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed744000 00000100:00100000:1.0:1789518661.198041:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.198144:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617414144 00000100:00100000:0.0:1789518661.198154:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617414144 00002000:00100000:0.0:1789518661.198207:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff99ffc52bc380 x1876445617414144/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.198219:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bc380 with x1876445617414144 ext(9437184->10485759) 00002000:00010000:0.0:1789518661.198225:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52bc380 00000100:00100000:0.0:1789518661.198438:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 255 00000100:00100000:0.0:1789518661.198449:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617414144:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.205061:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2342:x1876445617414144:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6591us (7006us total) trans 30064771242 rc 0/0 00000100:00100000:0.0:1789518661.205078:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 255 00002000:00100000:0.0:1789518661.205094:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff99ffc52bc380 x1876445617414144/t30064771242(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.205106:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bc380 with x1876445617414144 ext(9437184->10485759) 00002000:00010000:0.0:1789518661.205115:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52bc380 00000100:00100000:2.0:1789518661.211304:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.211544:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617414272 00000100:00100000:0.0:1789518661.211558:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617414272 00002000:00100000:0.0:1789518661.211776:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff99ffed746680 x1876445617414272/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.211790:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed746680 with x1876445617414272 ext(10485760->11534335) 00002000:00010000:0.0:1789518661.211798:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed746680 00000100:00100000:0.0:1789518661.211886:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 256 00000100:00100000:0.0:1789518661.211898:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2343:x1876445617414272:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.218099:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2343:x1876445617414272:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6195us (6801us total) trans 30064771243 rc 0/0 00000100:00100000:0.0:1789518661.218354:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 256 00002000:00100000:0.0:1789518661.218366:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff99ffed746680 x1876445617414272/t30064771243(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.218375:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed746680 with x1876445617414272 ext(10485760->11534335) 00002000:00010000:0.0:1789518661.218382:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed746680 00000100:00100000:2.0:1789518661.224094:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.224291:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617414400 00000100:00100000:0.0:1789518661.224304:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617414400 00002000:00100000:0.0:1789518661.224379:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff99ffed747100 x1876445617414400/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.224393:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed747100 with x1876445617414400 ext(11534336->12582911) 00002000:00010000:0.0:1789518661.224495:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed747100 00000100:00100000:0.0:1789518661.224575:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 257 00000100:00100000:0.0:1789518661.224588:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2342:x1876445617414400:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.233279:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2342:x1876445617414400:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8677us (9181us total) trans 30064771244 rc 0/0 00000100:00100000:0.0:1789518661.233297:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 257 00002000:00100000:0.0:1789518661.233314:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff99ffed747100 x1876445617414400/t30064771244(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.233326:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed747100 with x1876445617414400 ext(11534336->12582911) 00002000:00010000:0.0:1789518661.233334:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed747100 00000100:00100000:1.0:1789518661.234793:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.234906:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617414528 00000100:00100000:2.0:1789518661.234919:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617414528 00002000:00100000:2.0:1789518661.234969:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff99ffc52bca80 x1876445617414528/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.234982:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bca80 with x1876445617414528 ext(12582912->13631487) 00002000:00010000:2.0:1789518661.234999:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52bca80 00000100:00100000:2.0:1789518661.235038:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 258 00000100:00100000:2.0:1789518661.235048:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2343:x1876445617414528:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.235064:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627665792:0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.235128:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518661.235189:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627666304:0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.235227:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518661.235255:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789518661.235263:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627665664:0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.235309:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518661.235343:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627665664 00000100:00100000:0.0:1789518661.235348:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627666176:0@lo:400:kworker.0 00000100:00100000:2.0:1789518661.235349:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627665664 00000100:00100000:0.0:1789518661.235379:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518661.235386:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789518661.235395:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627665664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.235431:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627665920:0@lo:400:kworker.0 00000100:00100000:2.0:1789518661.235459:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627665664:12345-0@lo:400:kworker.0 Request processed in 65us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518661.235467:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518661.235472:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789518661.235510:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518661.235517:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fed35f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627666048:0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.235555:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518661.235585:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627666304 00000100:00100000:1.0:1789518661.235590:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627666304 00000100:00100000:0.0:1789518661.235607:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627665792 00000100:00100000:0.0:1789518661.235644:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627665792 00000100:00100000:1.0:1789518661.235667:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627666176 00000100:00100000:1.0:1789518661.235672:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627666176 00000100:00100000:0.0:1789518661.235682:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627665920 00000100:00100000:0.0:1789518661.235688:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627665920 00000100:00100000:1.0:1789518661.235700:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627666048 00000100:00100000:1.0:1789518661.235705:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627666048 00000100:00100000:0.0:1789518661.235721:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789518661.235730:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789518661.235733:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627665792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518661.235743:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627666304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518661.235792:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627666304:12345-0@lo:400:kworker.0 Request processed in 53us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518661.235799:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627665792:12345-0@lo:400:kworker.0 Request processed in 69us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518661.235800:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789518661.235812:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789518661.235822:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518661.235830:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627666176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.235847:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518661.235861:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627665920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518661.235865:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627666176:12345-0@lo:400:kworker.0 Request processed in 34us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518661.235873:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518661.235888:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789518661.235896:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627666048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.235906:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627665920:12345-0@lo:400:kworker.0 Request processed in 51us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518661.235913:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789518661.235935:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627666048:12345-0@lo:400:kworker.0 Request processed in 39us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518661.235941:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789518661.236003:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627666048:0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.236016:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771220 gen 2 00000004:00080000:0.0:1789518661.236022:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771220 committed transno 30064771220 00000100:00100000:0.0:1789518661.236046:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fec8340a80 x1876445627665408/t30064771231(30064771231) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518676 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518661.236058:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627665920:0@lo:400:kworker.0 00000100:00080000:2.0:1789518661.236086:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518661.236087:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627665664:0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.236104:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627666176:0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.236115:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627665792:0@lo:400:kworker.0 00000100:00100000:0.0:1789518661.236123:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fed35f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627666304:0@lo:400:kworker.0 00000100:00100000:1.0:1789518661.236547:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518661.236560:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffc5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627666432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518661.236600:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518661.237069:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627666432 00000100:00100000:2.0:1789518661.237077:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627666432 00000100:00100000:2.0:1789518661.237127:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789518661.237137:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627666432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518661.237158:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 299827200 pending 22151168 free 3725590528 avail 3723493376 00000100:00100000:2.0:1789518661.237679:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627666432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 539us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518661.237687:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789518661.237794:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffc5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627666432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518661.243000:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2343:x1876445617414528:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7930us (8194us total) trans 30064771245 rc 0/0 00000100:00100000:3.0:1789518661.243018:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 258 00002000:00100000:3.0:1789518661.243034:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff99ffc52bca80 x1876445617414528/t30064771245(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.243046:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bca80 with x1876445617414528 ext(12582912->13631487) 00002000:00010000:3.0:1789518661.243054:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52bca80 00000100:00100000:2.0:1789518661.249139:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.249336:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617414656 00000100:00100000:0.0:1789518661.249351:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617414656 00002000:00100000:0.0:1789518661.249429:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff99ffed747480 x1876445617414656/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.249444:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed747480 with x1876445617414656 ext(13631488->14680063) 00002000:00010000:0.0:1789518661.249451:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed747480 00000100:00100000:0.0:1789518661.249529:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 259 00000100:00100000:0.0:1789518661.249542:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2342:x1876445617414656:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518661.258395:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2342:x1876445617414656:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8839us (9435us total) trans 30064771246 rc 0/0 00000100:00100000:3.0:1789518661.258424:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 259 00002000:00100000:3.0:1789518661.258439:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff99ffed747480 x1876445617414656/t30064771246(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.258451:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed747480 with x1876445617414656 ext(13631488->14680063) 00002000:00010000:3.0:1789518661.258476:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed747480 00000100:00100000:1.0:1789518661.259527:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518661.259633:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.259711:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617415040 00000100:00100000:2.0:1789518661.259722:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617415040 00002000:00100000:2.0:1789518661.259773:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff99ffc52bea00 x1876445617415040/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.259784:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bea00 with x1876445617415040 ext(14680064->15728639) 00002000:00010000:2.0:1789518661.259790:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52bea00 00000100:00100000:2.0:1789518661.259825:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 260 00000100:00100000:2.0:1789518661.259835:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617415040:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518661.260608:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617414912 00000100:00100000:0.0:1789518661.260689:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617414912 00000100:00100000:0.0:1789518661.260787:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:0.0:1789518661.260797:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:36676:x1876445617414912:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:0.0:1789518661.261422:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:36676:x1876445617414912:12345-192.168.206.51@tcp:35:dd.0 Request processed in 623us (1899us total) trans 30064771399 rc 0/0 00000100:00100000:0.0:1789518661.261431:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1789518661.272179:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2343:x1876445617415040:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12332us (12553us total) trans 30064771247 rc 0/0 00000100:00100000:2.0:1789518661.272195:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 260 00002000:00100000:2.0:1789518661.272211:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff99ffc52bea00 x1876445617415040/t30064771247(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/448 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.272223:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bea00 with x1876445617415040 ext(14680064->15728639) 00002000:00010000:2.0:1789518661.272230:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc52bea00 00000100:00100000:3.0:1789518661.276324:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.277060:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617415168 00000100:00100000:0.0:1789518661.277074:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617415168 00000100:00100000:0.0:1789518661.277309:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 363 00000100:00100000:0.0:1789518661.277323:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:36677:x1876445617415168:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:0.0:1789518661.277356:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518661.277381:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786c8e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfded6 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.277440:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786c95 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.277458:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786c95 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.277472:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786c95 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.277605:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786c8e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfded6 expref: 37 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.277684:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d000/0x631fd8698c786c95 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfded6 expref: 36 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.277694:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:0.0:1789518661.277698:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518661.277702:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d000, rc 0) 00000100:00100000:0.0:1789518661.277770:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:36677:x1876445617415168:12345-192.168.206.51@tcp:101:chown.0 Request processed in 451us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518661.277778:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 363 00000100:00100000:1.0:1789518661.281216:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.281342:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617415424 00000100:00100000:0.0:1789518661.281357:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617415424 00000100:00100000:0.0:1789518661.281441:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 364 00000100:00100000:0.0:1789518661.281453:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:36677:x1876445617415424:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:0.0:1789518661.281524:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518661.281560:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6400/0x631fd8698c786c4f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeba expref: 36 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.281584:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:0.0:1789518661.281589:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518661.281754:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.281772:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.281784:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518661.284666:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].13, 88 off9168 00000004:00080000:0.0:1789518661.284687:0:39157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 715281072019ns, next at 716281067758ns, rc = 0 00000004:00010000:0.0:1789518661.284795:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cbf1642 reply state 00000000908f030e transno 30064771400 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518661.284808:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518661.284964:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:36677:x1876445617415424:12345-192.168.206.51@tcp:36:chown.0 Request processed in 3508us (3758us total) trans 30064771400 rc 0/0 00000100:00100000:0.0:1789518661.284977:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 364 00010000:00010000:0.0:1789518661.287707:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.287730:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.287740:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.287748:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518661.287753:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.287763:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.287785:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:0.0:1789518661.287788:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789518661.287795:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.287802:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786c9c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518661.289869:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.289939:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617415552 00000100:00100000:0.0:1789518661.289952:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617415552 00000100:00100000:0.0:1789518661.290030:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 365 00000100:00100000:0.0:1789518661.290041:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:36677:x1876445617415552:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:0.0:1789518661.290071:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518661.290094:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ca3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdedd expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.290173:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ca3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdedd expref: 37 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.290190:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ca3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdedd expref: 37 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.290215:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:0.0:1789518661.290219:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518661.290222:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28da00, rc 0) 00000100:00100000:0.0:1789518661.290301:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:36677:x1876445617415552:12345-192.168.206.51@tcp:101:chown.0 Request processed in 261us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518661.290308:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 365 00000100:00100000:1.0:1789518661.292584:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.293658:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617415680 00000100:00100000:2.0:1789518661.293673:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617415680 00000100:00100000:2.0:1789518661.293977:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:2.0:1789518661.293990:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2345:x1876445617415680:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:2.0:1789518661.294260:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1789518661.294265:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb mtime from disk: 0 -> 1789518661 00002000:00010000:2.0:1789518661.294267:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518661.294269:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb ctime from disk: 0 -> 1789518661 00002000:00010000:2.0:1789518661.294272:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518661.294416:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2345:x1876445617415680:12345-192.168.206.51@tcp:2:chown.0 Request processed in 427us (1842us total) trans 30064771181 rc 0/0 00000100:00100000:2.0:1789518661.294425:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:3.0:1789518661.311756:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.311886:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617415808 00000100:00100000:0.0:1789518661.311900:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617415808 00000100:00100000:0.0:1789518661.311973:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 366 00000100:00100000:0.0:1789518661.311986:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:36678:x1876445617415808:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:0.0:1789518661.312022:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518661.312049:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786caa lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdee4 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.312097:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786cb1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.312113:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786cb1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.312128:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786cb1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.312256:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786caa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdee4 expref: 39 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.312279:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c400/0x631fd8698c786cb1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdee4 expref: 38 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.312289:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:0.0:1789518661.312293:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518661.312297:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c400, rc 0) 00000100:00100000:0.0:1789518661.312729:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:36678:x1876445617415808:12345-192.168.206.51@tcp:101:chown.0 Request processed in 743us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518661.312738:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 366 00000100:00100000:1.0:1789518661.320384:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.320466:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617416064 00000100:00100000:0.0:1789518661.320479:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617416064 00000100:00100000:0.0:1789518661.320558:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 367 00000100:00100000:0.0:1789518661.320571:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:36678:x1876445617416064:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:0.0:1789518661.320810:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518661.320846:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786c79 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdec8 expref: 38 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.320871:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:0.0:1789518661.320877:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518661.320918:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.320935:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.320946:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518661.323387:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].13, 88 off9240 00000004:00080000:0.0:1789518661.323420:0:39157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 715319805176ns, next at 716319800564ns, rc = 0 00000004:00010000:0.0:1789518661.323544:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002210f94 reply state 00000000607a76c8 transno 30064771401 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518661.323559:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518661.323742:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:36678:x1876445617416064:12345-192.168.206.51@tcp:36:chown.0 Request processed in 3167us (3366us total) trans 30064771401 rc 0/0 00000100:00100000:0.0:1789518661.323753:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 367 00010000:00010000:1.0:1789518661.327368:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.327392:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.327411:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.327419:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518661.327424:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.327434:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.327453:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:1.0:1789518661.327456:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789518661.327461:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.327468:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786cb8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518661.328778:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.329717:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617416192 00000100:00100000:0.0:1789518661.329731:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617416192 00000100:00100000:0.0:1789518661.329806:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 368 00000100:00100000:0.0:1789518661.329815:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:36678:x1876445617416192:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:0.0:1789518661.329848:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518661.329873:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786cbf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdeeb expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.329953:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786cbf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeeb expref: 39 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.329970:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786cbf lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeeb expref: 39 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.329993:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:0.0:1789518661.329996:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518661.330001:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28dc00, rc 0) 00000100:00100000:0.0:1789518661.330150:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:36678:x1876445617416192:12345-192.168.206.51@tcp:101:chown.0 Request processed in 334us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518661.330157:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 368 00000100:00100000:0.0:1789518661.332578:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.332827:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617416320 00000100:00100000:2.0:1789518661.332840:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617416320 00000100:00100000:2.0:1789518661.332962:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:2.0:1789518661.332975:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2343:x1876445617416320:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:2.0:1789518661.333240:0:36532:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1789518661.333245:0:36532:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb mtime from disk: 0 -> 1789518661 00002000:00010000:2.0:1789518661.333248:0:36532:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518661.333250:0:36532:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb ctime from disk: 0 -> 1789518661 00002000:00010000:2.0:1789518661.333252:0:36532:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518661.333351:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617416320:12345-192.168.206.51@tcp:2:chown.0 Request processed in 377us (786us total) trans 30064771248 rc 0/0 00000100:00100000:2.0:1789518661.333365:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:3.0:1789518661.377100:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518661.377268:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617416448 00000100:00100000:1.0:1789518661.377280:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617416448 00000100:00100000:1.0:1789518661.377338:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 369 00000100:00100000:1.0:1789518661.377347:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:36684:x1876445617416448:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518661.377386:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518661.377425:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786cc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdef2 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.377509:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786ccd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.377522:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786ccd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.377532:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786ccd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518661.377567:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00000004:00200000:1.0:1789518661.377570:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518661.377587:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786ccd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.377610:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c7800/0x631fd8698c786cc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdef2 expref: 41 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.377711:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a00021c6a00/0x631fd8698c786ccd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdef2 expref: 40 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.377717:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:1.0:1789518661.377719:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518661.377722:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a00021c6a00, rc 0) 00000100:00100000:1.0:1789518661.377973:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:36684:x1876445617416448:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 626us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518661.378004:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 369 00000100:00100000:1.0:1789518661.381321:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.381433:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617416576 00000100:00100000:0.0:1789518661.381447:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617416576 00000100:00100000:0.0:1789518661.381662:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 370 00000100:00100000:0.0:1789518661.381675:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:36684:x1876445617416576:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:0.0:1789518661.381704:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518661.381731:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786cd4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdef9 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.381827:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.381847:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.381861:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.381879:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.381885:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.381892:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382038:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ce9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382048:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ce9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382056:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ce9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518661.382099:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00000004:00200000:0.0:1789518661.382105:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518661.382129:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ce9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382141:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ce9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382155:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382168:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382174:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382179:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518661.382183:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382189:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382203:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:0.0:1789518661.382207:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518661.382213:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382220:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c786cdb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382239:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382246:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382252:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382258:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518661.382261:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382267:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382275:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518661.382277:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518661.382280:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382285:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786ce2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382321:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c000/0x631fd8698c786cd4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdef9 expref: 42 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382334:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ce9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdef9 expref: 41 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.382339:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:0.0:1789518661.382341:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518661.382343:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d800, rc 0) 00000100:00100000:0.0:1789518661.382428:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:36684:x1876445617416576:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 755us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518661.382436:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 370 00000100:00100000:0.0:1789518661.385780:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518661.385915:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617416832 00000100:00100000:3.0:1789518661.385925:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617416832 00000100:00100000:3.0:1789518661.386036:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 371 00000100:00100000:3.0:1789518661.386061:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:36684:x1876445617416832:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518661.386087:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518661.386211:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786cf0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf00 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518661.386345:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786cf7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518661.386362:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786cf7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518661.386375:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786cf7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518661.386387:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00010000:00010000:3.0:1789518661.386574:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786cf0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf00 expref: 44 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518661.386596:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786cf7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf00 expref: 43 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518661.386605:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:3.0:1789518661.386926:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518661.386931:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:3.0:1789518661.387101:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:36684:x1876445617416832:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 1052us (1332us total) trans 30064771402 rc 0/0 00000100:00100000:3.0:1789518661.387110:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 371 00000100:00100000:3.0:1789518661.393328:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518661.393459:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617416960 00000100:00100000:1.0:1789518661.393473:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617416960 00000100:00100000:1.0:1789518661.393555:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:1.0:1789518661.393566:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2344:x1876445617416960:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518661.393586:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789518661.393858:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518661.393876:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786cf7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf00 expref: 43 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.393899:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:1.0:1789518661.393905:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518661.393966:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617417216 00000100:00100000:2.0:1789518661.393971:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617417216 00000100:00100000:1.0:1789518661.393993:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2344:x1876445617416960:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 429us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518661.394001:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:2.0:1789518661.394184:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 372 00000100:00100000:2.0:1789518661.394195:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:36684:x1876445617417216:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518661.394219:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518661.394222:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1789518661.394236:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786ca3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdedd expref: 42 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394254:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d800/0x631fd8698c786ce9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdef9 expref: 41 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394262:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:2.0:1789518661.394265:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518661.394282:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c786d05 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf07 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394324:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394340:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394354:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394376:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394384:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394391:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394409:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14da00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518661.394415:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394422:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394431:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:2.0:1789518661.394434:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518661.394438:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394444:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c786d0c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394471:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d200/0x631fd8698c786d13 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394480:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d200/0x631fd8698c786d13 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394487:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d200/0x631fd8698c786d13 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394848:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d200/0x631fd8698c786d13 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf07 expref: 43 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394859:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:2.0:1789518661.394861:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518661.394871:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c786d05 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf07 expref: 43 pid: 35846 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394888:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d200/0x631fd8698c786d13 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf07 expref: 42 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.394926:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:2.0:1789518661.394929:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518661.394932:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14d200, rc 0) 00000100:00100000:2.0:1789518661.394988:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:36684:x1876445617417216:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 794us (1129us total) trans 30064771403 rc 0/0 00000100:00100000:2.0:1789518661.394996:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 372 00000100:00100000:0.0:1789518661.416790:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518661.416951:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617417344 00000100:00100000:3.0:1789518661.416963:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617417344 00002000:00100000:3.0:1789518661.417021:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff99fed35f0700 x1876445617417344/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.417033:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f0700 with x1876445617417344 ext(0->1048575) 00002000:00010000:3.0:1789518661.417041:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f0700 00000100:00100000:3.0:1789518661.417221:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 261 00000100:00100000:3.0:1789518661.417231:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617417344:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518661.434411:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617417344:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 17162us (17710us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789518661.434425:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 261 00002000:00100000:3.0:1789518661.434437:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff99fed35f0700 x1876445617417344/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.434448:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f0700 with x1876445617417344 ext(0->1048575) 00002000:00010000:3.0:1789518661.434455:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f0700 00000100:00100000:3.0:1789518661.458303:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.458422:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617417472 00000100:00100000:0.0:1789518661.458433:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617417472 00002000:00100000:0.0:1789518661.458710:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff99fffbb82680 x1876445617417472/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.458723:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb82680 with x1876445617417472 ext(1048576->2097151) 00002000:00010000:0.0:1789518661.458730:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb82680 00000100:00100000:0.0:1789518661.458766:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 262 00000100:00100000:0.0:1789518661.458777:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2342:x1876445617417472:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:0.0:1789518661.490394:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2342:x1876445617417472:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 31609us (32192us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518661.490418:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 262 00002000:00100000:0.0:1789518661.490431:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff99fffbb82680 x1876445617417472/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.490441:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb82680 with x1876445617417472 ext(1048576->2097151) 00002000:00010000:0.0:1789518661.490448:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb82680 00010000:00010000:2.0:1789518661.491036:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518661.511927:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.512053:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617417600 00000100:00100000:2.0:1789518661.512063:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617417600 00002000:00100000:2.0:1789518661.512110:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff99fffbb81f80 x1876445617417600/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.512121:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb81f80 with x1876445617417600 ext(2097152->3145727) 00002000:00010000:2.0:1789518661.512127:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb81f80 00000100:00100000:2.0:1789518661.512165:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 263 00000100:00100000:2.0:1789518661.512175:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617417600:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518661.515417:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.515541:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617417728 00000100:00100000:0.0:1789518661.515551:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617417728 00002000:00100000:0.0:1789518661.515597:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff99ffed745f80 x1876445617417728/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.515608:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745f80 with x1876445617417728 ext(3145728->4194303) 00002000:00010000:0.0:1789518661.515630:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745f80 00000100:00100000:0.0:1789518661.515699:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 264 00000100:00100000:0.0:1789518661.515709:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2342:x1876445617417728:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518661.528648:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2343:x1876445617417600:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 16440us (16697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518661.528662:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 263 00002000:00100000:2.0:1789518661.528676:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff99fffbb81f80 x1876445617417600/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.528693:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb81f80 with x1876445617417600 ext(2097152->3145727) 00002000:00010000:2.0:1789518661.528701:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb81f80 00000100:00100000:1.0:1789518661.539082:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2342:x1876445617417728:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 23362us (23670us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.539107:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 264 00002000:00100000:1.0:1789518661.539119:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff99ffed745f80 x1876445617417728/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.539130:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745f80 with x1876445617417728 ext(3145728->4194303) 00002000:00010000:1.0:1789518661.539136:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745f80 00000100:00100000:3.0:1789518661.568135:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.569294:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617417856 00000100:00100000:0.0:1789518661.569307:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617417856 00002000:00100000:0.0:1789518661.569362:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff99fffbb83800 x1876445617417856/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.569374:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb83800 with x1876445617417856 ext(4194304->5242879) 00002000:00010000:0.0:1789518661.569381:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb83800 00000100:00100000:0.0:1789518661.569433:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 265 00000100:00100000:0.0:1789518661.569443:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617417856:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518661.571014:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.571314:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.572882:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518661.573709:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617417984 00000100:00100000:3.0:1789518661.573731:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617417984 00000100:00100000:1.0:1789518661.573887:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617418112 00000100:00100000:1.0:1789518661.573893:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617418112 00002000:00100000:1.0:1789518661.573950:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff99ffed745c00 x1876445617418112/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.573970:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745c00 with x1876445617418112 ext(6291456->7340031) 00002000:00010000:1.0:1789518661.573977:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745c00 00000100:00100000:1.0:1789518661.574000:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617418240 00000100:00100000:1.0:1789518661.574004:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617418240 00002000:00100000:1.0:1789518661.574022:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff99ffed744a80 x1876445617418240/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.574031:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744a80 with x1876445617418240 ext(7340032->8388607) 00002000:00010000:1.0:1789518661.574034:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed744a80 00000100:00100000:1.0:1789518661.574045:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 266 00000100:00100000:1.0:1789518661.574054:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2343:x1876445617418112:12345-192.168.206.51@tcp:3:lfs.0 00002000:00100000:2.0:1789518661.577750:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff99ffed745180 x1876445617417984/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.577774:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745180 with x1876445617417984 ext(5242880->6291455) 00002000:00010000:2.0:1789518661.577782:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745180 00000100:00100000:2.0:1789518661.577817:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 267 00000100:00100000:2.0:1789518661.577829:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2342:x1876445617418240:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518661.592547:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2343:x1876445617417856:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 23093us (24411us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518661.592563:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 265 00002000:00100000:2.0:1789518661.592581:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff99fffbb83800 x1876445617417856/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.592591:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fffbb83800 with x1876445617417856 ext(4194304->5242879) 00002000:00010000:2.0:1789518661.592599:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fffbb83800 00000100:00100000:2.0:1789518661.592657:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 268 00000100:00100000:2.0:1789518661.592671:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2342:x1876445617417984:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518661.597784:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2343:x1876445617418112:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 23718us (26458us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.597798:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 266 00002000:00100000:1.0:1789518661.597813:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff99ffed745c00 x1876445617418112/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.597824:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745c00 with x1876445617418112 ext(6291456->7340031) 00002000:00010000:1.0:1789518661.597840:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745c00 00000100:00100000:2.0:1789518661.603934:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2342:x1876445617418240:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 26097us (31049us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518661.603961:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 267 00002000:00100000:2.0:1789518661.603976:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff99ffed744a80 x1876445617418240/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.603987:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744a80 with x1876445617418240 ext(7340032->8388607) 00002000:00010000:2.0:1789518661.603994:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed744a80 00000100:00100000:2.0:1789518661.607049:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2342:x1876445617417984:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 14374us (36033us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518661.607061:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 268 00002000:00100000:2.0:1789518661.607073:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff99ffed745180 x1876445617417984/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.607082:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745180 with x1876445617417984 ext(5242880->6291455) 00002000:00010000:2.0:1789518661.607089:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745180 00000100:00100000:0.0:1789518661.654960:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518661.655165:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617418368 00000100:00100000:1.0:1789518661.655175:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617418368 00002000:00100000:1.0:1789518661.655221:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff99fed35f1500 x1876445617418368/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.655233:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f1500 with x1876445617418368 ext(8388608->9437183) 00002000:00010000:1.0:1789518661.655238:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f1500 00000100:00100000:1.0:1789518661.655288:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 269 00000100:00100000:1.0:1789518661.655298:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617418368:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518661.655844:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.656043:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617418496 00000100:00100000:0.0:1789518661.656060:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617418496 00002000:00100000:0.0:1789518661.656093:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff99ffed746a00 x1876445617418496/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.656103:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed746a00 with x1876445617418496 ext(9437184->10485759) 00002000:00010000:0.0:1789518661.656108:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed746a00 00000100:00100000:0.0:1789518661.656143:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 270 00000100:00100000:0.0:1789518661.656152:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2342:x1876445617418496:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518661.662427:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.662475:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.662597:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.662950:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518661.662972:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617418624 00000100:00100000:1.0:1789518661.662983:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617418624 00000100:00100000:3.0:1789518661.663003:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617418752 00000100:00100000:3.0:1789518661.663010:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617418752 00002000:00100000:1.0:1789518661.663029:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff99ffed744700 x1876445617418624/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.663041:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744700 with x1876445617418624 ext(10485760->11534335) 00002000:00010000:1.0:1789518661.663047:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed744700 00000100:00100000:1.0:1789518661.663062:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617418880 00000100:00100000:1.0:1789518661.663066:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617418880 00002000:00100000:1.0:1789518661.663081:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff99ffed746d80 x1876445617418880/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.663102:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed746d80 with x1876445617418880 ext(12582912->13631487) 00002000:00010000:1.0:1789518661.663106:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed746d80 00000100:00100000:1.0:1789518661.663120:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 271 00000100:00100000:1.0:1789518661.663128:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2343:x1876445617418624:12345-192.168.206.51@tcp:3:lfs.0 00002000:00100000:3.0:1789518661.663152:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff99ffed745880 x1876445617418752/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.663163:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745880 with x1876445617418752 ext(11534336->12582911) 00002000:00010000:3.0:1789518661.663167:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745880 00000100:00100000:2.0:1789518661.663870:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.664379:0:36537:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1789518661.664390:0:36537:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1789518661.664774:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617419008 00000100:00100000:2.0:1789518661.664782:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617419008 00002000:00100000:2.0:1789518661.664816:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff99ffed745500 x1876445617419008/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.664827:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745500 with x1876445617419008 ext(13631488->14680063) 00002000:00010000:2.0:1789518661.664832:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745500 00000100:00100000:2.0:1789518661.665378:0:36537:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789518661.665387:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617419136 00000100:00100000:2.0:1789518661.665392:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617419136 00002000:00100000:2.0:1789518661.665421:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff99ffed744e00 x1876445617419136/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.665430:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744e00 with x1876445617419136 ext(14680064->15728639) 00002000:00010000:2.0:1789518661.665434:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed744e00 00000100:00100000:3.0:1789518661.665951:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2343:x1876445617418368:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 10653us (11008us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518661.665951:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 272 00000100:00100000:0.0:1789518661.665961:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2343:x1876445617418880:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518661.665966:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 269 00002000:00100000:3.0:1789518661.665973:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff99fed35f1500 x1876445617418368/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.665980:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f1500 with x1876445617418368 ext(8388608->9437183) 00002000:00010000:3.0:1789518661.665984:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f1500 00000100:00100000:3.0:1789518661.666001:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 273 00000100:00100000:3.0:1789518661.666007:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2342:x1876445617418752:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:0.0:1789518661.671936:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2342:x1876445617418496:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 15775us (16084us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518661.671949:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 270 00002000:00100000:0.0:1789518661.672002:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff99ffed746a00 x1876445617418496/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.672013:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed746a00 with x1876445617418496 ext(9437184->10485759) 00002000:00010000:0.0:1789518661.672020:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed746a00 00000100:00100000:0.0:1789518661.672052:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:0.0:1789518661.672064:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2343:x1876445617419008:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518661.690771:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2343:x1876445617418624:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 27632us (28341us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.690785:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 271 00002000:00100000:1.0:1789518661.690800:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff99ffed744700 x1876445617418624/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.690811:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744700 with x1876445617418624 ext(10485760->11534335) 00002000:00010000:1.0:1789518661.690819:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed744700 00000100:00100000:1.0:1789518661.690851:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 275 00000100:00100000:1.0:1789518661.690873:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2343:x1876445617419136:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518661.698315:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2342:x1876445617418752:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 32296us (35827us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.698330:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 273 00002000:00100000:1.0:1789518661.698346:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff99ffed745880 x1876445617418752/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.698358:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745880 with x1876445617418752 ext(11534336->12582911) 00002000:00010000:1.0:1789518661.698366:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745880 00000100:00100000:0.0:1789518661.703733:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2343:x1876445617418880:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 37762us (41136us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518661.703745:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 272 00002000:00100000:0.0:1789518661.703759:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff99ffed746d80 x1876445617418880/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.703769:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed746d80 with x1876445617418880 ext(12582912->13631487) 00002000:00010000:0.0:1789518661.703776:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed746d80 00000100:00100000:0.0:1789518661.708844:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2343:x1876445617419008:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 36776us (45886us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518661.708856:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 274 00002000:00100000:0.0:1789518661.708868:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff99ffed745500 x1876445617419008/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.708877:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed745500 with x1876445617419008 ext(13631488->14680063) 00002000:00010000:0.0:1789518661.708884:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed745500 00000100:00100000:1.0:1789518661.718046:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617419136:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 27166us (54168us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.718058:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 275 00002000:00100000:1.0:1789518661.718070:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff99ffed744e00 x1876445617419136/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.718081:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed744e00 with x1876445617419136 ext(14680064->15728639) 00002000:00010000:1.0:1789518661.718087:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffed744e00 00000100:00100000:0.0:1789518661.746183:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.746259:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617419392 00000100:00100000:2.0:1789518661.746270:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617419392 00000100:00100000:2.0:1789518661.746328:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:2.0:1789518661.746338:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:36684:x1876445617419392:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:2.0:1789518661.746668:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:36684:x1876445617419392:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 331us (493us total) trans 30064771404 rc 0/0 00000100:00100000:2.0:1789518661.746675:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:2.0:1789518661.793926:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.794098:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617419520 00000100:00100000:0.0:1789518661.794113:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617419520 00000100:00100000:0.0:1789518661.794270:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 373 00000100:00100000:0.0:1789518661.794283:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:36690:x1876445617419520:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:0.0:1789518661.794434:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518661.794464:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63a00/0x631fd8698c786d1a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf0e expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794545:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794561:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794571:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794582:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794587:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794591:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794734:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62200/0x631fd8698c786d2f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794743:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62200/0x631fd8698c786d2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794749:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62200/0x631fd8698c786d2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518661.794781:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 15728640 00000004:00200000:0.0:1789518661.794785:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518661.794802:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62200/0x631fd8698c786d2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794812:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62200/0x631fd8698c786d2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794818:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794822:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794827:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794830:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed62e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518661.794834:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794840:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794849:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:0.0:1789518661.794851:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518661.794855:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794859:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62e00/0x631fd8698c786d21 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794874:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794878:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794882:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794885:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed63c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518661.794886:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794889:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794893:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518661.794894:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518661.794895:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794898:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63c00/0x631fd8698c786d28 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794922:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed63a00/0x631fd8698c786d1a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf0e expref: 45 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794931:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62200/0x631fd8698c786d2f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf0e expref: 44 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518661.794939:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:0.0:1789518661.794941:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518661.794943:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed62200, rc 0) 00000100:00100000:0.0:1789518661.795108:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:36690:x1876445617419520:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 823us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518661.795115:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 373 00000100:00100000:2.0:1789518661.799411:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518661.799861:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617419776 00000100:00100000:3.0:1789518661.799875:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617419776 00000100:00100000:2.0:1789518661.801137:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 374 00000100:00100000:2.0:1789518661.801152:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:36690:x1876445617419776:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518661.801180:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518661.801206:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c786d36 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf15 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.801348:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c786d3d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.801366:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c786d3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.801384:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c786d3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518661.801411:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 15728640 00010000:00010000:2.0:1789518661.801575:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c786d36 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf15 expref: 47 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.801597:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c786d3d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf15 expref: 46 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518661.801605:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:2.0:1789518661.801608:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518661.801647:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381c00, rc 0) 00000100:00100000:2.0:1789518661.801742:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:36690:x1876445617419776:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 593us (2359us total) trans 30064771405 rc 0/0 00000100:00100000:2.0:1789518661.801751:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 374 00000100:00100000:2.0:1789518661.804304:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518661.804507:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617420032 00000100:00100000:1.0:1789518661.804519:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617420032 00000100:00100000:1.0:1789518661.804585:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 375 00000100:00100000:1.0:1789518661.804598:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:36690:x1876445617420032:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518661.804676:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518661.804680:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:1.0:1789518661.804711:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c786cbf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeeb expref: 46 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804766:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c786d3d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf15 expref: 45 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804781:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed62200/0x631fd8698c786d2f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf0e expref: 44 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804793:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:1.0:1789518661.804801:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518661.804819:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c786d4b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf1c expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804873:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804888:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804900:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804919:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804927:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804933:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804962:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518661.804968:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804977:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.804986:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:1.0:1789518661.804989:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518661.804993:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.805000:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c786d52 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.805029:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23600/0x631fd8698c786d59 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.805038:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23600/0x631fd8698c786d59 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.805045:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23600/0x631fd8698c786d59 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.805329:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23600/0x631fd8698c786d59 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf1c expref: 46 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.805338:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:1.0:1789518661.805340:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789518661.805350:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c786d4b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf1c expref: 46 pid: 35846 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.805372:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23600/0x631fd8698c786d59 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf1c expref: 45 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518661.805413:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:1.0:1789518661.805416:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1789518661.805418:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23600, rc 0) 00000100:00100000:1.0:1789518661.805502:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:36690:x1876445617420032:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 906us (1210us total) trans 30064771406 rc 0/0 00000100:00100000:1.0:1789518661.805510:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 375 00000100:00100000:1.0:1789518661.823805:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518661.824198:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617420160 00000100:00100000:2.0:1789518661.824212:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617420160 00002000:00100000:2.0:1789518661.824277:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff99fff690b480 x1876445617420160/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.824291:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff690b480 with x1876445617420160 ext(0->1048575) 00002000:00010000:2.0:1789518661.824297:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff690b480 00000100:00100000:2.0:1789518661.824341:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 276 00000100:00100000:2.0:1789518661.824352:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617420160:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:0.0:1789518661.836334:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617420160:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 11966us (12525us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518661.836350:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 276 00002000:00100000:0.0:1789518661.836367:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff99fff690b480 x1876445617420160/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518661.836383:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff690b480 with x1876445617420160 ext(0->1048575) 00002000:00010000:0.0:1789518661.836391:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff690b480 00000100:00100000:2.0:1789518661.854416:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518661.854666:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617420288 00000100:00100000:1.0:1789518661.854677:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617420288 00002000:00100000:1.0:1789518661.854727:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff99ffc638aa00 x1876445617420288/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.854739:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc638aa00 with x1876445617420288 ext(1048576->2097151) 00002000:00010000:1.0:1789518661.854746:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc638aa00 00000100:00100000:1.0:1789518661.854931:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 277 00000100:00100000:1.0:1789518661.854943:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617420288:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518661.864973:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617420288:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 10023us (10568us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.864984:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 277 00002000:00100000:1.0:1789518661.864995:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff99ffc638aa00 x1876445617420288/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.865025:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc638aa00 with x1876445617420288 ext(1048576->2097151) 00002000:00010000:1.0:1789518661.865031:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc638aa00 00000100:00100000:0.0:1789518661.880464:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.880531:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518661.880699:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617420416 00000100:00100000:1.0:1789518661.880709:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617420416 00002000:00100000:1.0:1789518661.880754:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff99fed35f2a00 x1876445617420416/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.880771:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f2a00 with x1876445617420416 ext(2097152->3145727) 00002000:00010000:1.0:1789518661.880778:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fed35f2a00 00000100:00100000:2.0:1789518661.880804:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617420544 00000100:00100000:2.0:1789518661.880810:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617420544 00000100:00100000:1.0:1789518661.880812:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 278 00000100:00100000:1.0:1789518661.880825:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2343:x1876445617420416:12345-192.168.206.51@tcp:3:lfs.0 00002000:00100000:2.0:1789518661.880837:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff99fff7a24a80 x1876445617420544/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.880848:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24a80 with x1876445617420544 ext(3145728->4194303) 00002000:00010000:2.0:1789518661.880852:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a24a80 00000100:00100000:2.0:1789518661.880878:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 279 00000100:00100000:2.0:1789518661.880887:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:2343:x1876445617420544:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518661.890790:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2343:x1876445617420544:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 9894us (10247us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.890804:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 279 00002000:00100000:1.0:1789518661.890819:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff99fff7a24a80 x1876445617420544/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.890831:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24a80 with x1876445617420544 ext(3145728->4194303) 00002000:00010000:1.0:1789518661.890837:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a24a80 00000100:00100000:1.0:1789518661.899236:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617420416:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 18402us (18770us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.899250:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 278 00002000:00100000:1.0:1789518661.899264:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff99fed35f2a00 x1876445617420416/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.899292:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f2a00 with x1876445617420416 ext(2097152->3145727) 00002000:00010000:1.0:1789518661.899299:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fed35f2a00 00000100:00100000:0.0:1789518661.931371:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.931422:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.931455:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518661.931916:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617420672 00000100:00100000:3.0:1789518661.931927:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617420672 00002000:00100000:3.0:1789518661.931986:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff99fff7a27b80 x1876445617420672/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.931997:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a27b80 with x1876445617420672 ext(4194304->5242879) 00002000:00010000:3.0:1789518661.932003:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a27b80 00000100:00100000:3.0:1789518661.932021:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617420800 00000100:00100000:3.0:1789518661.932024:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617420800 00002000:00100000:3.0:1789518661.932053:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff99fff7a26a00 x1876445617420800/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.932061:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a26a00 with x1876445617420800 ext(5242880->6291455) 00002000:00010000:3.0:1789518661.932064:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a26a00 00000100:00100000:3.0:1789518661.932081:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617421056 00000100:00100000:3.0:1789518661.932084:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617421056 00002000:00100000:3.0:1789518661.932098:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff99fff7a25c00 x1876445617421056/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.932105:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25c00 with x1876445617421056 ext(7340032->8388607) 00002000:00010000:3.0:1789518661.932108:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a25c00 00000100:00100000:3.0:1789518661.932133:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 280 00000100:00100000:3.0:1789518661.932141:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2342:x1876445617420672:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518661.932643:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 281 00000100:00100000:2.0:1789518661.932656:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2343:x1876445617420800:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518661.932765:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 282 00000100:00100000:3.0:1789518661.932774:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2343:x1876445617421056:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518661.936710:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518661.937484:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617420928 00000100:00100000:3.0:1789518661.937495:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617420928 00002000:00100000:3.0:1789518661.937547:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff99ffc638b480 x1876445617420928/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/0 e 0 to 0 dl 1789518672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.937559:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc638b480 with x1876445617420928 ext(6291456->7340031) 00002000:00010000:3.0:1789518661.937566:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc638b480 00000100:00100000:0.0:1789518661.937607:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 283 00000100:00100000:0.0:1789518661.937721:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:2342:x1876445617420928:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518661.946684:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:2342:x1876445617420672:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 14532us (15314us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789518661.946698:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 280 00002000:00100000:3.0:1789518661.946712:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff99fff7a27b80 x1876445617420672/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518661.951477:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a27b80 with x1876445617420672 ext(4194304->5242879) 00002000:00010000:3.0:1789518661.951486:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a27b80 00000100:00100000:1.0:1789518661.952808:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2343:x1876445617421056:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 20025us (21341us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.952819:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 282 00002000:00100000:1.0:1789518661.952833:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff99fff7a25c00 x1876445617421056/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.952843:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25c00 with x1876445617421056 ext(7340032->8388607) 00002000:00010000:1.0:1789518661.952850:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a25c00 00000100:00100000:2.0:1789518661.963505:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2343:x1876445617420800:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 30840us (32068us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518661.963521:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 281 00002000:00100000:2.0:1789518661.963534:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff99fff7a26a00 x1876445617420800/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518661.963546:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a26a00 with x1876445617420800 ext(5242880->6291455) 00002000:00010000:2.0:1789518661.963554:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7a26a00 00000100:00100000:1.0:1789518661.968253:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2342:x1876445617420928:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 30606us (31544us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518661.968266:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 283 00002000:00100000:1.0:1789518661.968279:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff99ffc638b480 x1876445617420928/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:307/0 lens 488/440 e 0 to 0 dl 1789518672 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518661.968290:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc638b480 with x1876445617420928 ext(6291456->7340031) 00002000:00010000:1.0:1789518661.968297:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc638b480 00000100:00100000:2.0:1789518661.984177:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518661.984290:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617421312 00000100:00100000:0.0:1789518661.984301:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617421312 00000100:00100000:0.0:1789518661.984488:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:0.0:1789518661.984499:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:36690:x1876445617421312:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:0.0:1789518661.984757:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:36690:x1876445617421312:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 259us (964us total) trans 30064771407 rc 0/0 00000100:00100000:0.0:1789518661.984765:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1789518662.057548:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518662.059339:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617421568 00000100:00100000:0.0:1789518662.059353:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617421568 00000100:00100000:0.0:1789518662.059512:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 376 00000100:00100000:0.0:1789518662.059524:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:36700:x1876445617421568:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518662.059549:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518662.059570:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786d60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf23 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518662.059715:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00010000:00010000:0.0:1789518662.059836:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786d60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf23 expref: 48 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.059850:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:0.0:1789518662.059853:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518662.059859:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786d60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf23 expref: 48 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.059875:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:0.0:1789518662.059956:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:36700:x1876445617421568:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 435us (2418us total) trans 30064771408 rc 301/301 00000100:00100000:0.0:1789518662.059964:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 376 00000100:00080000:2.0:1789518662.060048:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518662.062470:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518662.067346:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617421696 00000100:00100000:0.0:1789518662.067364:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617421696 00000100:00100000:0.0:1789518662.067449:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 377 00000100:00100000:0.0:1789518662.067460:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:36700:x1876445617421696:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518662.067529:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067546:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067560:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067577:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067583:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067590:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067695:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067704:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067711:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518662.067750:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067762:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067769:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067776:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067782:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518662.067786:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067794:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067805:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:0.0:1789518662.067808:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518662.067813:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067819:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786d6e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067833:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067839:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067845:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067850:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518662.067853:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067858:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067864:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518662.067867:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518662.067870:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067875:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d75 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067890:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067896:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067902:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067907:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518662.067910:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067917:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067924:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:0.0:1789518662.067927:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518662.067930:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.067935:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d7c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518662.068007:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:36700:x1876445617421696:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 549us (5546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518662.068378:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 377 00000100:00100000:1.0:1789518662.076157:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518662.076816:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617421952 00000100:00100000:0.0:1789518662.076826:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617421952 00000100:00100000:1.0:1789518662.077033:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:1.0:1789518662.077045:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:36700:x1876445617421952:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518662.077328:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:36700:x1876445617421952:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 285us (1179us total) trans 30064771409 rc 0/0 00000100:00100000:1.0:1789518662.077336:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:1.0:1789518662.130079:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518662.130248:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617422208 00000100:00100000:2.0:1789518662.130260:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617422208 00000100:00100000:2.0:1789518662.130323:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 378 00000100:00100000:2.0:1789518662.130334:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:36710:x1876445617422208:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518662.130358:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518662.130378:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786d83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf2a expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.130494:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786d8a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.130511:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786d8a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.130523:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786d8a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518662.130534:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 16384 00010000:00010000:2.0:1789518662.130698:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786d83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf2a expref: 51 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.130719:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4600/0x631fd8698c786d8a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf2a expref: 50 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.130727:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:2.0:1789518662.130730:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518662.130733:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d4600, rc 0) 00000100:00100000:2.0:1789518662.130812:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:36710:x1876445617422208:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 476us (749us total) trans 30064771410 rc 0/0 00000100:00100000:2.0:1789518662.130819:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 378 00000100:00100000:2.0:1789518662.134040:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518662.134282:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617422336 00000100:00100000:0.0:1789518662.134297:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617422336 00000100:00100000:0.0:1789518662.134579:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 379 00000100:00100000:0.0:1789518662.134591:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:36710:x1876445617422336:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518662.134759:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.134779:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.134793:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.134811:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.134818:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.134825:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.134965:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.134974:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.134980:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518662.135034:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135054:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135059:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135064:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135069:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518662.135074:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135081:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135094:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:0.0:1789518662.135098:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518662.135104:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135111:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786d98 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135133:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135139:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135145:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135150:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518662.135153:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135160:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135167:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518662.135170:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518662.135174:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135178:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786d9f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135194:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135197:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135202:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135205:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518662.135207:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135210:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135214:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff99ffc2d97a00) 00010000:00010000:0.0:1789518662.135215:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518662.135217:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.135220:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786da6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518662.135288:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:36710:x1876445617422336:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 700us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518662.135294:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 379 00000100:00100000:1.0:1789518662.189734:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518662.189881:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617422464 00000100:00100000:0.0:1789518662.189893:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617422464 00000100:00100000:0.0:1789518662.189968:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 380 00000100:00100000:0.0:1789518662.189979:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:36716:x1876445617422464:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518662.190007:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518662.190033:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786dad lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf31 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190118:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190137:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190151:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190165:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190170:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190174:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190350:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786dc2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190359:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786dc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190365:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786dc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518662.190421:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00000004:00200000:0.0:1789518662.190426:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518662.190448:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786dc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190466:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786dc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190475:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190481:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190489:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190496:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bd000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518662.190500:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190508:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190521:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff99ffeaa78000) 00010000:00010000:0.0:1789518662.190524:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518662.190530:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190535:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bd000/0x631fd8698c786db4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190553:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190559:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190566:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190571:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffed5bc000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518662.190573:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190579:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190585:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518662.190588:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518662.190590:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190609:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc000/0x631fd8698c786dbb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190708:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bce00/0x631fd8698c786dad lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf31 expref: 52 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190722:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffed5bc400/0x631fd8698c786dc2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf31 expref: 51 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518662.190729:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:0.0:1789518662.190732:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518662.190734:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bc400, rc 0) 00000100:00100000:0.0:1789518662.190822:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:36716:x1876445617422464:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 845us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518662.190833:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 380 00000100:00100000:1.0:1789518662.195011:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518662.195349:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617422720 00000100:00100000:2.0:1789518662.195363:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617422720 00000100:00100000:2.0:1789518662.195868:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 381 00000100:00100000:2.0:1789518662.195884:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:36716:x1876445617422720:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518662.195912:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518662.195941:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786dc9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf38 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.196075:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786dd0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.196092:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786dd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.196106:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786dd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518662.196120:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00010000:00010000:2.0:1789518662.196439:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d4800/0x631fd8698c786dc9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf38 expref: 54 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.196460:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786dd0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf38 expref: 53 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.196469:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:2.0:1789518662.196472:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518662.196476:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec26d5200, rc 0) 00000100:00100000:2.0:1789518662.196547:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:36716:x1876445617422720:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 668us (1549us total) trans 30064771411 rc 0/0 00000100:00100000:2.0:1789518662.196557:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 381 00000100:00100000:1.0:1789518662.199602:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518662.199820:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518662.199910:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617423104 00000100:00100000:2.0:1789518662.199922:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617423104 00000100:00100000:2.0:1789518662.199993:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:2.0:1789518662.200005:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:2344:x1876445617423104:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518662.200024:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518662.200051:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fec26d5200/0x631fd8698c786dd0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf38 expref: 53 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518662.200070:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff99ffc6733a00) 00010000:00010000:2.0:1789518662.200074:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518662.200132:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:2344:x1876445617423104:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518662.200137:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1789518662.200839:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617422976 00000100:00100000:0.0:1789518662.200848:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617422976 00000100:00100000:0.0:1789518662.201012:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:0.0:1789518662.201023:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:36716:x1876445617422976:12345-192.168.206.51@tcp:35:lfs.0 00000001:00080000:0.0:1789518662.201325:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771412 00000100:00100000:0.0:1789518662.202106:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:36716:x1876445617422976:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 1075us (2508us total) trans 30064771413 rc 0/0 00000100:00100000:0.0:1789518662.202117:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000020:00080000:0.0:1789518662.202125:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518662.514991:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518662.541837:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518662.541880:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518662.541965:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617423360 00000100:00100000:0.0:1789518662.541977:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617423360 00000100:00080000:2.0:1789518662.542046:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518662.542053:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518662.542071:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2344:x1876445617423360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518662.542211:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2344:x1876445617423360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 109us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518662.542219:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:1.0:1789518662.542381:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518662.542430:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617423232 00000100:00100000:3.0:1789518662.542436:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617423232 00000100:00100000:3.0:1789518662.542480:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:3.0:1789518662.542488:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617423232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518662.542522:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617423232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518662.542528:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:0.0:1789518662.542673:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617423488 00000100:00100000:0.0:1789518662.542677:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617423488 00000100:00100000:0.0:1789518662.542720:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:0.0:1789518662.542728:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617423488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518662.542765:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617423488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518662.542779:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00080000:3.0:1789518662.542804:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789518663.538907:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789518664.362375:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771180 is committed 00000001:00080000:2.0:1789518664.362446:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771181 is committed 00010000:00010000:2.0:1789518664.562908:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518665.177683:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518665.177824:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617423616 00000100:00100000:0.0:1789518665.177838:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617423616 00000100:00100000:0.0:1789518665.177938:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 382 00000100:00100000:0.0:1789518665.177951:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:36658:x1876445617423616:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1789518665.177984:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518665.178092:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:36658:x1876445617423616:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 143us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518665.178100:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 382 00000100:00100000:1.0:1789518665.181952:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518665.182392:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617423872 00000100:00100000:2.0:1789518665.182405:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617423872 00000100:00100000:2.0:1789518665.182531:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:2.0:1789518665.182544:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:36658:x1876445617423872:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518665.182916:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:36658:x1876445617423872:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 374us (978us total) trans 30064771414 rc 0/0 00000100:00100000:2.0:1789518665.182925:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00010000:00010000:2.0:1789518665.586813:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518665.846161:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffbb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627666560:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789518665.846163:0:35868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 719842148475ns, next at 720842146364ns, rc = 0 00000100:00100000:1.0:1789518665.846230:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518665.846325:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627666560 00000100:00100000:1.0:1789518665.846332:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627666560 00000100:00100000:1.0:1789518665.846399:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518665.846409:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627666560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518665.846440:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 178847744 pending 0 free 3796893696 avail 3794796544 00000100:00100000:1.0:1789518665.847771:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627666560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1360us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518665.847782:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789518665.847812:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518665.847881:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffbb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627666560:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789518665.899966:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771413 is committed 00000004:00080000:3.0:1789518665.899995:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000004:00080000:3.0:1789518665.900004:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000001:00080000:3.0:1789518665.900025:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771414 is committed 00000020:00080000:3.0:1789518665.900045:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803904 batchid updated 00000020:00080000:3.0:1789518665.900220:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000020:00080000:3.0:1789518665.900228:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000100:00100000:0.0:1789518665.900443:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627666816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789518665.900507:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518665.900540:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627666816 00000100:00100000:2.0:1789518665.900547:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627666816 00000100:00100000:0.0:1789518665.900552:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518665.900557:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffbb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627666688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518665.900581:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518665.900585:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789518665.900593:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627666816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789518665.900786:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:2.0:1789518665.900790:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb mtime from disk: 1789518661 -> 1789518661 00002000:00010000:2.0:1789518665.900793:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518665.900795:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb ctime from disk: 1789518661 -> 1789518661 00002000:00010000:2.0:1789518665.900798:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:2.0:1789518665.900841:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627666816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (334us total) trans 30064771182 rc 0/0 00000100:00100000:2.0:1789518665.900848:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789518665.900860:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627666688 00000100:00100000:2.0:1789518665.900863:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627666688 00000100:00100000:2.0:1789518665.900895:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789518665.900901:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627666688:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1789518665.901004:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffc6389180/2, rc 0, transno 30064771182 00000100:00100000:0.0:1789518665.901011:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627666816:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789518665.901029:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:2.0:1789518665.901032:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb mtime from disk: 1789518661 -> 1789518661 00002000:00010000:2.0:1789518665.901034:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518665.901036:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb ctime from disk: 1789518661 -> 1789518661 00002000:00010000:2.0:1789518665.901038:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:2.0:1789518665.901072:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3283:x1876445627666688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (490us total) trans 30064771249 rc 0/0 00000100:00100000:2.0:1789518665.901078:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000004:00080000:0.0:1789518665.901797:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fffbb80e00/2, rc 0, transno 30064771249 00000100:00100000:0.0:1789518665.901803:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffbb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627666688:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789518665.904683:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789518665.914075:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771244 is committed 00000001:00080000:0.0:1789518665.914131:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771248 is committed 00000001:00080000:0.0:1789518665.914156:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771232 is committed 00000040:00080000:1.0:1789518666.035250:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518666.035260:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518666.035406:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 10 00000040:00080000:1.0:1789518666.035413:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518666.127361:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518666.127442:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617424000 00000100:00100000:1.0:1789518666.127453:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617424000 00002000:00100000:1.0:1789518666.127518:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc5:0x0] (0->11) req@ffff99ffc6388000 x1876445617424000/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:312/0 lens 504/0 e 0 to 0 dl 1789518677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518666.127530:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6388000 with x1876445617424000 ext(0->11) 00002000:00010000:1.0:1789518666.127536:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc6388000 00000100:00100000:1.0:1789518666.127609:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 284 00000100:00100000:1.0:1789518666.127654:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2344:x1876445617424000:12345-192.168.206.51@tcp:4:cat.0 00000100:00080000:2.0:1789518666.127743:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518666.128134:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2344:x1876445617424000:12345-192.168.206.51@tcp:4:cat.0 Request processed in 482us (784us total) trans 30064771250 rc 0/0 00000100:00100000:1.0:1789518666.128143:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 284 00002000:00100000:1.0:1789518666.128152:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc5:0x0] (0->11) req@ffff99ffc6388000 x1876445617424000/t30064771250(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:312/0 lens 504/448 e 0 to 0 dl 1789518677 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518666.128162:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6388000 with x1876445617424000 ext(0->11) 00002000:00010000:1.0:1789518666.128167:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffc6388000 00000001:02000400:1.0:1789518666.278013:0:39648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10d: Test RO-PCC with group quota on loop PCC device ========================================================== 20:31:06 (1789518666) 00000100:00100000:2.0:1789518666.355320:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627667328:0@lo:400:kworker.0 00000100:00100000:2.0:1789518666.355424:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518666.355491:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518666.355498:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627667200:0@lo:400:kworker.0 00000100:00100000:2.0:1789518666.355525:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518666.355559:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627667328 00000100:00100000:2.0:1789518666.355568:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627667328 00000100:00100000:2.0:1789518666.355655:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518666.355665:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627667328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518666.355727:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627667328:12345-0@lo:400:kworker.0 Request processed in 63us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518666.355734:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789518666.355761:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627667200 00000100:00100000:2.0:1789518666.355766:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627667200 00000100:00100000:2.0:1789518666.355794:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789518666.355800:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627667200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518666.355832:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627667200:12345-0@lo:400:kworker.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518666.355837:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789518666.355877:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771232 gen 2 00000004:00080000:2.0:1789518666.355882:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec8340a80, transno 30064771231 00000004:00080000:2.0:1789518666.355891:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec8343480, transno 30064771232 00000100:00100000:2.0:1789518666.355900:0:3283:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fffbb80e00 x1876445627666688/t30064771249(30064771249) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518681 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789518666.355913:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627667200:0@lo:400:kworker.0 00000100:00100000:2.0:1789518666.355923:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627667328:0@lo:400:kworker.0 00000100:00100000:3.0:1789518666.356732:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627666944:0@lo:400:kworker.0 00000100:00100000:3.0:1789518666.356792:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518666.356841:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627667456:0@lo:400:kworker.0 00000100:00100000:3.0:1789518666.356867:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518666.356891:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789518666.356897:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627667072:0@lo:400:kworker.0 00000100:00100000:3.0:1789518666.356939:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518666.356961:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc6389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627667584:0@lo:400:kworker.0 00000100:00100000:3.0:1789518666.356981:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518666.357165:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627667072 00000100:00100000:1.0:1789518666.357173:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627667072 00000100:00100000:1.0:1789518666.357221:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518666.357234:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627667072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518666.357254:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627667456 00000100:00100000:0.0:1789518666.357260:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627667456 00000100:00100000:1.0:1789518666.357312:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627667072:12345-0@lo:400:kworker.0 Request processed in 80us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518666.357321:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789518666.357360:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627667584 00000100:00100000:0.0:1789518666.357364:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627667584 00000100:00100000:0.0:1789518666.357410:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518666.357418:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627667456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518666.357456:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627667456:12345-0@lo:400:kworker.0 Request processed in 39us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518666.357463:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789518666.357477:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789518666.357482:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627667584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518666.357506:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627667584:12345-0@lo:400:kworker.0 Request processed in 24us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518666.357512:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789518666.357530:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518666.357704:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffbb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627667712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518666.357738:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518666.357778:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627667712 00000100:00100000:3.0:1789518666.357782:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627667712 00000100:00100000:3.0:1789518666.357813:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518666.357820:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627667712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518666.357836:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 284491776 pending 1703936 free 3725590528 avail 3723493376 00000100:00100000:3.0:1789518666.357872:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627667712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518666.357878:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518666.357925:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffbb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627667712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518666.357951:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627667072:0@lo:400:kworker.0 00000100:00100000:3.0:1789518666.357961:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627667584:0@lo:400:kworker.0 00000100:00100000:3.0:1789518666.357972:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627667456:0@lo:400:kworker.0 00000100:00100000:2.0:1789518666.358082:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627666944 00000100:00100000:2.0:1789518666.358087:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627666944 00000100:00100000:2.0:1789518666.358159:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789518666.358167:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627666944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518666.358208:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627666944:12345-0@lo:400:kworker.0 Request processed in 43us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518666.358214:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789518666.358296:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc6389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627666944:0@lo:400:kworker.0 00010000:00010000:0.0:1789518666.610871:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518667.206919:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.207935:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617424256 00000100:00100000:2.0:1789518667.207954:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617424256 00000100:00100000:2.0:1789518667.208132:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 383 00000100:00100000:2.0:1789518667.208146:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:37431:x1876445617424256:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518667.208180:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518667.208207:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786dde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf3f expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.208316:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.208335:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.208352:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.208380:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.208389:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.208396:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.208838:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786df3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.208851:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786df3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.208859:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786df3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518667.208870:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789518667.209011:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209019:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209027:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209033:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518667.209038:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209046:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209059:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:2.0:1789518667.209063:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518667.209069:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209081:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786de5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209095:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209101:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209107:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209112:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518667.209115:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209121:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209129:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99fec3b12f00) 00010000:00010000:2.0:1789518667.209132:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518667.209134:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209140:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786dec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209818:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786dde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf3f expref: 38 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209844:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786df3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf3f expref: 37 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.209851:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:2.0:1789518667.209854:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518667.209857:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:2.0:1789518667.209951:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:37431:x1876445617424256:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1808us (3040us total) trans 30064771415 rc 0/0 00000100:00100000:2.0:1789518667.209961:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 383 00000100:00080000:0.0:1789518667.210491:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518667.217649:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.217731:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617424384 00000100:00100000:0.0:1789518667.217745:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617424384 00000100:00100000:0.0:1789518667.217809:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 384 00000100:00100000:0.0:1789518667.217819:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:37431:x1876445617424384:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789518667.217950:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:37431:x1876445617424384:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 131us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518667.217958:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 384 00000100:00100000:1.0:1789518667.218506:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.218596:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617424512 00000100:00100000:3.0:1789518667.218603:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617424512 00000100:00100000:3.0:1789518667.218673:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1789518667.218683:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2343:x1876445617424512:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518667.218697:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518667.218734:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786df3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf3f expref: 37 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.218757:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:3.0:1789518667.218765:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518667.218805:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2343:x1876445617424512:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 123us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518667.218813:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:3.0:1789518667.315686:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.315749:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.315924:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617424640 00000100:00100000:0.0:1789518667.315939:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617424640 00000100:00100000:0.0:1789518667.316023:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617424896 00000100:00100000:0.0:1789518667.316027:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617424896 00000100:00100000:0.0:1789518667.316071:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 385 00000100:00100000:0.0:1789518667.316151:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2345:x1876445617424640:12345-192.168.206.51@tcp:41:mkdir.0 00000004:00000024:0.0:1789518667.316207:0:35845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1789518667.316314:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2345:x1876445617424640:12345-192.168.206.51@tcp:41:mkdir.0 Request processed in 167us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518667.317089:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 386 00000100:00100000:2.0:1789518667.317110:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:37446:x1876445617424896:12345-192.168.206.51@tcp:36:mkdir.0 00010000:00010000:2.0:1789518667.317171:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518667.318094:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786c17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdeac expref: 37 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.318123:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:2.0:1789518667.318135:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518667.318734:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.318752:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.318761:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.318775:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.318779:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.318783:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518667.318821:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 385 00000004:00200000:2.0:1789518667.320178:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00010000:00010000:2.0:1789518667.320197:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.320457:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.320465:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.320471:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518667.320477:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.320486:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.320503:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518667.320506:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518667.320511:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.320523:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e01 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518667.320548:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000177c3a17 reply state 00000000bd56f706 transno 30064771416 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518667.320655:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518667.321110:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:37446:x1876445617424896:12345-192.168.206.51@tcp:36:mkdir.0 Request processed in 4001us (5352us total) trans 30064771416 rc 0/0 00000100:00100000:2.0:1789518667.321123:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 386 00010000:00010000:0.0:1789518667.323237:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.323259:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.323268:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.323275:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518667.323281:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.323302:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.323321:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff99fec3b12400) 00010000:00010000:0.0:1789518667.323325:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518667.323332:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.323339:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e08 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518667.331643:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.331798:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617425024 00000100:00100000:3.0:1789518667.331811:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617425024 00000100:00100000:3.0:1789518667.331888:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 387 00000100:00100000:3.0:1789518667.331901:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:37447:x1876445617425024:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518667.331933:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518667.331963:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900000/0x631fd8698c786e0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf46 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.332069:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c786e16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.332086:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c786e16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.332100:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c786e16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518667.332149:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518667.332154:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518667.332211:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c786e16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.332243:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900000/0x631fd8698c786e0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf46 expref: 38 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.332267:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c786e16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf46 expref: 37 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.332277:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:3.0:1789518667.332280:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518667.332284:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901600, rc 0) 00000100:00100000:3.0:1789518667.332779:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:37447:x1876445617425024:12345-192.168.206.51@tcp:101:dd.0 Request processed in 879us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518667.332788:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 387 00000100:00100000:3.0:1789518667.336733:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.337417:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617425152 00000100:00100000:2.0:1789518667.337429:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617425152 00000100:00100000:2.0:1789518667.337562:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 388 00000100:00100000:2.0:1789518667.337576:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:37447:x1876445617425152:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518667.337604:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518667.337655:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf4d expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.337751:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.337769:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.337786:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.337806:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.337818:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.337825:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.337950:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786e32 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.337959:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786e32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.337966:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786e32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518667.338017:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00000004:00200000:2.0:1789518667.338021:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518667.338100:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786e32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338116:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338123:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338130:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338136:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518667.338141:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338151:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338166:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:2.0:1789518667.338170:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518667.338176:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338183:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786e24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338202:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338209:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338215:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338220:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518667.338222:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338228:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338234:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518667.338237:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518667.338240:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338249:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786e2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338285:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf4d expref: 39 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338301:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16c00/0x631fd8698c786e32 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf4d expref: 38 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.338308:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518667.338311:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789518667.338313:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16c00, rc 0) 00000100:00100000:2.0:1789518667.338415:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:37447:x1876445617425152:12345-192.168.206.51@tcp:101:dd.0 Request processed in 842us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518667.338423:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 388 00000100:00100000:1.0:1789518667.343198:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.343435:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617425408 00000100:00100000:2.0:1789518667.343447:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617425408 00000100:00100000:2.0:1789518667.343529:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 389 00000100:00100000:2.0:1789518667.343541:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:37447:x1876445617425408:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518667.343786:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518667.343814:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e39 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf54 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.343981:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.343999:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.344012:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.344028:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.344034:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.344041:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518667.345123:0:35846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcb:0x0], index 0: 0 00010000:00010000:2.0:1789518667.347161:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786e4e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347186:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786e4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347200:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786e4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347244:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347252:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347343:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347349:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518667.347354:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347364:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347387:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518667.347391:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518667.347396:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347403:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0800/0x631fd8698c786e40 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518667.347418:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021430dd8 reply state 0000000050e12b7d transno 30064771417 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518667.347427:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518667.347474:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e39 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf54 expref: 41 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347490:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786e4e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf54 expref: 40 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.347497:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518667.347499:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518667.347502:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1c00, rc 0) 00000100:00100000:2.0:1789518667.347763:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:37447:x1876445617425408:12345-192.168.206.51@tcp:101:dd.0 Request processed in 4222us (4573us total) trans 30064771417 rc 0/0 00000100:00100000:2.0:1789518667.347773:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 389 00010000:00010000:2.0:1789518667.350595:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.350647:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.350657:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.350663:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e1400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518667.350668:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.350677:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.350695:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff99fec3b12b00) 00010000:00010000:2.0:1789518667.350698:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518667.350704:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.350711:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e47 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518667.356191:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.356307:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617425536 00000100:00100000:2.0:1789518667.356321:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617425536 00000100:00100000:2.0:1789518667.356430:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:2.0:1789518667.356444:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+8:37447:x1876445617425536:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518667.356465:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518667.356492:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c786e5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf5b expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518667.356531:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518667.356560:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcb:0x0].0x0 since=721s v=(0 0) 00010000:00010000:2.0:1789518667.356566:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518667.356578:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c786e5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf5b expref: 9 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.356599:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000600444e7/0x631fd8698c786e5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf5b expref: 9 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789518667.356918:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789518667.358201:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e0800, rc 0) 00000100:00100000:2.0:1789518667.358304:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:37447:x1876445617425536:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1857us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518667.358315:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:1.0:1789518667.398284:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.398412:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617425664 00000100:00100000:3.0:1789518667.398425:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617425664 00002000:00100000:3.0:1789518667.398495:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff99ffd03d8000 x1876445617425664/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.398509:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d8000 with x1876445617425664 ext(0->1048575) 00002000:00010000:3.0:1789518667.398516:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03d8000 00000100:00100000:3.0:1789518667.398679:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 285 00000100:00100000:3.0:1789518667.398692:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2343:x1876445617425664:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518667.413550:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.413855:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617425792 00000100:00100000:2.0:1789518667.413869:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617425792 00002000:00100000:2.0:1789518667.413932:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff99fec1ec4700 x1876445617425792/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.413946:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec4700 with x1876445617425792 ext(1048576->2097151) 00002000:00010000:2.0:1789518667.413953:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec4700 00000100:00100000:2.0:1789518667.413993:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 286 00000100:00100000:2.0:1789518667.414004:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617425792:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518667.429915:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518667.430159:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617425920 00000100:00100000:1.0:1789518667.430172:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617425920 00002000:00100000:1.0:1789518667.430308:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff99fec1ec7480 x1876445617425920/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518667.430321:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec7480 with x1876445617425920 ext(2097152->3145727) 00002000:00010000:1.0:1789518667.430329:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec7480 00000100:00100000:1.0:1789518667.430423:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 287 00000100:00100000:1.0:1789518667.430435:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2344:x1876445617425920:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518667.433436:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617425792:12345-192.168.206.51@tcp:4:dd.0 Request processed in 19417us (19885us total) trans 30064771184 rc 0/0 00000100:00100000:0.0:1789518667.433454:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 286 00002000:00100000:0.0:1789518667.433470:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff99fec1ec4700 x1876445617425792/t30064771184(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.433482:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec4700 with x1876445617425792 ext(1048576->2097151) 00002000:00010000:0.0:1789518667.433492:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec4700 00000100:00100000:2.0:1789518667.433499:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2343:x1876445617425664:12345-192.168.206.51@tcp:4:dd.0 Request processed in 34805us (35224us total) trans 30064771183 rc 0/0 00000100:00100000:2.0:1789518667.433515:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 285 00002000:00100000:2.0:1789518667.433524:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff99ffd03d8000 x1876445617425664/t30064771183(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.433534:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d8000 with x1876445617425664 ext(0->1048575) 00002000:00010000:2.0:1789518667.433539:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03d8000 00000100:00100000:0.0:1789518667.439905:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2344:x1876445617425920:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9458us (9990us total) trans 30064771185 rc 0/0 00000100:00100000:0.0:1789518667.439919:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 287 00002000:00100000:0.0:1789518667.439934:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff99fec1ec7480 x1876445617425920/t30064771185(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.439943:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec7480 with x1876445617425920 ext(2097152->3145727) 00002000:00010000:0.0:1789518667.439950:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec7480 00000100:00100000:1.0:1789518667.447854:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.447999:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617426048 00000100:00100000:2.0:1789518667.448012:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617426048 00002000:00100000:2.0:1789518667.448075:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff99ffd03d9180 x1876445617426048/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.448088:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d9180 with x1876445617426048 ext(3145728->4194303) 00002000:00010000:2.0:1789518667.448094:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03d9180 00000100:00100000:2.0:1789518667.448208:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 288 00000100:00100000:2.0:1789518667.448220:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2345:x1876445617426048:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.457100:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2345:x1876445617426048:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8856us (9235us total) trans 30064771186 rc 0/0 00000100:00100000:2.0:1789518667.457117:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 288 00002000:00100000:2.0:1789518667.457327:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff99ffd03d9180 x1876445617426048/t30064771186(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.457339:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d9180 with x1876445617426048 ext(3145728->4194303) 00002000:00010000:2.0:1789518667.457348:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03d9180 00000100:00100000:2.0:1789518667.467875:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.468066:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617426176 00000100:00100000:3.0:1789518667.468111:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617426176 00002000:00100000:3.0:1789518667.468179:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff99ffefff0700 x1876445617426176/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.468192:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff0700 with x1876445617426176 ext(4194304->5242879) 00002000:00010000:3.0:1789518667.468200:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff0700 00000100:00100000:3.0:1789518667.468241:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 289 00000100:00100000:3.0:1789518667.468252:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617426176:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518667.482588:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2342:x1876445617426176:12345-192.168.206.51@tcp:4:dd.0 Request processed in 14321us (14711us total) trans 30064771187 rc 0/0 00000100:00100000:3.0:1789518667.482605:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 289 00002000:00100000:3.0:1789518667.482714:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff99ffefff0700 x1876445617426176/t30064771187(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.482726:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffefff0700 with x1876445617426176 ext(4194304->5242879) 00002000:00010000:3.0:1789518667.482734:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffefff0700 00000100:00100000:1.0:1789518667.492042:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.492235:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617426304 00000100:00100000:2.0:1789518667.492252:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617426304 00002000:00100000:2.0:1789518667.492327:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff99ffd03daa00 x1876445617426304/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.492341:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03daa00 with x1876445617426304 ext(5242880->6291455) 00002000:00010000:2.0:1789518667.492349:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03daa00 00000100:00100000:2.0:1789518667.492567:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 290 00000100:00100000:2.0:1789518667.492579:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2344:x1876445617426304:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518667.508103:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2344:x1876445617426304:12345-192.168.206.51@tcp:4:dd.0 Request processed in 15512us (16056us total) trans 30064771188 rc 0/0 00000100:00100000:3.0:1789518667.508119:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 290 00002000:00100000:3.0:1789518667.508134:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff99ffd03daa00 x1876445617426304/t30064771188(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.508145:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03daa00 with x1876445617426304 ext(5242880->6291455) 00002000:00010000:3.0:1789518667.508153:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03daa00 00000100:00100000:2.0:1789518667.514353:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.514767:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617426432 00000100:00100000:0.0:1789518667.514781:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617426432 00002000:00100000:0.0:1789518667.514847:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff99ffc6389880 x1876445617426432/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.514862:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6389880 with x1876445617426432 ext(6291456->7340031) 00002000:00010000:0.0:1789518667.514869:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6389880 00000100:00100000:0.0:1789518667.514955:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 291 00000100:00100000:0.0:1789518667.514967:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2345:x1876445617426432:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518667.533530:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2345:x1876445617426432:12345-192.168.206.51@tcp:4:dd.0 Request processed in 18551us (19178us total) trans 30064771189 rc 0/0 00000100:00100000:1.0:1789518667.533547:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 291 00002000:00100000:1.0:1789518667.533563:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff99ffc6389880 x1876445617426432/t30064771189(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518667.533575:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6389880 with x1876445617426432 ext(6291456->7340031) 00002000:00010000:1.0:1789518667.533584:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6389880 00000100:00100000:0.0:1789518667.541920:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.543009:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617426560 00000100:00100000:2.0:1789518667.543024:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617426560 00002000:00100000:2.0:1789518667.543099:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff99fff7a25880 x1876445617426560/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.543112:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25880 with x1876445617426560 ext(7340032->8388607) 00002000:00010000:2.0:1789518667.543120:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a25880 00000100:00100000:2.0:1789518667.543863:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 292 00000100:00100000:2.0:1789518667.543882:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2343:x1876445617426560:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.551477:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518667.551892:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617426688 00000100:00100000:1.0:1789518667.551906:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617426688 00002000:00100000:1.0:1789518667.551983:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff99ffc6388700 x1876445617426688/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518667.552013:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6388700 with x1876445617426688 ext(8388608->9437183) 00002000:00010000:1.0:1789518667.552021:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6388700 00000100:00100000:1.0:1789518667.552102:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 293 00000100:00100000:1.0:1789518667.552115:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2343:x1876445617426688:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518667.555807:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2343:x1876445617426560:12345-192.168.206.51@tcp:4:dd.0 Request processed in 11917us (13885us total) trans 30064771190 rc 0/0 00000100:00100000:1.0:1789518667.555822:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 292 00002000:00100000:1.0:1789518667.555837:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff99fff7a25880 x1876445617426560/t30064771190(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518667.555848:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a25880 with x1876445617426560 ext(7340032->8388607) 00002000:00010000:1.0:1789518667.555856:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a25880 00000100:00100000:0.0:1789518667.565882:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2343:x1876445617426688:12345-192.168.206.51@tcp:4:dd.0 Request processed in 13755us (14405us total) trans 30064771191 rc 0/0 00000100:00100000:0.0:1789518667.565899:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 293 00002000:00100000:0.0:1789518667.565916:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff99ffc6388700 x1876445617426688/t30064771191(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.565929:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6388700 with x1876445617426688 ext(8388608->9437183) 00002000:00010000:0.0:1789518667.565936:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6388700 00000100:00100000:2.0:1789518667.581426:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.581904:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617426816 00000100:00100000:0.0:1789518667.581919:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617426816 00002000:00100000:0.0:1789518667.582083:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff99ffc6389f80 x1876445617426816/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.582098:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6389f80 with x1876445617426816 ext(9437184->10485759) 00002000:00010000:0.0:1789518667.582106:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6389f80 00000100:00100000:0.0:1789518667.582139:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 294 00000100:00100000:0.0:1789518667.582151:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617426816:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518667.592105:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617426816:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9940us (10678us total) trans 30064771192 rc 0/0 00000100:00100000:0.0:1789518667.592123:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 294 00002000:00100000:0.0:1789518667.592139:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff99ffc6389f80 x1876445617426816/t30064771192(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.592151:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6389f80 with x1876445617426816 ext(9437184->10485759) 00002000:00010000:0.0:1789518667.592159:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6389f80 00000100:00100000:1.0:1789518667.606394:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.606520:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617426944 00000100:00100000:0.0:1789518667.606533:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617426944 00002000:00100000:0.0:1789518667.606597:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff99ffd03dbb80 x1876445617426944/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.606610:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03dbb80 with x1876445617426944 ext(10485760->11534335) 00002000:00010000:0.0:1789518667.606773:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03dbb80 00000100:00100000:0.0:1789518667.606819:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 295 00000100:00100000:0.0:1789518667.606830:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2344:x1876445617426944:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.624193:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.624484:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617427072 00000100:00100000:3.0:1789518667.624497:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617427072 00002000:00100000:3.0:1789518667.624559:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff99ffc638a680 x1876445617427072/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.624584:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc638a680 with x1876445617427072 ext(11534336->12582911) 00002000:00010000:3.0:1789518667.624592:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc638a680 00000100:00100000:0.0:1789518667.624677:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 296 00000100:00100000:0.0:1789518667.624693:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2345:x1876445617427072:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518667.625679:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2344:x1876445617426944:12345-192.168.206.51@tcp:4:dd.0 Request processed in 18842us (19305us total) trans 30064771193 rc 0/0 00000100:00100000:1.0:1789518667.625692:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 295 00002000:00100000:1.0:1789518667.625703:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff99ffd03dbb80 x1876445617426944/t30064771193(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518667.625713:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03dbb80 with x1876445617426944 ext(10485760->11534335) 00002000:00010000:1.0:1789518667.625718:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03dbb80 00010000:00010000:3.0:1789518667.634821:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518667.637298:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2345:x1876445617427072:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12594us (13103us total) trans 30064771194 rc 0/0 00000100:00100000:0.0:1789518667.637316:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 296 00002000:00100000:0.0:1789518667.637334:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff99ffc638a680 x1876445617427072/t30064771194(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.637346:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc638a680 with x1876445617427072 ext(11534336->12582911) 00002000:00010000:0.0:1789518667.637354:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc638a680 00000100:00100000:1.0:1789518667.648583:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.648811:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617427200 00000100:00100000:0.0:1789518667.648824:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617427200 00002000:00100000:0.0:1789518667.648888:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff99ffd03d9f80 x1876445617427200/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.648901:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d9f80 with x1876445617427200 ext(12582912->13631487) 00002000:00010000:0.0:1789518667.648908:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03d9f80 00000100:00100000:0.0:1789518667.648988:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 297 00000100:00100000:0.0:1789518667.649000:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+33:2343:x1876445617427200:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.657214:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2343:x1876445617427200:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8201us (8630us total) trans 30064771195 rc 0/0 00000100:00100000:2.0:1789518667.657231:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 297 00002000:00100000:2.0:1789518667.657249:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff99ffd03d9f80 x1876445617427200/t30064771195(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.657262:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d9f80 with x1876445617427200 ext(12582912->13631487) 00002000:00010000:2.0:1789518667.657271:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03d9f80 00000100:00100000:0.0:1789518667.660504:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.660910:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617427328 00000100:00100000:2.0:1789518667.660924:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617427328 00002000:00100000:2.0:1789518667.660991:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff99fff7a24380 x1876445617427328/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.661010:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24380 with x1876445617427328 ext(13631488->14680063) 00002000:00010000:2.0:1789518667.661018:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a24380 00000100:00100000:1.0:1789518667.661585:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.661758:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 298 00000100:00100000:2.0:1789518667.661775:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+35:2343:x1876445617427328:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518667.661902:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617427456 00000100:00100000:0.0:1789518667.661914:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617427456 00000100:00100000:0.0:1789518667.662044:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:0.0:1789518667.662055:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617427456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518667.662233:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617427456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 180us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518667.662241:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:0.0:1789518667.663147:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.663238:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.663307:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617427584 00000100:00100000:2.0:1789518667.663318:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617427584 00000100:00100000:3.0:1789518667.663326:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617427712 00000100:00100000:3.0:1789518667.663333:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617427712 00000100:00100000:2.0:1789518667.663391:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:2.0:1789518667.663482:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617427584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518667.663548:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:0.0:1789518667.663558:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617427712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518667.663565:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617427584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 163us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518667.663575:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1789518667.663601:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617427712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518667.663610:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00080000:1.0:1789518667.663642:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518667.674757:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.674825:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.674828:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617428096 00000100:00100000:0.0:1789518667.674841:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617428096 00000100:00100000:0.0:1789518667.674916:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:0.0:1789518667.674929:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:37447:x1876445617428096:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:1.0:1789518667.674985:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617427968 00000100:00100000:1.0:1789518667.675004:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617427968 00002000:00100000:1.0:1789518667.675040:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff99ffc6388a80 x1876445617427968/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518667.675051:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6388a80 with x1876445617427968 ext(14680064->15728639) 00002000:00010000:1.0:1789518667.675058:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6388a80 00000100:00100000:1.0:1789518667.675080:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 299 00000100:00100000:1.0:1789518667.675088:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+37:2345:x1876445617427968:12345-192.168.206.51@tcp:4:dd.0 00000001:00080000:0.0:1789518667.676153:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771418 00000100:00100000:0.0:1789518667.676328:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:37447:x1876445617428096:12345-192.168.206.51@tcp:35:dd.0 Request processed in 1397us (1580us total) trans 30064771419 rc 0/0 00000100:00100000:0.0:1789518667.676339:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00000020:00080000:0.0:1789518667.676345:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789518667.680484:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617427328:12345-192.168.206.51@tcp:4:dd.0 Request processed in 18698us (19979us total) trans 30064771196 rc 0/0 00000100:00100000:3.0:1789518667.680501:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 298 00002000:00100000:3.0:1789518667.680519:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff99fff7a24380 x1876445617427328/t30064771196(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.680532:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7a24380 with x1876445617427328 ext(13631488->14680063) 00002000:00010000:3.0:1789518667.680540:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff7a24380 00000100:00100000:0.0:1789518667.682913:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2345:x1876445617427968:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7811us (8074us total) trans 30064771197 rc 0/0 00000100:00100000:0.0:1789518667.682929:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 299 00002000:00100000:0.0:1789518667.682945:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff99ffc6388a80 x1876445617427968/t30064771197(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.682956:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc6388a80 with x1876445617427968 ext(14680064->15728639) 00002000:00010000:0.0:1789518667.682964:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc6388a80 00000100:00100000:1.0:1789518667.686777:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.686922:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617428352 00000100:00100000:2.0:1789518667.686937:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617428352 00000100:00100000:2.0:1789518667.687056:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 390 00000100:00100000:2.0:1789518667.687069:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:37449:x1876445617428352:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518667.687101:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518667.687140:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e63 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf62 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.687294:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.687313:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.687327:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.687345:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.687352:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.687359:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518667.688480:0:37723:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcb:0x0], index 1: 0 00010000:00010000:2.0:1789518667.688859:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e78 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.688876:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.688887:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.688931:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.688945:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.688952:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.688958:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518667.688963:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.688971:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.689047:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518667.689052:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518667.689059:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.689066:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786e6a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518667.689084:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000273cc6da reply state 00000000c05f1696 transno 30064771420 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518667.689095:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518667.689211:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786e63 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf62 expref: 45 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.689230:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e78 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf62 expref: 44 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.689245:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518667.689247:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518667.689250:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16a00, rc 0) 00000100:00100000:2.0:1789518667.689464:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:37449:x1876445617428352:12345-192.168.206.51@tcp:101:dd.0 Request processed in 2396us (2699us total) trans 30064771420 rc 0/0 00000100:00100000:2.0:1789518667.689474:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 390 00010000:00010000:0.0:1789518667.691351:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.691384:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.691392:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.691397:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc6b16400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518667.691403:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.691411:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.691429:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff99fec3b12b00) 00010000:00010000:0.0:1789518667.691432:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518667.691438:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.691444:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786e71 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518667.695223:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.695466:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617428480 00000100:00100000:2.0:1789518667.695480:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617428480 00000100:00100000:0.0:1789518667.695698:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:0.0:1789518667.695710:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:37449:x1876445617428480:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1789518667.695730:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518667.695751:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c786e86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf69 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518667.695779:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789518667.695804:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcb:0x0].0x0 since=721s v=(0 0) 00010000:00010000:0.0:1789518667.695808:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518667.695816:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c786e86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf69 expref: 14 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.695830:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e16297d1/0x631fd8698c786e86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf69 expref: 14 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.695840:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffed5bce00, rc 0) 00000100:00100000:0.0:1789518667.695968:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:37449:x1876445617428480:12345-192.168.206.51@tcp:101:dd.0 Request processed in 260us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518667.695976:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:1.0:1789518667.712253:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.712381:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617428608 00000100:00100000:2.0:1789518667.712394:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617428608 00002000:00100000:2.0:1789518667.712459:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff99fec525f800 x1876445617428608/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.712471:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525f800 with x1876445617428608 ext(0->1048575) 00002000:00010000:2.0:1789518667.712478:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525f800 00000100:00100000:2.0:1789518667.712523:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 300 00000100:00100000:2.0:1789518667.712534:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2345:x1876445617428608:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518667.725509:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.725650:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617428736 00000100:00100000:3.0:1789518667.725663:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617428736 00002000:00100000:3.0:1789518667.725742:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff99fec525c700 x1876445617428736/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.725755:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525c700 with x1876445617428736 ext(1048576->2097151) 00002000:00010000:3.0:1789518667.725762:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525c700 00000100:00100000:3.0:1789518667.725846:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 301 00000100:00100000:3.0:1789518667.725855:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2344:x1876445617428736:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518667.728271:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2345:x1876445617428608:12345-192.168.206.51@tcp:4:dd.0 Request processed in 15722us (16016us total) trans 30064771251 rc 0/0 00000100:00100000:0.0:1789518667.728288:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 300 00002000:00100000:0.0:1789518667.728302:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff99fec525f800 x1876445617428608/t30064771251(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.728313:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525f800 with x1876445617428608 ext(0->1048575) 00002000:00010000:0.0:1789518667.728320:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525f800 00000100:00100000:2.0:1789518667.734818:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2344:x1876445617428736:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8946us (9307us total) trans 30064771252 rc 0/0 00000100:00100000:2.0:1789518667.734836:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 301 00002000:00100000:2.0:1789518667.734852:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff99fec525c700 x1876445617428736/t30064771252(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.734862:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525c700 with x1876445617428736 ext(1048576->2097151) 00002000:00010000:2.0:1789518667.734872:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525c700 00000100:00100000:1.0:1789518667.738421:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.738511:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617428864 00000100:00100000:3.0:1789518667.738523:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617428864 00002000:00100000:3.0:1789518667.738586:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff99fec525ca80 x1876445617428864/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.738742:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525ca80 with x1876445617428864 ext(2097152->3145727) 00002000:00010000:3.0:1789518667.738750:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525ca80 00000100:00100000:2.0:1789518667.739180:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 302 00000100:00100000:2.0:1789518667.739197:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2342:x1876445617428864:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.751168:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.751220:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617428992 00000100:00100000:2.0:1789518667.751237:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617428992 00002000:00100000:2.0:1789518667.751301:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff99fec8340a80 x1876445617428992/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.751313:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8340a80 with x1876445617428992 ext(3145728->4194303) 00002000:00010000:2.0:1789518667.751320:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8340a80 00000100:00100000:2.0:1789518667.751360:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 303 00000100:00100000:2.0:1789518667.751383:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2343:x1876445617428992:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.755123:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2342:x1876445617428864:12345-192.168.206.51@tcp:4:dd.0 Request processed in 15911us (16693us total) trans 30064771253 rc 0/0 00000100:00100000:2.0:1789518667.755143:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 302 00002000:00100000:2.0:1789518667.755343:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff99fec525ca80 x1876445617428864/t30064771253(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.755358:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525ca80 with x1876445617428864 ext(2097152->3145727) 00002000:00010000:2.0:1789518667.755377:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525ca80 00000100:00100000:2.0:1789518667.759281:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2343:x1876445617428992:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7897us (8114us total) trans 30064771254 rc 0/0 00000100:00100000:2.0:1789518667.759297:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 303 00002000:00100000:2.0:1789518667.759313:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff99fec8340a80 x1876445617428992/t30064771254(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.759324:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec8340a80 with x1876445617428992 ext(3145728->4194303) 00002000:00010000:2.0:1789518667.759333:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec8340a80 00000100:00100000:0.0:1789518667.759359:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.759406:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617429120 00000100:00100000:2.0:1789518667.759415:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617429120 00002000:00100000:2.0:1789518667.759454:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff99fecb2a4700 x1876445617429120/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.759462:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a4700 with x1876445617429120 ext(4194304->5242879) 00002000:00010000:2.0:1789518667.759465:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a4700 00000100:00100000:2.0:1789518667.759499:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 304 00000100:00100000:2.0:1789518667.759509:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2345:x1876445617429120:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.765901:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2345:x1876445617429120:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6379us (6527us total) trans 30064771255 rc 0/0 00000100:00100000:2.0:1789518667.765918:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 304 00002000:00100000:2.0:1789518667.765933:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff99fecb2a4700 x1876445617429120/t30064771255(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.765944:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb2a4700 with x1876445617429120 ext(4194304->5242879) 00002000:00010000:2.0:1789518667.765952:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb2a4700 00000100:00100000:1.0:1789518667.769553:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.769699:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617429248 00000100:00100000:0.0:1789518667.769711:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617429248 00002000:00100000:0.0:1789518667.769778:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff99fec525f480 x1876445617429248/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.769791:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525f480 with x1876445617429248 ext(5242880->6291455) 00002000:00010000:0.0:1789518667.769798:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525f480 00000100:00100000:0.0:1789518667.769890:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 305 00000100:00100000:0.0:1789518667.769902:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2343:x1876445617429248:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.777720:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2343:x1876445617429248:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7804us (8173us total) trans 30064771256 rc 0/0 00000100:00100000:2.0:1789518667.777736:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 305 00002000:00100000:2.0:1789518667.777753:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff99fec525f480 x1876445617429248/t30064771256(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.777767:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525f480 with x1876445617429248 ext(5242880->6291455) 00002000:00010000:2.0:1789518667.777774:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525f480 00000100:00100000:1.0:1789518667.782498:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.782722:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617429376 00000100:00100000:2.0:1789518667.782735:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617429376 00002000:00100000:2.0:1789518667.782802:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff99fec525d880 x1876445617429376/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.782814:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525d880 with x1876445617429376 ext(6291456->7340031) 00002000:00010000:2.0:1789518667.782821:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525d880 00000100:00100000:2.0:1789518667.782871:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 306 00000100:00100000:2.0:1789518667.782883:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2343:x1876445617429376:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.791133:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2343:x1876445617429376:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8237us (8633us total) trans 30064771257 rc 0/0 00000100:00100000:2.0:1789518667.791150:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 306 00002000:00100000:2.0:1789518667.791167:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff99fec525d880 x1876445617429376/t30064771257(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.791178:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525d880 with x1876445617429376 ext(6291456->7340031) 00002000:00010000:2.0:1789518667.791187:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525d880 00000100:00100000:0.0:1789518667.792870:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.793033:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617429504 00000100:00100000:3.0:1789518667.793045:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617429504 00002000:00100000:3.0:1789518667.793103:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff99fecb0e8a80 x1876445617429504/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.793116:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8a80 with x1876445617429504 ext(7340032->8388607) 00002000:00010000:3.0:1789518667.793122:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e8a80 00000100:00100000:3.0:1789518667.793159:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 307 00000100:00100000:3.0:1789518667.793170:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2345:x1876445617429504:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518667.801514:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2345:x1876445617429504:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8335us (8645us total) trans 30064771258 rc 0/0 00000100:00100000:3.0:1789518667.801527:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 307 00002000:00100000:3.0:1789518667.801540:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff99fecb0e8a80 x1876445617429504/t30064771258(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518667.801551:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e8a80 with x1876445617429504 ext(7340032->8388607) 00002000:00010000:3.0:1789518667.801557:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e8a80 00000100:00100000:1.0:1789518667.806273:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.806435:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617429632 00000100:00100000:0.0:1789518667.806444:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617429632 00002000:00100000:0.0:1789518667.806488:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff99fec525df80 x1876445617429632/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.806496:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525df80 with x1876445617429632 ext(8388608->9437183) 00002000:00010000:0.0:1789518667.806501:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525df80 00000100:00100000:0.0:1789518667.806579:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 308 00000100:00100000:0.0:1789518667.806586:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2344:x1876445617429632:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.814429:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2344:x1876445617429632:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7826us (8149us total) trans 30064771259 rc 0/0 00000100:00100000:2.0:1789518667.814447:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 308 00002000:00100000:2.0:1789518667.814464:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff99fec525df80 x1876445617429632/t30064771259(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.814476:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525df80 with x1876445617429632 ext(8388608->9437183) 00002000:00010000:2.0:1789518667.814486:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525df80 00000100:00100000:1.0:1789518667.820161:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.820246:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617429760 00000100:00100000:0.0:1789518667.820260:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617429760 00002000:00100000:0.0:1789518667.821548:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff99fec525c000 x1876445617429760/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.821561:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525c000 with x1876445617429760 ext(9437184->10485759) 00002000:00010000:0.0:1789518667.821568:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525c000 00000100:00100000:2.0:1789518667.822096:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 309 00000100:00100000:2.0:1789518667.822126:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+32:2344:x1876445617429760:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518667.832438:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.832560:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617429888 00000100:00100000:2.0:1789518667.832574:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617429888 00002000:00100000:2.0:1789518667.832663:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff99fec1ec5880 x1876445617429888/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.832676:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec5880 with x1876445617429888 ext(10485760->11534335) 00002000:00010000:2.0:1789518667.832684:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1ec5880 00000100:00100000:2.0:1789518667.832849:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 310 00000100:00100000:2.0:1789518667.832862:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+34:2344:x1876445617429888:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.834649:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2344:x1876445617429760:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12498us (14459us total) trans 30064771260 rc 0/0 00000100:00100000:2.0:1789518667.834665:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 309 00002000:00100000:2.0:1789518667.834680:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff99fec525c000 x1876445617429760/t30064771260(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.834692:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec525c000 with x1876445617429760 ext(9437184->10485759) 00002000:00010000:2.0:1789518667.834700:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec525c000 00000100:00100000:2.0:1789518667.840668:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2344:x1876445617429888:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7790us (8226us total) trans 30064771261 rc 0/0 00000100:00100000:2.0:1789518667.840684:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 310 00002000:00100000:2.0:1789518667.841912:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff99fec1ec5880 x1876445617429888/t30064771261(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.841926:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec5880 with x1876445617429888 ext(10485760->11534335) 00002000:00010000:2.0:1789518667.841940:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1ec5880 00000100:00100000:0.0:1789518667.844563:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.844722:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617430016 00000100:00100000:2.0:1789518667.844734:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617430016 00002000:00100000:2.0:1789518667.844787:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff99fecb0eb480 x1876445617430016/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.844800:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0eb480 with x1876445617430016 ext(11534336->12582911) 00002000:00010000:2.0:1789518667.844807:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0eb480 00000100:00100000:2.0:1789518667.844849:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 311 00000100:00100000:2.0:1789518667.844861:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+36:2345:x1876445617430016:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.854830:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2345:x1876445617430016:12345-192.168.206.51@tcp:4:dd.0 Request processed in 9954us (10269us total) trans 30064771262 rc 0/0 00000100:00100000:2.0:1789518667.854851:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 311 00002000:00100000:2.0:1789518667.854871:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff99fecb0eb480 x1876445617430016/t30064771262(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.854884:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0eb480 with x1876445617430016 ext(11534336->12582911) 00002000:00010000:2.0:1789518667.854892:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0eb480 00000100:00100000:0.0:1789518667.855702:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.855853:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617430144 00000100:00100000:2.0:1789518667.855865:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617430144 00002000:00100000:2.0:1789518667.855915:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff99fecb0eaa00 x1876445617430144/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.855989:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0eaa00 with x1876445617430144 ext(12582912->13631487) 00002000:00010000:2.0:1789518667.855997:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0eaa00 00000100:00100000:2.0:1789518667.856071:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 312 00000100:00100000:2.0:1789518667.856081:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+38:2345:x1876445617430144:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.868340:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2345:x1876445617430144:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12241us (12626us total) trans 30064771263 rc 0/0 00000100:00100000:2.0:1789518667.868364:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 312 00002000:00100000:2.0:1789518667.868392:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff99fecb0eaa00 x1876445617430144/t30064771263(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.868403:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0eaa00 with x1876445617430144 ext(12582912->13631487) 00002000:00010000:2.0:1789518667.868412:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0eaa00 00000100:00100000:0.0:1789518667.868488:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.868654:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617430272 00000100:00100000:2.0:1789518667.868664:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617430272 00002000:00100000:2.0:1789518667.868707:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff99fecb0e9c00 x1876445617430272/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.868716:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e9c00 with x1876445617430272 ext(13631488->14680063) 00002000:00010000:2.0:1789518667.868719:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e9c00 00000100:00100000:2.0:1789518667.868809:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 313 00000100:00100000:2.0:1789518667.868821:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2345:x1876445617430272:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518667.876891:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2345:x1876445617430272:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8055us (8387us total) trans 30064771264 rc 0/0 00000100:00100000:2.0:1789518667.876909:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 313 00002000:00100000:2.0:1789518667.876926:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff99fecb0e9c00 x1876445617430272/t30064771264(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.876951:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fecb0e9c00 with x1876445617430272 ext(13631488->14680063) 00002000:00010000:2.0:1789518667.876959:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fecb0e9c00 00000100:00100000:0.0:1789518667.888692:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.889136:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617430528 00000100:00100000:2.0:1789518667.889149:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617430528 00000100:00100000:2.0:1789518667.889442:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:2.0:1789518667.889456:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:37449:x1876445617430528:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:2.0:1789518667.890089:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:37449:x1876445617430528:12345-192.168.206.51@tcp:35:dd.0 Request processed in 633us (1411us total) trans 30064771421 rc 0/0 00000100:00100000:2.0:1789518667.890098:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:1.0:1789518667.890914:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.891180:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617430656 00000100:00100000:0.0:1789518667.891190:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617430656 00002000:00100000:0.0:1789518667.891237:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff99fec9671c00 x1876445617430656/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/0 e 0 to 0 dl 1789518678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518667.891257:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9671c00 with x1876445617430656 ext(14680064->15728639) 00002000:00010000:0.0:1789518667.891270:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9671c00 00000100:00100000:0.0:1789518667.892251:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 314 00000100:00100000:0.0:1789518667.892267:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2342:x1876445617430656:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518667.904430:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.904686:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617430784 00000100:00100000:3.0:1789518667.904698:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617430784 00000100:00100000:3.0:1789518667.904767:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 391 00000100:00100000:3.0:1789518667.904780:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:37450:x1876445617430784:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:3.0:1789518667.904811:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518667.904856:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c786e8d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf70 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.904906:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900000/0x631fd8698c786e94 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518667.904906:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2342:x1876445617430656:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12641us (13990us total) trans 30064771265 rc 0/0 00000100:00100000:2.0:1789518667.904925:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 314 00002000:00100000:2.0:1789518667.904939:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff99fec9671c00 x1876445617430656/t30064771265(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:313/0 lens 488/448 e 0 to 0 dl 1789518678 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518667.904948:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec9671c00 with x1876445617430656 ext(14680064->15728639) 00002000:00010000:2.0:1789518667.904955:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec9671c00 00010000:00010000:3.0:1789518667.905008:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900000/0x631fd8698c786e94 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.905025:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900000/0x631fd8698c786e94 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.905146:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c786e8d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf70 expref: 47 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.905171:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900000/0x631fd8698c786e94 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf70 expref: 46 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.905181:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:3.0:1789518667.905185:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518667.905190:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900000, rc 0) 00000100:00100000:3.0:1789518667.906111:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:37450:x1876445617430784:12345-192.168.206.51@tcp:101:chown.0 Request processed in 1328us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518667.906120:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 391 00000100:00100000:1.0:1789518667.911380:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.911522:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617431040 00000100:00100000:0.0:1789518667.911535:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617431040 00000100:00100000:0.0:1789518667.911655:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 392 00000100:00100000:0.0:1789518667.911669:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:37450:x1876445617431040:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:0.0:1789518667.911744:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518667.911782:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786e4e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf54 expref: 46 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.911804:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:0.0:1789518667.911810:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518667.911852:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.911870:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.911882:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518667.912490:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].14, 88 off9256 00000004:00080000:0.0:1789518667.912512:0:35847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721908896747ns, next at 722908893162ns, rc = 0 00000004:00010000:0.0:1789518667.912652:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de5ddd8e reply state 00000000d35514c6 transno 30064771422 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518667.912665:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518667.912801:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:37450:x1876445617431040:12345-192.168.206.51@tcp:36:chown.0 Request processed in 1133us (1445us total) trans 30064771422 rc 0/0 00000100:00100000:0.0:1789518667.912810:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 392 00010000:00010000:2.0:1789518667.914183:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.914197:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.914202:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.914207:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518667.914211:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.914217:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.914230:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518667.914233:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518667.914237:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.914241:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c786e9b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518667.915540:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.915726:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617431168 00000100:00100000:2.0:1789518667.915740:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617431168 00000100:00100000:2.0:1789518667.916035:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 393 00000100:00100000:2.0:1789518667.916050:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:37450:x1876445617431168:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518667.916095:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518667.916485:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786ea2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf77 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.916574:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786ea2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf77 expref: 47 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.916591:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786ea2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf77 expref: 47 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.916667:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518667.916671:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518667.916689:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16800, rc 0) 00000100:00100000:2.0:1789518667.916789:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:37450:x1876445617431168:12345-192.168.206.51@tcp:101:chown.0 Request processed in 739us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518667.916804:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 393 00000100:00100000:0.0:1789518667.920254:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.920379:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617431296 00000100:00100000:3.0:1789518667.920393:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617431296 00000100:00100000:3.0:1789518667.920461:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:3.0:1789518667.920473:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+39:2343:x1876445617431296:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:3.0:1789518667.920776:0:36531:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1789518667.920800:0:36531:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb mtime from disk: 0 -> 1789518668 00002000:00010000:3.0:1789518667.920803:0:36531:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789518667.920806:0:36531:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb ctime from disk: 0 -> 1789518668 00002000:00010000:3.0:1789518667.920808:0:36531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789518667.920893:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2343:x1876445617431296:12345-192.168.206.51@tcp:2:chown.0 Request processed in 421us (654us total) trans 30064771198 rc 0/0 00000100:00100000:3.0:1789518667.920902:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:1.0:1789518667.936673:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518667.937400:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617431424 00000100:00100000:3.0:1789518667.937414:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617431424 00000100:00100000:3.0:1789518667.937549:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 394 00000100:00100000:3.0:1789518667.937563:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:37451:x1876445617431424:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:3.0:1789518667.937591:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518667.937656:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c786ea9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf7e expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.937703:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900600/0x631fd8698c786eb0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.937720:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900600/0x631fd8698c786eb0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.937735:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900600/0x631fd8698c786eb0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.937879:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c786ea9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf7e expref: 49 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.937905:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900600/0x631fd8698c786eb0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf7e expref: 48 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.937941:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:3.0:1789518667.937944:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518667.937949:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900600, rc 0) 00000100:00100000:3.0:1789518667.938010:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:37451:x1876445617431424:12345-192.168.206.51@tcp:101:chown.0 Request processed in 452us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518667.938015:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 394 00000100:00100000:1.0:1789518667.941022:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518667.941309:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617431680 00000100:00100000:0.0:1789518667.941322:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617431680 00000100:00100000:0.0:1789518667.941402:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 395 00000100:00100000:0.0:1789518667.941413:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:37451:x1876445617431680:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:0.0:1789518667.941478:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518667.941509:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786e78 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf62 expref: 48 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.941530:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:0.0:1789518667.941536:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518667.941575:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.941591:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518667.941602:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518667.942140:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].14, 88 off9328 00000004:00080000:0.0:1789518667.942149:0:35847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721938534324ns, next at 722938532467ns, rc = 0 00000004:00010000:0.0:1789518667.942224:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ae5a480 reply state 00000000ea8ac3f5 transno 30064771423 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518667.942233:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518667.942330:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:37451:x1876445617431680:12345-192.168.206.51@tcp:36:chown.0 Request processed in 918us (1318us total) trans 30064771423 rc 0/0 00000100:00100000:0.0:1789518667.942338:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 395 00010000:00010000:3.0:1789518667.944401:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.944420:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.944429:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.944435:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28da00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518667.944441:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.944449:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.944467:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:3.0:1789518667.944470:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518667.944476:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518667.944860:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28da00/0x631fd8698c786eb7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518667.945548:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.949569:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617431808 00000100:00100000:2.0:1789518667.949594:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617431808 00000100:00100000:2.0:1789518667.949794:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 396 00000100:00100000:2.0:1789518667.949809:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:37451:x1876445617431808:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518667.949845:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518667.949871:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786ebe lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf85 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.949957:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786ebe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf85 expref: 49 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.949975:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786ebe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf85 expref: 49 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.950008:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518667.950012:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518667.950016:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16400, rc 0) 00000100:00100000:2.0:1789518667.950108:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:37451:x1876445617431808:12345-192.168.206.51@tcp:101:chown.0 Request processed in 303us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518667.950115:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 396 00000100:00100000:0.0:1789518667.952182:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.952430:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617431936 00000100:00100000:2.0:1789518667.952442:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617431936 00000100:00100000:2.0:1789518667.952516:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:2.0:1789518667.952528:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2342:x1876445617431936:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:2.0:1789518667.953194:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1789518667.953201:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb mtime from disk: 0 -> 1789518668 00002000:00010000:2.0:1789518667.953203:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518667.953206:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb ctime from disk: 0 -> 1789518668 00002000:00010000:2.0:1789518667.953208:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518667.953414:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2342:x1876445617431936:12345-192.168.206.51@tcp:2:chown.0 Request processed in 886us (1242us total) trans 30064771266 rc 0/0 00000100:00100000:2.0:1789518667.953425:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:3.0:1789518667.995853:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518667.996085:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617432064 00000100:00100000:2.0:1789518667.996101:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617432064 00000100:00100000:2.0:1789518667.996204:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 397 00000100:00100000:2.0:1789518667.996218:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:37457:x1876445617432064:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518667.996246:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518667.996275:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786ec5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf8c expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.996399:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786ecc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.996417:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786ecc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.996432:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786ecc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518667.996490:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00000004:00200000:2.0:1789518667.996495:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518667.996524:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786ecc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.996574:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786ec5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf8c expref: 51 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.996601:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16200/0x631fd8698c786ecc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf8c expref: 50 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518667.996694:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518667.996698:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518667.996703:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc6b16200, rc 0) 00000100:00100000:2.0:1789518667.996807:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:37457:x1876445617432064:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 592us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518667.996815:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 397 00000100:00100000:1.0:1789518668.002839:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518668.003070:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617432192 00000100:00100000:3.0:1789518668.003081:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617432192 00000100:00100000:3.0:1789518668.003241:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 398 00000100:00100000:3.0:1789518668.003252:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:37457:x1876445617432192:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518668.003274:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518668.003292:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c786ed3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf93 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003357:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003380:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003392:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003408:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003420:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003427:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003524:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c786ee8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003551:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c786ee8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003559:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c786ee8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518668.003587:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00000004:00200000:3.0:1789518668.003592:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518668.003610:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c786ee8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003749:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c786ee8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003757:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003761:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003766:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003770:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518668.003772:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003777:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003785:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:3.0:1789518668.003792:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518668.003797:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003802:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c786eda lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003812:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003817:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003823:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003828:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518668.003830:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003836:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003843:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518668.003846:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518668.003848:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003854:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c786ee1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003884:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c786ed3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf93 expref: 52 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003899:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c786ee8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf93 expref: 51 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.003905:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:3.0:1789518668.003906:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518668.003908:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900e00, rc 0) 00000100:00100000:3.0:1789518668.004141:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:37457:x1876445617432192:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 889us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518668.004150:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 398 00000100:00100000:3.0:1789518668.006849:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.006985:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617432448 00000100:00100000:2.0:1789518668.006994:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617432448 00000100:00100000:2.0:1789518668.007274:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 399 00000100:00100000:2.0:1789518668.007284:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:37457:x1876445617432448:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518668.007306:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518668.007326:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786eef lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdf9a expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.007433:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ef6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.007449:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ef6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.007463:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ef6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518668.007475:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00010000:00010000:2.0:1789518668.007602:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16a00/0x631fd8698c786eef lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf9a expref: 54 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.007661:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ef6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf9a expref: 53 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.007670:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518668.007673:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518668.007676:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc29e1c00, rc 0) 00000100:00100000:2.0:1789518668.007740:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:37457:x1876445617432448:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 457us (903us total) trans 30064771424 rc 0/0 00000100:00100000:2.0:1789518668.007747:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 399 00000100:00100000:1.0:1789518668.012503:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518668.012553:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518668.012728:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617432576 00000100:00100000:0.0:1789518668.012739:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617432576 00000100:00100000:0.0:1789518668.012806:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1789518668.012816:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:2344:x1876445617432576:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518668.012830:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518668.012853:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1c00/0x631fd8698c786ef6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf9a expref: 53 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.012873:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:0.0:1789518668.012878:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518668.012941:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:2344:x1876445617432576:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 127us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518668.012949:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1789518668.013171:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617432832 00000100:00100000:2.0:1789518668.013176:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617432832 00000100:00100000:2.0:1789518668.013213:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 400 00000100:00100000:2.0:1789518668.013221:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:37457:x1876445617432832:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518668.013242:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518668.013245:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1789518668.013260:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16800/0x631fd8698c786ea2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf77 expref: 52 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013277:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c786ee8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf93 expref: 51 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013287:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518668.013290:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518668.013301:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786f04 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfa1 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013343:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013357:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013376:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013392:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013398:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013404:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013409:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc29e0e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518668.013413:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013419:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013426:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518668.013429:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518668.013432:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013437:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e0e00/0x631fd8698c786f0b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013461:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c786f12 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013470:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c786f12 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013476:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c786f12 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013721:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c786f12 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfa1 expref: 53 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013729:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518668.013731:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518668.013740:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc29e1400/0x631fd8698c786f04 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfa1 expref: 53 pid: 35847 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013752:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fec4981000/0x631fd8698c786f12 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfa1 expref: 52 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.013774:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518668.013776:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518668.013778:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fec4981000, rc 0) 00000100:00100000:2.0:1789518668.013820:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:37457:x1876445617432832:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 600us (1266us total) trans 30064771425 rc 0/0 00000100:00100000:2.0:1789518668.013827:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 400 00000100:00100000:1.0:1789518668.041331:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518668.041454:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617432960 00000100:00100000:3.0:1789518668.041463:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617432960 00002000:00100000:3.0:1789518668.041510:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff99fec1b9ea00 x1876445617432960/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518668.041521:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9ea00 with x1876445617432960 ext(0->1048575) 00002000:00010000:3.0:1789518668.041527:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1b9ea00 00000100:00100000:3.0:1789518668.041567:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 315 00000100:00100000:3.0:1789518668.041581:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2344:x1876445617432960:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518668.053418:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2344:x1876445617432960:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 11826us (12096us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789518668.053434:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 315 00002000:00100000:3.0:1789518668.053451:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff99fec1b9ea00 x1876445617432960/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518668.053485:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1b9ea00 with x1876445617432960 ext(0->1048575) 00002000:00010000:3.0:1789518668.053494:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1b9ea00 00000100:00100000:3.0:1789518668.066132:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.066239:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617433088 00000100:00100000:2.0:1789518668.066254:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617433088 00002000:00100000:2.0:1789518668.066309:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff99fec1ec5f80 x1876445617433088/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.066320:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec5f80 with x1876445617433088 ext(1048576->2097151) 00002000:00010000:2.0:1789518668.066326:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec5f80 00000100:00100000:2.0:1789518668.066438:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 316 00000100:00100000:2.0:1789518668.066448:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2343:x1876445617433088:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.079880:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2343:x1876445617433088:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 13412us (13741us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.079899:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 316 00002000:00100000:2.0:1789518668.079930:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff99fec1ec5f80 x1876445617433088/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.079944:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec5f80 with x1876445617433088 ext(1048576->2097151) 00002000:00010000:2.0:1789518668.079952:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec5f80 00000040:00080000:1.0:1789518668.082975:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518668.082988:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518668.083119:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 10 00000040:00080000:1.0:1789518668.083130:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518668.097097:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518668.097146:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518668.097252:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617433216 00000100:00100000:1.0:1789518668.097266:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617433216 00002000:00100000:1.0:1789518668.097354:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff99ffc52bc000 x1876445617433216/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.097380:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bc000 with x1876445617433216 ext(2097152->3145727) 00002000:00010000:1.0:1789518668.097388:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bc000 00000100:00100000:1.0:1789518668.097422:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617433344 00000100:00100000:1.0:1789518668.097425:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617433344 00002000:00100000:1.0:1789518668.097441:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff99fed35f2680 x1876445617433344/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.097450:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f2680 with x1876445617433344 ext(3145728->4194303) 00002000:00010000:1.0:1789518668.097453:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f2680 00000100:00100000:1.0:1789518668.097552:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 317 00000100:00100000:1.0:1789518668.097564:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2342:x1876445617433216:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518668.098640:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 318 00000100:00100000:3.0:1789518668.098657:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2342:x1876445617433344:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.111243:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2342:x1876445617433216:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 13661us (14141us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.111259:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 317 00002000:00100000:2.0:1789518668.111276:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff99ffc52bc000 x1876445617433216/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.111287:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc52bc000 with x1876445617433216 ext(2097152->3145727) 00002000:00010000:2.0:1789518668.111296:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc52bc000 00000100:00100000:3.0:1789518668.112144:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2342:x1876445617433344:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 13427us (14931us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789518668.112156:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 318 00002000:00100000:3.0:1789518668.112166:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff99fed35f2680 x1876445617433344/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518668.112175:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f2680 with x1876445617433344 ext(3145728->4194303) 00002000:00010000:3.0:1789518668.112181:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f2680 00000100:00100000:0.0:1789518668.153275:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518668.153326:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518668.153419:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617433472 00000100:00100000:3.0:1789518668.153434:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617433472 00000100:00100000:2.0:1789518668.153464:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617433600 00000100:00100000:2.0:1789518668.153469:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617433600 00002000:00100000:3.0:1789518668.153498:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff99fed35f3480 x1876445617433472/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.153498:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff99fed35f3b80 x1876445617433600/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518668.153511:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f3480 with x1876445617433472 ext(4194304->5242879) 00002000:00100000:2.0:1789518668.153517:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f3b80 with x1876445617433600 ext(5242880->6291455) 00002000:00010000:3.0:1789518668.153518:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f3480 00002000:00010000:2.0:1789518668.153520:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f3b80 00000100:00100000:3.0:1789518668.153551:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 319 00000100:00100000:3.0:1789518668.153561:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2343:x1876445617433472:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.153643:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 320 00000100:00100000:2.0:1789518668.153651:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+41:2342:x1876445617433600:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518668.156427:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518668.156472:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518668.156649:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617433856 00000100:00100000:0.0:1789518668.156664:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617433856 00000100:00100000:2.0:1789518668.156931:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617433728 00002000:00100000:0.0:1789518668.156935:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff99ffffe5a680 x1876445617433856/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789518668.156938:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617433728 00002000:00100000:0.0:1789518668.156962:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe5a680 with x1876445617433856 ext(7340032->8388607) 00002000:00100000:2.0:1789518668.156968:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff99ffffe5b480 x1876445617433728/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00010000:0.0:1789518668.156971:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe5a680 00002000:00100000:2.0:1789518668.156982:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe5b480 with x1876445617433728 ext(6291456->7340031) 00002000:00010000:2.0:1789518668.156986:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe5b480 00000100:00100000:0.0:1789518668.157016:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 321 00000100:00100000:0.0:1789518668.157027:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2343:x1876445617433856:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.157091:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 322 00000100:00100000:2.0:1789518668.157103:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2343:x1876445617433728:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.167853:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2342:x1876445617433600:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 14187us (14511us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.167869:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 320 00002000:00100000:2.0:1789518668.167884:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff99fed35f3b80 x1876445617433600/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.167896:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f3b80 with x1876445617433600 ext(5242880->6291455) 00002000:00010000:2.0:1789518668.167904:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f3b80 00000100:00100000:2.0:1789518668.172137:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2343:x1876445617433728:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 15018us (15646us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.172153:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 322 00002000:00100000:2.0:1789518668.172172:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff99ffffe5b480 x1876445617433728/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.172183:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe5b480 with x1876445617433728 ext(6291456->7340031) 00002000:00010000:2.0:1789518668.172191:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe5b480 00000100:00100000:2.0:1789518668.172271:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2343:x1876445617433472:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 18711us (19021us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.172279:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 319 00002000:00100000:2.0:1789518668.172286:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff99fed35f3480 x1876445617433472/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.172295:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f3480 with x1876445617433472 ext(4194304->5242879) 00002000:00010000:2.0:1789518668.172298:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fed35f3480 00000100:00100000:3.0:1789518668.175287:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2343:x1876445617433856:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 18247us (18859us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789518668.175319:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 321 00002000:00100000:3.0:1789518668.175334:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff99ffffe5a680 x1876445617433856/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518668.175346:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe5a680 with x1876445617433856 ext(7340032->8388607) 00002000:00010000:3.0:1789518668.175354:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe5a680 00000100:00100000:1.0:1789518668.220540:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518668.221390:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617433984 00000100:00100000:0.0:1789518668.221405:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617433984 00000100:00100000:1.0:1789518668.221426:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00002000:00100000:0.0:1789518668.221464:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff99ffffe59f80 x1876445617433984/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1789518668.221482:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00002000:00100000:0.0:1789518668.221492:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe59f80 with x1876445617433984 ext(8388608->9437183) 00002000:00010000:0.0:1789518668.221500:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe59f80 00000100:00100000:0.0:1789518668.221605:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617434112 00000100:00100000:0.0:1789518668.221610:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617434112 00000100:00100000:1.0:1789518668.221635:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518668.221670:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00002000:00100000:0.0:1789518668.221676:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff99ffffe58380 x1876445617434112/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.221687:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58380 with x1876445617434112 ext(9437184->10485759) 00002000:00010000:0.0:1789518668.221692:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe58380 00000100:00100000:1.0:1789518668.221708:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518668.221710:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617434368 00000100:00100000:0.0:1789518668.221715:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617434368 00000100:00100000:1.0:1789518668.221754:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00002000:00100000:0.0:1789518668.221814:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff99ffffe58700 x1876445617434368/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.221823:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58700 with x1876445617434368 ext(11534336->12582911) 00002000:00010000:0.0:1789518668.221827:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe58700 00000100:00100000:0.0:1789518668.221837:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617434624 00000100:00100000:0.0:1789518668.221841:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617434624 00002000:00100000:0.0:1789518668.221855:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff99ffffe59180 x1876445617434624/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.221862:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe59180 with x1876445617434624 ext(13631488->14680063) 00002000:00010000:0.0:1789518668.221865:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe59180 00000100:00100000:0.0:1789518668.221872:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617434240 00000100:00100000:0.0:1789518668.221874:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617434240 00002000:00100000:0.0:1789518668.221886:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff99ffffe59880 x1876445617434240/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.221893:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe59880 with x1876445617434240 ext(10485760->11534335) 00002000:00010000:0.0:1789518668.221896:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe59880 00000100:00100000:0.0:1789518668.221902:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617434496 00000100:00100000:0.0:1789518668.221904:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617434496 00002000:00100000:0.0:1789518668.221916:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff99ffffe59c00 x1876445617434496/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.221923:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe59c00 with x1876445617434496 ext(12582912->13631487) 00002000:00010000:0.0:1789518668.221925:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe59c00 00000100:00100000:0.0:1789518668.221931:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617434752 00000100:00100000:0.0:1789518668.221933:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617434752 00002000:00100000:0.0:1789518668.221945:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff99ffffe58a80 x1876445617434752/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.221952:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58a80 with x1876445617434752 ext(14680064->15728639) 00002000:00010000:0.0:1789518668.221955:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe58a80 00000100:00100000:0.0:1789518668.221967:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 323 00000100:00100000:0.0:1789518668.221976:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2344:x1876445617433984:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.222402:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 324 00000100:00100000:2.0:1789518668.222423:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2344:x1876445617434112:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518668.222791:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 325 00000100:00100000:3.0:1789518668.222805:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:2344:x1876445617434368:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.223757:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 326 00000100:00100000:2.0:1789518668.223772:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:2344:x1876445617434624:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.232469:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:2344:x1876445617434112:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 10035us (11164us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.232496:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 324 00002000:00100000:2.0:1789518668.232514:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff99ffffe58380 x1876445617434112/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.232527:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58380 with x1876445617434112 ext(9437184->10485759) 00002000:00010000:2.0:1789518668.232535:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe58380 00000100:00100000:2.0:1789518668.232578:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 327 00000100:00100000:2.0:1789518668.232593:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:2344:x1876445617434240:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518668.240494:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:2344:x1876445617433984:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 18508us (19959us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518668.240507:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 323 00002000:00100000:1.0:1789518668.240520:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff99ffffe59f80 x1876445617433984/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.240530:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe59f80 with x1876445617433984 ext(8388608->9437183) 00002000:00010000:1.0:1789518668.240537:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe59f80 00000100:00100000:1.0:1789518668.240567:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 328 00000100:00100000:1.0:1789518668.240579:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2344:x1876445617434496:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518668.242081:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2344:x1876445617434368:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 19273us (20601us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518668.242091:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 325 00002000:00100000:1.0:1789518668.242101:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff99ffffe58700 x1876445617434368/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.242112:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58700 with x1876445617434368 ext(11534336->12582911) 00002000:00010000:1.0:1789518668.242117:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe58700 00000100:00100000:1.0:1789518668.242141:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 329 00000100:00100000:1.0:1789518668.242151:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2344:x1876445617434752:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.246225:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2344:x1876445617434624:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 22447us (24605us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.246238:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 326 00002000:00100000:2.0:1789518668.246251:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff99ffffe59180 x1876445617434624/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.246261:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe59180 with x1876445617434624 ext(13631488->14680063) 00002000:00010000:2.0:1789518668.246268:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe59180 00000100:00100000:2.0:1789518668.256724:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2344:x1876445617434240:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 24118us (35037us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.256741:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 327 00002000:00100000:2.0:1789518668.256757:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff99ffffe59880 x1876445617434240/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.256767:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe59880 with x1876445617434240 ext(10485760->11534335) 00002000:00010000:2.0:1789518668.256776:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe59880 00000100:00100000:1.0:1789518668.260302:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+42:2344:x1876445617434496:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 19710us (38583us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518668.260319:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 328 00002000:00100000:1.0:1789518668.260337:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff99ffffe59c00 x1876445617434496/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.260383:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe59c00 with x1876445617434496 ext(12582912->13631487) 00002000:00010000:1.0:1789518668.260391:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe59c00 00000100:00100000:3.0:1789518668.260529:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+40:2344:x1876445617434752:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 18379us (38774us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789518668.260538:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 329 00002000:00100000:3.0:1789518668.260545:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff99ffffe58a80 x1876445617434752/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518668.260555:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffffe58a80 with x1876445617434752 ext(14680064->15728639) 00002000:00010000:3.0:1789518668.260559:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffffe58a80 00000100:00100000:0.0:1789518668.314539:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.314747:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617435008 00000100:00100000:2.0:1789518668.314757:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617435008 00000100:00100000:2.0:1789518668.314862:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:2.0:1789518668.314873:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc33c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:37457:x1876445617435008:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:2.0:1789518668.315120:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc33c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:37457:x1876445617435008:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 248us (589us total) trans 30064771426 rc 0/0 00000100:00100000:2.0:1789518668.315129:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:2.0:1789518668.358845:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518668.359740:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617435136 00000100:00100000:3.0:1789518668.359754:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617435136 00000100:00100000:3.0:1789518668.359842:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 401 00000100:00100000:3.0:1789518668.359853:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:37463:x1876445617435136:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518668.359884:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518668.359910:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c786f19 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfa8 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360386:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360420:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360433:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360451:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360459:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360465:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360588:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786f2e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360598:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786f2e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360606:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786f2e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518668.360685:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 15728640 00000004:00200000:3.0:1789518668.360691:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518668.360715:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786f2e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360728:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786f2e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360748:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360755:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360762:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360769:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518668.360774:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360783:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360797:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:3.0:1789518668.360801:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518668.360807:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360814:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c786f20 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360830:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360836:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360842:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360853:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518668.360857:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360862:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360870:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518668.360872:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518668.360875:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.360881:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c786f27 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.361420:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c786f19 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfa8 expref: 55 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.361442:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786f2e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfa8 expref: 54 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518668.361450:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:3.0:1789518668.361452:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518668.361455:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901200, rc 0) 00000100:00100000:2.0:1789518668.361707:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:37463:x1876445617435136:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 1852us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518668.361718:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 401 00000100:00100000:0.0:1789518668.366854:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.366955:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617435392 00000100:00100000:2.0:1789518668.366969:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617435392 00000100:00100000:2.0:1789518668.367080:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 402 00000100:00100000:2.0:1789518668.367097:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:37463:x1876445617435392:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518668.367127:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518668.367150:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c786f35 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfaf expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.367275:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c786f3c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.367359:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c786f3c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.367385:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c786f3c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518668.367399:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 15728640 00010000:00010000:2.0:1789518668.367562:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c786f35 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfaf expref: 57 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.367583:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c786f3c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfaf expref: 56 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.367592:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518668.367595:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518668.367599:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380a00, rc 0) 00000100:00100000:2.0:1789518668.367719:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:37463:x1876445617435392:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 625us (880us total) trans 30064771427 rc 0/0 00000100:00100000:2.0:1789518668.367727:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 402 00000100:00100000:0.0:1789518668.370052:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.370238:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617435648 00000100:00100000:2.0:1789518668.370250:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617435648 00000100:00100000:2.0:1789518668.370683:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 403 00000100:00100000:2.0:1789518668.370697:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:37463:x1876445617435648:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518668.370729:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518668.370733:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:2.0:1789518668.370766:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc6b16400/0x631fd8698c786ebe lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf85 expref: 56 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.370789:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c786f3c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfaf expref: 55 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.370802:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786f2e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfa8 expref: 54 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.370812:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518668.370817:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518668.370832:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380800/0x631fd8698c786f4a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfb6 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.370884:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.370900:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.370917:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371049:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371057:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371065:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371072:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518668.371077:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371086:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371095:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518668.371097:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518668.371101:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371107:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c786f51 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371134:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381600/0x631fd8698c786f58 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371143:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381600/0x631fd8698c786f58 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371150:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381600/0x631fd8698c786f58 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371473:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381600/0x631fd8698c786f58 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfb6 expref: 56 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371482:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518668.371484:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518668.371495:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380800/0x631fd8698c786f4a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfb6 expref: 56 pid: 35847 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371509:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381600/0x631fd8698c786f58 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfb6 expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.371535:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:2.0:1789518668.371537:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518668.371540:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381600, rc 0) 00000100:00100000:2.0:1789518668.371691:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:37463:x1876445617435648:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 997us (1649us total) trans 30064771428 rc 0/0 00000100:00100000:2.0:1789518668.371699:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 403 00000100:00100000:0.0:1789518668.389560:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.389728:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617435776 00000100:00100000:2.0:1789518668.389742:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617435776 00002000:00100000:2.0:1789518668.389823:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff99fed35f2300 x1876445617435776/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.389836:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f2300 with x1876445617435776 ext(0->1048575) 00002000:00010000:2.0:1789518668.389843:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fed35f2300 00000100:00100000:2.0:1789518668.389884:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 330 00000100:00100000:2.0:1789518668.389895:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2342:x1876445617435776:12345-192.168.206.51@tcp:3:lfs.0 00000100:00080000:1.0:1789518668.390003:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518668.397179:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2342:x1876445617435776:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 7269us (7618us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.397195:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 330 00002000:00100000:2.0:1789518668.397210:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff99fed35f2300 x1876445617435776/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.397223:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fed35f2300 with x1876445617435776 ext(0->1048575) 00002000:00010000:2.0:1789518668.397232:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fed35f2300 00000100:00100000:0.0:1789518668.410987:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.411072:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617435904 00000100:00100000:2.0:1789518668.411085:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617435904 00002000:00100000:2.0:1789518668.411149:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff99ffedb28e00 x1876445617435904/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.411162:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb28e00 with x1876445617435904 ext(1048576->2097151) 00002000:00010000:2.0:1789518668.411169:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb28e00 00000100:00100000:2.0:1789518668.411210:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 331 00000100:00100000:2.0:1789518668.411221:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2344:x1876445617435904:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.419778:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2344:x1876445617435904:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 8541us (8790us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.419795:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 331 00002000:00100000:2.0:1789518668.419812:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff99ffedb28e00 x1876445617435904/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.419824:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb28e00 with x1876445617435904 ext(1048576->2097151) 00002000:00010000:2.0:1789518668.419834:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb28e00 00000100:00100000:0.0:1789518668.435790:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518668.436683:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518668.437119:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617436032 00000100:00100000:1.0:1789518668.437120:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617436160 00000100:00100000:1.0:1789518668.437135:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617436160 00000100:00100000:3.0:1789518668.437136:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617436032 00002000:00100000:3.0:1789518668.437202:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff99ffedb2a300 x1876445617436032/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.437204:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff99ffedb29f80 x1876445617436160/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.437229:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29f80 with x1876445617436160 ext(3145728->4194303) 00002000:00010000:1.0:1789518668.437237:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb29f80 00002000:00100000:3.0:1789518668.437251:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2a300 with x1876445617436032 ext(2097152->3145727) 00002000:00010000:3.0:1789518668.437255:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb2a300 00000100:00100000:1.0:1789518668.437285:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 332 00000100:00100000:1.0:1789518668.437299:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2345:x1876445617436160:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518668.437343:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 333 00000100:00100000:3.0:1789518668.437354:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:2345:x1876445617436032:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:2.0:1789518668.454835:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2345:x1876445617436160:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 17523us (18301us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518668.454852:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 332 00002000:00100000:2.0:1789518668.454869:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff99ffedb29f80 x1876445617436160/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518668.454881:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29f80 with x1876445617436160 ext(3145728->4194303) 00002000:00010000:2.0:1789518668.454889:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb29f80 00000100:00100000:1.0:1789518668.456854:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2345:x1876445617436032:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 19488us (21065us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518668.456869:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 333 00002000:00100000:1.0:1789518668.456884:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff99ffedb2a300 x1876445617436032/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.456896:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2a300 with x1876445617436032 ext(2097152->3145727) 00002000:00010000:1.0:1789518668.456904:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb2a300 00000100:00100000:3.0:1789518668.487210:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518668.487333:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617436288 00000100:00100000:1.0:1789518668.487347:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617436288 00002000:00100000:1.0:1789518668.488156:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff99fec1ec5500 x1876445617436288/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.488169:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec5500 with x1876445617436288 ext(4194304->5242879) 00002000:00010000:1.0:1789518668.488192:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1ec5500 00000100:00100000:1.0:1789518668.488226:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 334 00000100:00100000:1.0:1789518668.488237:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2343:x1876445617436288:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:0.0:1789518668.489010:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518668.489047:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518668.489075:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617436416 00000100:00100000:0.0:1789518668.489079:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518668.489085:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617436416 00000100:00100000:0.0:1789518668.489103:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617436544 00000100:00100000:0.0:1789518668.489107:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617436544 00002000:00100000:0.0:1789518668.489130:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff99ffedb29180 x1876445617436544/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.489139:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29180 with x1876445617436544 ext(6291456->7340031) 00002000:00010000:0.0:1789518668.489143:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb29180 00000100:00100000:0.0:1789518668.489160:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617436672 00000100:00100000:0.0:1789518668.489162:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617436672 00002000:00100000:0.0:1789518668.489177:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff99ffedb2bb80 x1876445617436672/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.489184:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2bb80 with x1876445617436672 ext(7340032->8388607) 00000100:00100000:1.0:1789518668.489188:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 335 00002000:00010000:0.0:1789518668.489189:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb2bb80 00002000:00100000:3.0:1789518668.489191:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff99ffedb2a680 x1876445617436416/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/0 e 0 to 0 dl 1789518679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1789518668.489204:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:2343:x1876445617436544:12345-192.168.206.51@tcp:3:lfs.0 00002000:00100000:3.0:1789518668.489206:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2a680 with x1876445617436416 ext(5242880->6291455) 00002000:00010000:3.0:1789518668.489214:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb2a680 00000100:00100000:0.0:1789518668.489220:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 336 00000100:00100000:0.0:1789518668.489229:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:2343:x1876445617436672:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:3.0:1789518668.489240:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 337 00000100:00100000:3.0:1789518668.489251:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:2342:x1876445617436416:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:1.0:1789518668.495797:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:2343:x1876445617436288:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 7543us (8583us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518668.495812:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 334 00002000:00100000:1.0:1789518668.495829:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff99fec1ec5500 x1876445617436288/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.495840:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec5500 with x1876445617436288 ext(4194304->5242879) 00002000:00010000:1.0:1789518668.495849:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec1ec5500 00000100:00100000:1.0:1789518668.505773:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:2343:x1876445617436544:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 16557us (16710us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518668.505789:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 335 00002000:00100000:1.0:1789518668.505804:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff99ffedb29180 x1876445617436544/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518668.505815:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb29180 with x1876445617436544 ext(6291456->7340031) 00002000:00010000:1.0:1789518668.505822:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb29180 00000100:00100000:0.0:1789518668.506807:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:2343:x1876445617436672:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 17570us (17719us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518668.506818:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 336 00002000:00100000:0.0:1789518668.506829:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff99ffedb2bb80 x1876445617436672/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.506839:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2bb80 with x1876445617436672 ext(7340032->8388607) 00002000:00010000:0.0:1789518668.506844:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb2bb80 00000100:00100000:0.0:1789518668.510662:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:2342:x1876445617436416:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 21366us (21608us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518668.510679:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 337 00002000:00100000:0.0:1789518668.510697:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff99ffedb2a680 x1876445617436416/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:314/0 lens 488/440 e 0 to 0 dl 1789518679 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518668.510708:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffedb2a680 with x1876445617436416 ext(5242880->6291455) 00002000:00010000:0.0:1789518668.510717:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffedb2a680 00000100:00100000:2.0:1789518668.530239:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518668.530385:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617436928 00000100:00100000:3.0:1789518668.530399:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617436928 00000100:00100000:3.0:1789518668.530472:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:3.0:1789518668.530484:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:37463:x1876445617436928:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:2.0:1789518668.531091:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:37463:x1876445617436928:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 607us (871us total) trans 30064771429 rc 0/0 00000100:00100000:2.0:1789518668.531098:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:1.0:1789518668.587015:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.588094:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617437184 00000100:00100000:2.0:1789518668.588111:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617437184 00000100:00100000:2.0:1789518668.588203:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 404 00000100:00100000:2.0:1789518668.588216:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:37473:x1876445617437184:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518668.588247:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518668.588273:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c786f5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfbd expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518668.588412:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00010000:00010000:2.0:1789518668.588879:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c786f5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfbd expref: 58 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.588896:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:2.0:1789518668.588899:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518668.588907:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6c00/0x631fd8698c786f5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfbd expref: 58 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.588924:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6c00, rc 0) 00000100:00100000:2.0:1789518668.589014:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:37473:x1876445617437184:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 801us (2013us total) trans 30064771430 rc 301/301 00000100:00100000:2.0:1789518668.589022:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 404 00000100:00100000:3.0:1789518668.590897:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.591695:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617437312 00000100:00100000:2.0:1789518668.591708:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617437312 00000100:00100000:2.0:1789518668.591834:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 405 00000100:00100000:2.0:1789518668.591846:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:37473:x1876445617437312:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518668.591951:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.591971:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.591983:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592000:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592007:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592013:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592122:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592133:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592141:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518668.592188:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592203:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592210:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592217:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592224:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518668.592228:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592236:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592249:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518668.592252:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518668.592258:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592265:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786f6d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592280:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592287:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592293:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592298:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518668.592301:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592308:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592315:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff99ffc13ed300) 00010000:00010000:2.0:1789518668.592317:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518668.592320:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592326:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f74 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592341:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592348:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592354:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592360:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518668.592375:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592382:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592391:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518668.592393:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518668.592396:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.592402:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f7b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518668.592578:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:37473:x1876445617437312:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 732us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518668.592587:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 405 00000100:00100000:0.0:1789518668.595334:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518668.595449:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617437568 00000100:00100000:3.0:1789518668.595461:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617437568 00000100:00100000:3.0:1789518668.595546:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:3.0:1789518668.595558:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:37473:x1876445617437568:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518668.595928:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:37473:x1876445617437568:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 362us (597us total) trans 30064771431 rc 0/0 00000100:00100000:3.0:1789518668.595957:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:1.0:1789518668.650196:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.650273:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617437824 00000100:00100000:2.0:1789518668.650288:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617437824 00000100:00100000:2.0:1789518668.650414:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 406 00000100:00100000:2.0:1789518668.650426:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:37483:x1876445617437824:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518668.650457:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518668.650481:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfc4 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.650644:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f89 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.650665:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f89 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.650677:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f89 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518668.650690:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 16384 00010000:00010000:2.0:1789518668.650842:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786f82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfc4 expref: 61 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.650864:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7200/0x631fd8698c786f89 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfc4 expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.650874:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518668.650876:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518668.650880:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7200, rc 0) 00000100:00100000:2.0:1789518668.650950:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:37483:x1876445617437824:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 527us (767us total) trans 30064771432 rc 0/0 00000100:00100000:2.0:1789518668.650958:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 406 00000100:00100000:2.0:1789518668.653698:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518668.654130:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617437952 00000100:00100000:0.0:1789518668.654144:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617437952 00000100:00100000:0.0:1789518668.654220:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 407 00000100:00100000:0.0:1789518668.654232:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:37483:x1876445617437952:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518668.654334:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.654355:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.654379:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.654399:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.654412:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.654419:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.654531:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.654541:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.654547:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518668.654599:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655642:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655656:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655664:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655670:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed75400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518668.655676:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655684:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655701:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:0.0:1789518668.655705:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518668.655711:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655717:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75400/0x631fd8698c786f97 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655734:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655741:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655747:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655752:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed75a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518668.655754:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655760:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655767:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518668.655769:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518668.655772:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655778:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed75a00/0x631fd8698c786f9e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655802:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655809:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655813:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655815:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed74e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518668.655817:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655820:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655826:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff99ffc13ed400) 00010000:00010000:0.0:1789518668.655828:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518668.655831:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518668.655838:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed74e00/0x631fd8698c786fa5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518668.655961:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:37483:x1876445617437952:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1726us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518668.655972:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 407 00010000:00010000:2.0:1789518668.659040:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518668.705862:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.706020:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617438080 00000100:00100000:2.0:1789518668.706034:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617438080 00000100:00100000:2.0:1789518668.706185:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 408 00000100:00100000:2.0:1789518668.706198:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:37489:x1876445617438080:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518668.706230:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518668.706259:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786fac lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfcb expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.706339:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.706357:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.706520:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.706543:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.706551:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.706557:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.706907:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c786fc1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.706921:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c786fc1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.706929:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c786fc1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518668.706975:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00000004:00200000:2.0:1789518668.706981:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518668.707004:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c786fc1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707022:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c786fc1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707031:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707039:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707046:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707053:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518668.707058:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707067:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707087:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff99fec3b12900) 00010000:00010000:2.0:1789518668.707090:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518668.707096:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707103:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6400/0x631fd8698c786fb3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707134:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707141:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707146:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707152:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518668.707155:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707161:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707169:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff99ffc13ed300) 00010000:00010000:2.0:1789518668.707171:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518668.707174:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707181:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7e00/0x631fd8698c786fba lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707227:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7000/0x631fd8698c786fac lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfcb expref: 62 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707242:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6600/0x631fd8698c786fc1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfcb expref: 61 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.707249:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518668.707252:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518668.707254:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6600, rc 0) 00000100:00100000:2.0:1789518668.707344:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:37489:x1876445617438080:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1149us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518668.707356:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 408 00000100:00100000:1.0:1789518668.710678:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518668.710765:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617438336 00000100:00100000:2.0:1789518668.710779:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617438336 00000100:00100000:2.0:1789518668.710849:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 409 00000100:00100000:2.0:1789518668.710861:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:37489:x1876445617438336:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518668.710889:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518668.710915:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c786fc8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfd2 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.711047:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7a00/0x631fd8698c786fcf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.711067:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7a00/0x631fd8698c786fcf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.711081:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7a00/0x631fd8698c786fcf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518668.711094:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00010000:00010000:2.0:1789518668.711260:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7400/0x631fd8698c786fc8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfd2 expref: 64 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.711283:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7a00/0x631fd8698c786fcf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfd2 expref: 63 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518668.711292:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:2.0:1789518668.711295:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518668.711299:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f7a00, rc 0) 00000100:00100000:2.0:1789518668.711444:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:37489:x1876445617438336:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 584us (779us total) trans 30064771433 rc 0/0 00000100:00100000:2.0:1789518668.711453:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 409 00000100:00100000:3.0:1789518668.714645:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518668.715516:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617438464 00000100:00100000:1.0:1789518668.715779:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617438464 00000100:00100000:1.0:1789518668.715964:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1789518668.715976:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1080050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:2343:x1876445617438464:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518668.715996:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518668.716028:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7a00/0x631fd8698c786fcf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfd2 expref: 63 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518668.716052:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff99fec3b12f00) 00010000:00010000:1.0:1789518668.716058:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518668.716256:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518668.716309:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1080050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:2343:x1876445617438464:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 333us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518668.716318:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:2.0:1789518668.716320:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617438720 00000100:00100000:2.0:1789518668.716327:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617438720 00000100:00100000:2.0:1789518668.716385:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:2.0:1789518668.716396:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:37489:x1876445617438720:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518668.716817:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:37489:x1876445617438720:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 422us (560us total) trans 30064771434 rc 0/0 00000100:00100000:2.0:1789518668.716825:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000001:00080000:2.0:1789518669.480553:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771197 is committed 00000001:00080000:2.0:1789518669.480642:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771182 is committed 00000001:00080000:2.0:1789518669.480649:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771198 is committed 00010000:00010000:3.0:1789518669.684419:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518670.706997:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789518670.962897:0:35868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 724959280783ns, next at 725959278234ns, rc = 0 00000100:00100000:3.0:1789518670.962925:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627667840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518670.962991:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518670.963064:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627667840 00000100:00100000:3.0:1789518670.963071:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627667840 00000100:00100000:3.0:1789518670.963125:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789518670.963134:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627667840:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518670.963236:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789518670.963292:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 204406784 pending 0 free 3781165056 avail 3779067904 00000100:00100000:3.0:1789518670.963347:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627667840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518670.963364:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789518670.963546:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771182 gen 2 00000004:00080000:2.0:1789518670.963553:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffc6389180, transno 30064771182 00000100:00100000:2.0:1789518670.963574:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627667840:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789518671.022420:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771423 is committed 00000004:00080000:3.0:1789518671.022431:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000004:00080000:3.0:1789518671.022449:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000001:00080000:3.0:1789518671.022471:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771434 is committed 00000004:00080000:3.0:1789518671.022519:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000100:00100000:3.0:1789518671.022713:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627668096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789518671.022774:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518671.022820:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627667968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518671.022854:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518671.022886:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627667968 00000100:00100000:0.0:1789518671.022886:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627668096 00000100:00100000:1.0:1789518671.022892:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627667968 00000100:00100000:0.0:1789518671.022892:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627668096 00000100:00100000:0.0:1789518671.022938:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789518671.022949:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627668096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789518671.023125:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789518671.023134:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627667968:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789518671.023162:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1789518671.023245:0:37973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:0.0:1789518671.023250:0:37973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb mtime from disk: 1789518668 -> 1789518668 00002000:00010000:0.0:1789518671.023252:0:37973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518671.023255:0:37973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb ctime from disk: 1789518668 -> 1789518668 00002000:00010000:0.0:1789518671.023257:0:37973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:0.0:1789518671.023303:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627668096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 356us (529us total) trans 30064771199 rc 0/0 00000100:00100000:0.0:1789518671.023311:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00002000:00010000:1.0:1789518671.023322:0:36735:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:1.0:1789518671.023325:0:36735:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb mtime from disk: 1789518668 -> 1789518668 00002000:00010000:1.0:1789518671.023327:0:36735:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789518671.023330:0:36735:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb ctime from disk: 1789518668 -> 1789518668 00002000:00010000:1.0:1789518671.023333:0:36735:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 30727 00000004:00080000:0.0:1789518671.023371:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec48d4a80/2, rc 0, transno 30064771199 00000100:00100000:0.0:1789518671.023378:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627668096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789518671.024418:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627667968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1282us (1558us total) trans 30064771267 rc 0/0 00000100:00100000:1.0:1789518671.024428:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000004:00080000:0.0:1789518671.024553:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec48d4380/2, rc 0, transno 30064771267 00000100:00100000:0.0:1789518671.024559:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627667968:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1789518671.026222:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771251 is committed 00000001:00080000:1.0:1789518671.026242:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771266 is committed 00000001:00080000:1.0:1789518671.026292:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771249 is committed 00000100:00100000:3.0:1789518671.245440:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518671.245835:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617438848 00000100:00100000:1.0:1789518671.245849:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617438848 00002000:00100000:1.0:1789518671.245908:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc6:0x0] (42811392->42991615) req@ffff99fec48d5880 x1876445617438848/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:317/0 lens 488/0 e 0 to 0 dl 1789518682 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518671.245918:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5880 with x1876445617438848 ext(42811392->42991615) 00002000:00010000:1.0:1789518671.245923:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec48d5880 00000100:00100000:1.0:1789518671.245966:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 338 00000100:00080000:3.0:1789518671.245971:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518671.245977:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617438848:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518671.252635:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617438848:12345-192.168.206.51@tcp:4:dd.0 Request processed in 6632us (7175us total) trans 30064771268 rc 0/0 00000100:00100000:2.0:1789518671.252649:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 338 00002000:00100000:2.0:1789518671.252661:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xc6:0x0] (42811392->42991615) req@ffff99fec48d5880 x1876445617438848/t30064771268(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:317/0 lens 488/448 e 0 to 0 dl 1789518682 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518671.252672:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5880 with x1876445617438848 ext(42811392->42991615) 00002000:00010000:2.0:1789518671.252679:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec48d5880 00000100:00100000:3.0:1789518671.474905:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627668480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518671.474911:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627668352:0@lo:400:kworker.0 00000100:00100000:2.0:1789518671.475000:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627668224:0@lo:400:kworker.0 00000100:00100000:1.0:1789518671.475260:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627668608:0@lo:400:kworker.0 00000100:00100000:0.0:1789518671.475988:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518671.476069:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627668352 00000100:00100000:0.0:1789518671.476076:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627668352 00000100:00100000:0.0:1789518671.476125:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789518671.476134:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627668352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518671.476222:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518671.476251:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627668736:0@lo:400:kworker.0 00000100:00100000:2.0:1789518671.476279:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518671.476307:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627668224 00000100:00100000:2.0:1789518671.476311:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627668224 00000100:00100000:2.0:1789518671.476340:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789518671.476347:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627668224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518671.476410:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627668224:12345-0@lo:400:kworker.0 Request processed in 63us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518671.476417:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789518671.476446:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627668736 00000100:00100000:2.0:1789518671.476450:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627668736 00000100:00100000:2.0:1789518671.476480:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789518671.476486:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627668736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518671.476519:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627668736:12345-0@lo:400:kworker.0 Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518671.476524:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789518671.476562:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627668224:0@lo:400:kworker.0 00000100:00100000:2.0:1789518671.476574:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627668736:0@lo:400:kworker.0 00000100:00080000:2.0:1789518671.476609:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518671.476713:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518671.476826:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518671.476957:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627668352:12345-0@lo:400:kworker.0 Request processed in 824us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518671.476963:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789518671.476975:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627668608 00000100:00100000:0.0:1789518671.476979:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627668608 00000100:00100000:0.0:1789518671.477004:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789518671.477010:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627668608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518671.477039:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627668608:12345-0@lo:400:kworker.0 Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518671.477047:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789518671.477060:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518671.477230:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627668608:0@lo:400:kworker.0 00000100:00100000:1.0:1789518671.477256:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627668352:0@lo:400:kworker.0 00000100:00100000:2.0:1789518671.477314:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627668480 00000100:00100000:2.0:1789518671.477318:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627668480 00000100:00100000:2.0:1789518671.477400:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789518671.477408:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627668480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518671.477425:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 311754752 pending 1703936 free 3709861888 avail 3707764736 00000100:00100000:2.0:1789518671.477473:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627668480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518671.477479:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789518671.477529:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771249 gen 2 00000004:00080000:0.0:1789518671.477534:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fffbb80e00, transno 30064771249 00000100:00100000:0.0:1789518671.477557:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fec48d4380 x1876445627667968/t30064771267(30064771267) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789518687 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789518671.477572:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627668480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518671.526057:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518671.526244:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617438976 00000100:00100000:2.0:1789518671.526255:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617438976 00000100:00100000:2.0:1789518671.526396:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 410 00000100:00100000:2.0:1789518671.526405:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:37431:x1876445617438976:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789518671.526522:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:37431:x1876445617438976:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 114us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518671.526531:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 410 00000100:00080000:0.0:1789518671.526531:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518671.529056:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518671.529152:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617439232 00000100:00100000:1.0:1789518671.529166:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617439232 00000100:00100000:1.0:1789518671.529748:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1789518671.529759:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+43:37431:x1876445617439232:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518671.530138:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:37431:x1876445617439232:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 380us (1096us total) trans 30064771435 rc 0/0 00000100:00100000:1.0:1789518671.530146:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00010000:00010000:2.0:1789518671.730981:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789518672.610111:0:39848:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10e: Tolerate -EDQUOT failure when auto PCC-RO attach with user quota ========================================================== 20:31:12 (1789518672) 00010000:00010000:3.0:1789518672.754870:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518672.781442:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518672.781507:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518672.781531:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518672.781556:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518672.781589:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518672.781601:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617439872 00000100:00100000:2.0:1789518672.781602:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617439616 00000100:00100000:1.0:1789518672.781637:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617439488 00000100:00100000:1.0:1789518672.781642:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617439488 00000100:00100000:2.0:1789518672.781645:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617439616 00000100:00100000:2.0:1789518672.781698:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617439744 00000100:00100000:1.0:1789518672.781699:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:2.0:1789518672.781703:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617439744 00000100:00100000:1.0:1789518672.781714:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2345:x1876445617439488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518672.781729:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1789518672.781738:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2345:x1876445617439616:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518672.781747:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617439872 00000100:00100000:0.0:1789518672.781784:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:0.0:1789518672.781792:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fed35f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617439872:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518672.781799:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:2345:x1876445617439488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518672.781806:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:2.0:1789518672.782041:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:2345:x1876445617439616:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 302us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518672.782049:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1789518672.782062:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fed35f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617439872:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 268us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518672.782070:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:0.0:1789518672.782095:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:0.0:1789518672.782103:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2345:x1876445617439744:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:2.0:1789518672.782138:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518672.782143:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2345:x1876445617439744:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00080000:2.0:1789518672.782144:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518672.782153:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:3.0:1789518672.782256:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617439360 00000100:00100000:3.0:1789518672.782261:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617439360 00000100:00100000:2.0:1789518672.782390:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:2.0:1789518672.782396:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617439360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518672.782427:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617439360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518672.782437:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:1.0:1789518673.623934:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.624833:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617440128 00000100:00100000:3.0:1789518673.624847:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617440128 00000100:00100000:3.0:1789518673.625016:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 411 00000100:00100000:3.0:1789518673.625029:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:38207:x1876445617440128:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518673.625056:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518673.625060:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518673.625105:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c786e16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdf46 expref: 44 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.625129:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:3.0:1789518673.625144:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1789518673.625159:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518673.625167:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c786fdd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfd9 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.625513:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.625527:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.625537:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.625550:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.625686:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.625695:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518673.630264:0:35846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcc:0x0], index 0: 0 00010000:00010000:3.0:1789518673.632227:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c786ff2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632253:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c786ff2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632268:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c786ff2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632316:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632325:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632333:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632349:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518673.632354:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632362:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632397:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:3.0:1789518673.632400:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518673.632407:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632414:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c786fe4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518673.632432:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023a4fa9c reply state 00000000dc3f6065 transno 30064771436 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518673.632443:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518673.632488:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c786fdd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfd9 expref: 46 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632511:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c786ff2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfd9 expref: 45 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.632518:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.632521:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518673.632524:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901c00, rc 0) 00000100:00100000:3.0:1789518673.632659:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:38207:x1876445617440128:12345-192.168.206.51@tcp:101:dd.0 Request processed in 7632us (8741us total) trans 30064771436 rc 0/0 00000100:00100000:3.0:1789518673.632669:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 411 00010000:00010000:2.0:1789518673.634514:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.634533:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.634542:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.634549:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518673.634555:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.634610:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.634657:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99ffeaa78400) 00010000:00010000:2.0:1789518673.634661:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518673.634667:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.634675:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c786feb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518673.639760:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518673.640498:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617440256 00000100:00100000:2.0:1789518673.640513:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617440256 00000100:00100000:2.0:1789518673.640596:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:2.0:1789518673.640608:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+9:38207:x1876445617440256:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518673.640652:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518673.640679:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005014be07/0x631fd8698c787000 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfe0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518673.640714:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518673.640744:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcc:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1789518673.640750:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518673.640762:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005014be07/0x631fd8698c787000 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfe0 expref: 10 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.640784:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005014be07/0x631fd8698c787000 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfe0 expref: 10 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.640798:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6e00, rc 0) 00000100:00100000:2.0:1789518673.640880:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:38207:x1876445617440256:12345-192.168.206.51@tcp:101:dd.0 Request processed in 274us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518673.640888:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:1.0:1789518673.657745:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518673.658053:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617440384 00000100:00100000:2.0:1789518673.658067:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617440384 00002000:00100000:2.0:1789518673.658136:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff99fff4b1ce00 x1876445617440384/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:319/0 lens 488/0 e 0 to 0 dl 1789518684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518673.658148:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1ce00 with x1876445617440384 ext(0->1048575) 00002000:00010000:2.0:1789518673.658457:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1ce00 00000100:00100000:2.0:1789518673.658501:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 339 00000100:00100000:2.0:1789518673.658514:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617440384:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:1.0:1789518673.680441:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518673.680501:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.680652:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617440768 00000100:00100000:3.0:1789518673.680664:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617440768 00000100:00100000:3.0:1789518673.680729:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:3.0:1789518673.680741:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:38207:x1876445617440768:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:0.0:1789518673.680812:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617440512 00000100:00100000:0.0:1789518673.680817:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617440512 00002000:00100000:0.0:1789518673.680848:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff99fff4b1ca80 x1876445617440512/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:319/0 lens 488/0 e 0 to 0 dl 1789518684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518673.680857:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1ca80 with x1876445617440512 ext(1048576->2097151) 00002000:00010000:0.0:1789518673.680863:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1ca80 00000100:00100000:0.0:1789518673.680942:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 340 00000100:00100000:0.0:1789518673.680948:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2343:x1876445617440512:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518673.681168:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:38207:x1876445617440768:12345-192.168.206.51@tcp:35:dd.0 Request processed in 428us (665us total) trans 30064771437 rc 0/0 00000100:00100000:3.0:1789518673.681177:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:2.0:1789518673.684518:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617440384:12345-192.168.206.51@tcp:4:dd.0 Request processed in 25993us (26773us total) trans 30064771200 rc 0/0 00000100:00100000:2.0:1789518673.684535:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 339 00002000:00100000:2.0:1789518673.684551:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff99fff4b1ce00 x1876445617440384/t30064771200(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:319/0 lens 488/448 e 0 to 0 dl 1789518684 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518673.684562:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1ce00 with x1876445617440384 ext(0->1048575) 00002000:00010000:2.0:1789518673.684570:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1ce00 00000100:00100000:2.0:1789518673.691189:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617440512:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10224us (10748us total) trans 30064771201 rc 0/0 00000100:00100000:2.0:1789518673.691207:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 340 00002000:00100000:2.0:1789518673.691223:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff99fff4b1ca80 x1876445617440512/t30064771201(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:319/0 lens 488/448 e 0 to 0 dl 1789518684 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518673.691234:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1ca80 with x1876445617440512 ext(1048576->2097151) 00002000:00010000:2.0:1789518673.691243:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1ca80 00000100:00100000:1.0:1789518673.700100:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.700221:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617440896 00000100:00100000:3.0:1789518673.700233:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617440896 00000100:00100000:3.0:1789518673.700402:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 412 00000100:00100000:3.0:1789518673.700413:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:38208:x1876445617440896:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:3.0:1789518673.700446:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518673.700485:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787007 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfe7 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.700569:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c78700e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.700585:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c78700e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.700597:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c78700e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518673.700663:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518673.700667:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518673.700690:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c78700e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.700731:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787007 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfe7 expref: 48 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.700750:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c78700e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfe7 expref: 47 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.700773:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:3.0:1789518673.700776:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518673.700780:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901200, rc 0) 00000100:00100000:3.0:1789518673.700853:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:38208:x1876445617440896:12345-192.168.206.51@tcp:101:chown.0 Request processed in 442us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518673.700861:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 412 00000100:00100000:0.0:1789518673.703203:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518673.704120:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617441024 00000100:00100000:2.0:1789518673.704136:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617441024 00000100:00100000:2.0:1789518673.704221:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 413 00000100:00100000:2.0:1789518673.704233:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+47:38208:x1876445617441024:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518673.704263:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518673.704293:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c787015 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdfee expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.704358:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c78701c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.704380:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c78701c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.704395:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c78701c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.704552:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c787015 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfee expref: 49 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.704575:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6200/0x631fd8698c78701c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfee expref: 48 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.704584:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.704587:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518673.704592:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6200, rc 0) 00000100:00100000:2.0:1789518673.705011:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38208:x1876445617441024:12345-192.168.206.51@tcp:101:chown.0 Request processed in 777us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518673.705019:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 413 00000100:00100000:0.0:1789518673.706964:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.707021:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617441280 00000100:00100000:3.0:1789518673.707032:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617441280 00000100:00100000:3.0:1789518673.707085:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 414 00000100:00100000:3.0:1789518673.707099:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38208:x1876445617441280:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:3.0:1789518673.707152:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518673.707178:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c786ff2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfd9 expref: 48 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.707196:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.707201:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518673.707229:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.707242:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.707252:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518673.707862:0:35846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].15, 88 off9344 00000004:00080000:3.0:1789518673.707875:0:35846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727704261073ns, next at 728704257553ns, rc = 0 00000004:00010000:3.0:1789518673.707991:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c3e78d9 reply state 00000000425904f1 transno 30064771438 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518673.708002:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518673.708102:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38208:x1876445617441280:12345-192.168.206.51@tcp:36:chown.0 Request processed in 1004us (1147us total) trans 30064771438 rc 0/0 00000100:00100000:3.0:1789518673.708111:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 414 00010000:00010000:3.0:1789518673.709743:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.709759:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.709767:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.709774:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518673.709779:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.709788:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.709805:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.709809:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789518673.709814:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.709820:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787023 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518673.709968:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.710086:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617441408 00000100:00100000:3.0:1789518673.710107:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617441408 00000100:00100000:3.0:1789518673.710161:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 415 00000100:00100000:3.0:1789518673.710170:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38208:x1876445617441408:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:3.0:1789518673.710195:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518673.710212:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78702a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdff5 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.710286:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78702a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdff5 expref: 49 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.710301:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78702a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdff5 expref: 49 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.710321:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.710324:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518673.710327:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900200, rc 0) 00000100:00100000:3.0:1789518673.710400:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38208:x1876445617441408:12345-192.168.206.51@tcp:101:chown.0 Request processed in 230us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518673.710408:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 415 00000100:00100000:1.0:1789518673.712523:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518673.712732:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617441536 00000100:00100000:2.0:1789518673.712744:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617441536 00000100:00100000:2.0:1789518673.712811:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:2.0:1789518673.712823:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617441536:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:2.0:1789518673.713312:0:36531:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1789518673.713317:0:36531:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 0 -> 1789518674 00002000:00010000:2.0:1789518673.713319:0:36531:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518673.713321:0:36531:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 0 -> 1789518674 00002000:00010000:2.0:1789518673.713323:0:36531:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518673.713468:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617441536:12345-192.168.206.51@tcp:2:chown.0 Request processed in 643us (953us total) trans 30064771202 rc 0/0 00000100:00100000:2.0:1789518673.713476:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:0.0:1789518673.748054:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518673.748265:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617441792 00000100:00100000:2.0:1789518673.748278:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617441792 00000100:00100000:2.0:1789518673.748529:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 416 00000100:00100000:2.0:1789518673.748542:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38214:x1876445617441792:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:2.0:1789518673.748570:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518673.748939:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c787031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfdffc expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749038:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749056:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749070:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749088:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749095:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749174:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749307:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c787046 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749318:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c787046 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749325:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c787046 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518673.749432:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00010000:00010000:2.0:1789518673.749558:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749565:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749570:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749573:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f7600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518673.749578:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749587:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749601:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:2.0:1789518673.749605:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518673.749611:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749640:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7600/0x631fd8698c787038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749655:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749659:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749663:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749666:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc2f6000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518673.749667:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749671:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749675:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99ffc13ed300) 00010000:00010000:2.0:1789518673.749676:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518673.749678:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749681:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6000/0x631fd8698c78703f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749724:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f7c00/0x631fd8698c787031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdffc expref: 52 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749735:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c787046 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdffc expref: 51 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.749743:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.749745:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518673.749747:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc2f6800, rc 0) 00000100:00100000:2.0:1789518673.749822:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:38214:x1876445617441792:12345-192.168.206.51@tcp:101:dd.500 Request processed in 1282us (1780us total) trans 30064771439 rc 0/0 00000100:00100000:2.0:1789518673.749830:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 416 00000100:00100000:0.0:1789518673.752097:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.752202:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617442048 00000100:00100000:3.0:1789518673.752213:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617442048 00000100:00100000:3.0:1789518673.752313:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 417 00000100:00100000:3.0:1789518673.752321:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:38214:x1876445617442048:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:3.0:1789518673.752360:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518673.752364:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1789518673.752395:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78702a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdff5 expref: 51 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752457:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc2f6800/0x631fd8698c787046 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdffc expref: 50 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752469:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.752474:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518673.752489:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787054 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe003 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752535:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752549:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752565:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752583:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752590:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752597:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752603:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518673.752608:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752665:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752680:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.752683:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518673.752688:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752694:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78705b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752722:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787062 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752730:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787062 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.752737:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787062 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.753012:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787062 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe003 expref: 52 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.753021:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.753024:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789518673.753035:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787054 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe003 expref: 52 pid: 35846 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.753050:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787062 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe003 expref: 51 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.753097:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.753099:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1789518673.753115:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901a00, rc 0) 00000100:00100000:3.0:1789518673.753181:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:38214:x1876445617442048:12345-192.168.206.51@tcp:101:dd.500 Request processed in 861us (1094us total) trans 30064771440 rc 0/0 00000100:00100000:3.0:1789518673.753188:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 417 00000100:00100000:1.0:1789518673.765729:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518673.765810:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617442176 00000100:00100000:0.0:1789518673.765824:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617442176 00002000:00100000:0.0:1789518673.765907:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff99fff4b1c000 x1876445617442176/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:319/0 lens 488/0 e 0 to 0 dl 1789518684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518673.765921:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1c000 with x1876445617442176 ext(0->1048575) 00002000:00010000:0.0:1789518673.765928:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1c000 00000100:00100000:0.0:1789518673.765968:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 341 00000100:00100000:0.0:1789518673.765980:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617442176:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:2.0:1789518673.777976:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617442176:12345-192.168.206.51@tcp:3:dd.0 Request processed in 11983us (12248us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518673.777990:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 341 00002000:00100000:2.0:1789518673.778007:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff99fff4b1c000 x1876445617442176/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:319/0 lens 488/440 e 0 to 0 dl 1789518684 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518673.778028:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1c000 with x1876445617442176 ext(0->1048575) 00002000:00010000:2.0:1789518673.778036:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1c000 00010000:00010000:3.0:1789518673.778868:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518673.790397:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518673.790589:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617442304 00000100:00100000:2.0:1789518673.790602:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617442304 00002000:00100000:2.0:1789518673.790712:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff99fff4b1f800 x1876445617442304/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:319/0 lens 488/0 e 0 to 0 dl 1789518684 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518673.790726:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1f800 with x1876445617442304 ext(1048576->2097151) 00002000:00010000:2.0:1789518673.790781:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1f800 00000100:00100000:2.0:1789518673.790811:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 342 00000100:00100000:2.0:1789518673.790823:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617442304:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:2.0:1789518673.801510:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617442304:12345-192.168.206.51@tcp:3:dd.0 Request processed in 10516us (10955us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518673.801531:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 342 00002000:00100000:2.0:1789518673.801553:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff99fff4b1f800 x1876445617442304/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:319/0 lens 488/440 e 0 to 0 dl 1789518684 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518673.801565:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1f800 with x1876445617442304 ext(1048576->2097151) 00002000:00010000:2.0:1789518673.801574:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1f800 00000100:00100000:1.0:1789518673.813396:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.813515:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617442560 00000100:00100000:3.0:1789518673.813528:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617442560 00000100:00100000:3.0:1789518673.813667:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:3.0:1789518673.813679:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0c34450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:38214:x1876445617442560:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:3.0:1789518673.813964:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0c34450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38214:x1876445617442560:12345-192.168.206.51@tcp:35:dd.500 Request processed in 287us (581us total) trans 30064771441 rc 0/0 00000100:00100000:3.0:1789518673.813973:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:0.0:1789518673.854596:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.854713:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617442688 00000100:00100000:3.0:1789518673.854723:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617442688 00000100:00100000:3.0:1789518673.854776:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 418 00000100:00100000:3.0:1789518673.854786:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38224:x1876445617442688:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1789518673.854860:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.854877:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.854887:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.854921:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.854928:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.854934:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855018:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855352:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855361:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518673.855396:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855405:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855410:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855414:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855418:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518673.855421:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855431:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855440:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:3.0:1789518673.855441:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518673.855445:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855448:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855457:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855461:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855464:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855467:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518673.855469:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855472:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855475:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99ffeaa78100) 00010000:00010000:3.0:1789518673.855476:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518673.855478:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855487:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787070 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855497:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855501:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855504:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855507:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518673.855509:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855512:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855515:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.855517:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518673.855518:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.855521:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787077 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518673.855584:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38224:x1876445617442688:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 800us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518673.855590:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 418 00000100:00100000:0.0:1789518673.876060:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518673.876367:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617442944 00000100:00100000:2.0:1789518673.876376:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617442944 00000100:00100000:2.0:1789518673.876429:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 419 00000100:00100000:2.0:1789518673.876440:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38225:x1876445617442944:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518673.876459:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518673.876479:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78707e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe00a expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876564:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876578:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876589:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876603:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876609:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876658:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876742:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876749:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876755:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876761:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518673.876765:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876772:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876783:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:2.0:1789518673.876786:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518673.876790:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876797:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c787085 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876809:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876815:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876821:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876825:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076d800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518673.876828:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876834:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876840:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99ffc13ed300) 00010000:00010000:2.0:1789518673.876843:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518673.876846:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876851:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78708c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876895:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78707e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe00a expref: 53 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876905:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:2.0:1789518673.876907:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518673.876911:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78707e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe00a expref: 53 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.876920:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076c000, rc 0) 00000100:00100000:2.0:1789518673.876982:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38225:x1876445617442944:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 544us (929us total) trans 0 rc 301/301 00000100:00100000:2.0:1789518673.876993:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 419 00000100:00100000:1.0:1789518673.880795:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.880865:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617443072 00000100:00100000:3.0:1789518673.880874:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617443072 00000100:00100000:3.0:1789518673.881009:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 420 00000100:00100000:3.0:1789518673.881021:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38225:x1876445617443072:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:3.0:1789518673.881090:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881104:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881114:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881126:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881132:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881137:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881208:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881215:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881222:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518673.881251:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00000004:00200000:3.0:1789518673.881270:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518673.881282:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881294:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881299:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881305:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881311:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518673.881315:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881321:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881331:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:3.0:1789518673.881333:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518673.881349:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881355:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787093 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881367:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881372:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881388:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881393:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518673.881396:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881402:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881409:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99ffeaa78100) 00010000:00010000:3.0:1789518673.881412:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518673.881415:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881420:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78709a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881436:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881442:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881447:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881452:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518673.881455:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881472:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881479:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.881481:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518673.881485:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.881490:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518673.881639:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38225:x1876445617443072:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 618us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518673.881647:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 420 00000100:00100000:0.0:1789518673.914277:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.914518:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617443328 00000100:00100000:3.0:1789518673.914528:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617443328 00000100:00100000:3.0:1789518673.914589:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 421 00000100:00100000:3.0:1789518673.914599:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38231:x1876445617443328:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518673.914654:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518673.914658:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518673.914685:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c78700e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfdfe7 expref: 52 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.914703:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78700) 00010000:00010000:3.0:1789518673.914714:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518673.914727:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe011 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.914881:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.914895:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.914904:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.914917:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.914925:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.914931:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915745:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c7870bd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915760:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c7870bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915770:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c7870bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518673.915782:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00010000:00010000:2.0:1789518673.915888:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915896:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915902:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915908:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518673.915912:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915919:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915928:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffeaa78100) 00010000:00010000:2.0:1789518673.915930:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518673.915934:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915944:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7870af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915956:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915961:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915966:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915971:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518673.915973:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915979:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915985:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99ffeaa78400) 00010000:00010000:2.0:1789518673.915987:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518673.915990:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.915995:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7870b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.916418:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7870a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe011 expref: 54 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.916439:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c7870bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe011 expref: 53 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.916446:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.916448:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518673.916450:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901400, rc 0) 00000100:00100000:2.0:1789518673.916517:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:38231:x1876445617443328:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1919us (2249us total) trans 30064771442 rc 0/0 00000100:00100000:2.0:1789518673.916525:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 421 00000100:00100000:2.0:1789518673.919821:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.919899:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617443584 00000100:00100000:3.0:1789518673.919909:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617443584 00000100:00100000:3.0:1789518673.919954:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 422 00000100:00100000:3.0:1789518673.919963:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:38231:x1876445617443584:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:3.0:1789518673.920366:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789518673.920392:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787062 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe003 expref: 53 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.920413:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c7870bd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe011 expref: 52 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.920440:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.920445:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518673.923812:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.923839:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.923852:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518673.923921:0:39157:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771443 00000004:00010000:3.0:1789518673.923958:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000632373e9 reply state 00000000e9971352 transno 30064771444 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518673.923968:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518673.924072:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38231:x1876445617443584:12345-192.168.206.51@tcp:36:dd.0 Request processed in 4107us (4462us total) trans 30064771444 rc 0/0 00000100:00100000:3.0:1789518673.924081:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 422 00000020:00080000:3.0:1789518673.924086:0:39157:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518673.927332:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.927358:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.927366:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.927372:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518673.927377:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.927384:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.927400:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.927402:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518673.927407:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.927413:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7870cb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518673.929839:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.930094:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617443712 00000100:00100000:3.0:1789518673.930103:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617443712 00000100:00100000:3.0:1789518673.930159:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 423 00000100:00100000:3.0:1789518673.930169:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:38231:x1876445617443712:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:3.0:1789518673.930190:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518673.930208:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7870d2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe018 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.930282:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7870d2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe018 expref: 54 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.930296:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7870d2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe018 expref: 54 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518673.930314:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518673.930317:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518673.930321:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901200, rc 0) 00000100:00100000:3.0:1789518673.930438:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38231:x1876445617443712:12345-192.168.206.51@tcp:101:dd.0 Request processed in 269us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518673.930445:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 423 00000100:00100000:1.0:1789518673.934450:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518673.934541:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617443968 00000100:00100000:2.0:1789518673.934551:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617443968 00000100:00100000:2.0:1789518673.934640:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 424 00000100:00100000:2.0:1789518673.934651:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38231:x1876445617443968:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518673.934671:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518673.934675:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518673.934701:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7870d2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe018 expref: 54 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.934718:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.934724:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518673.934736:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7870d9 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe01f expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.934784:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c7870e0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.934799:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c7870e0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.934808:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c7870e0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.934982:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c7870e0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe01f expref: 56 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.934991:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.934994:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518673.935017:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7870d9 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe01f expref: 56 pid: 35847 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.935032:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c7870e0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe01f expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.935053:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.935056:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518673.935058:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076d800, rc 0) 00000100:00100000:2.0:1789518673.935125:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:38231:x1876445617443968:12345-192.168.206.51@tcp:101:dd.0 Request processed in 476us (684us total) trans 30064771445 rc 0/0 00000100:00100000:2.0:1789518673.935132:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 424 00000100:00100000:0.0:1789518673.941209:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518673.941568:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617444224 00000100:00100000:3.0:1789518673.941578:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617444224 00000100:00100000:2.0:1789518673.941771:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 425 00000100:00100000:2.0:1789518673.941783:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:38231:x1876445617444224:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518673.941805:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518673.941809:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518673.941834:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c7870e0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe01f expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.941849:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.941854:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518673.941868:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7870e7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe026 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.941937:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7870ee lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.941951:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7870ee lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.941961:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7870ee lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518673.942355:0:35846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].16, 88 off9432 00000004:00080000:2.0:1789518673.942364:0:35846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 727938749711ns, next at 728704257553ns, rc = 0 00010000:00010000:2.0:1789518673.976674:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7870ee lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe026 expref: 57 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.976690:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.976693:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518673.976708:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7870e7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe026 expref: 57 pid: 35846 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.976725:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7870ee lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe026 expref: 56 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518673.976757:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518673.976759:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518673.976761:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076c800, rc 0) 00000100:00100000:2.0:1789518673.976826:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:38231:x1876445617444224:12345-192.168.206.51@tcp:101:dd.0 Request processed in 35046us (35624us total) trans 30064771446 rc 0/0 00000100:00100000:2.0:1789518673.976835:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 425 00000001:00080000:3.0:1789518673.976959:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771435 is committed 00000001:00080000:3.0:1789518673.976973:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771446 is committed 00000004:00080000:3.0:1789518673.976976:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000004:00080000:3.0:1789518673.977010:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000004:00080000:3.0:1789518673.977017:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000100:00100000:2.0:1789518673.977106:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518673.977118:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627668864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789518673.977163:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518673.977221:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627668864 00000100:00100000:2.0:1789518673.977228:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627668864 00000100:00080000:0.0:1789518673.977256:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518673.977273:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789518673.977281:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627668864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789518673.977435:0:37973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1789518673.977439:0:37973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1789518674 -> 1789518674 00002000:00010000:2.0:1789518673.977442:0:37973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518673.977444:0:37973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1789518674 -> 1789518674 00002000:00010000:2.0:1789518673.977446:0:37973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518673.977484:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627668864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (321us total) trans 30064771203 rc 0/0 00000100:00100000:2.0:1789518673.977490:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000004:00080000:0.0:1789518673.977597:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffedb2b100/2, rc 0, transno 30064771203 00000100:00100000:0.0:1789518673.977662:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627668864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789518673.977762:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd03d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627668992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789518673.977789:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518673.977968:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627668992 00000100:00100000:2.0:1789518673.977973:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627668992 00000100:00100000:2.0:1789518673.977997:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789518673.978003:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627668992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789518673.978101:0:36532:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1789518673.978104:0:36532:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1789518674 -> 1789518674 00002000:00010000:2.0:1789518673.978107:0:36532:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518673.978109:0:36532:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1789518674 -> 1789518674 00002000:00010000:2.0:1789518673.978111:0:36532:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518673.978430:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3280:x1876445627668992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 426us (639us total) trans 30064771204 rc 0/0 00000100:00100000:2.0:1789518673.978437:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000004:00080000:3.0:1789518673.978531:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffd03d9500/2, rc 0, transno 30064771204 00000100:00100000:3.0:1789518673.978536:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd03d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627668992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789518673.982027:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518673.982103:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617444352 00000100:00100000:2.0:1789518673.982111:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617444352 00002000:00010000:2.0:1789518673.982148:0:36537:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/204 (0->18446744073709551615) 00002000:00100000:2.0:1789518673.982152:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5f80 with x1876445617444352 ext(0->18446744073709551615) 00002000:00010000:2.0:1789518673.982160:0:36537:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d5f80. 00000100:00100000:2.0:1789518673.982185:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 343 00000100:00100000:2.0:1789518673.982192:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617444352:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:2.0:1789518673.982522:0:36537:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:2.0:1789518673.982526:0:36537:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1789518674 -> 1789518674 00002000:00010000:2.0:1789518673.982529:0:36537:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518673.982531:0:36537:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1789518674 -> 1789518674 00002000:00010000:2.0:1789518673.982533:0:36537:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518673.982691:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617444352:12345-192.168.206.51@tcp:10:dd.0 Request processed in 497us (671us total) trans 30064771205 rc 0/0 00000100:00100000:2.0:1789518673.982700:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 343 00002000:00010000:2.0:1789518673.982704:0:36537:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/204 (0->18446744073709551615) 00002000:00100000:2.0:1789518673.982706:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d5f80 with x1876445617444352 ext(0->18446744073709551615) 00002000:00010000:2.0:1789518673.982711:0:36537:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d5f80. 00000100:00100000:1.0:1789518674.003518:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.003693:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617444480 00000100:00100000:2.0:1789518674.003703:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617444480 00002000:00100000:2.0:1789518674.003755:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff99fff4b1df80 x1876445617444480/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.003767:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1df80 with x1876445617444480 ext(0->1048575) 00002000:00010000:2.0:1789518674.003773:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1df80 00000100:00100000:2.0:1789518674.003809:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 344 00000100:00100000:2.0:1789518674.003819:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2343:x1876445617444480:12345-192.168.206.51@tcp:4:dd.0 00000100:00080000:0.0:1789518674.003992:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518674.014052:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2343:x1876445617444480:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10225us (10533us total) trans 30064771206 rc 0/0 00000100:00100000:2.0:1789518674.014074:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 344 00002000:00100000:2.0:1789518674.014087:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff99fff4b1df80 x1876445617444480/t30064771206(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/448 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.014096:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff4b1df80 with x1876445617444480 ext(0->1048575) 00002000:00010000:2.0:1789518674.014103:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff4b1df80 00000100:00100000:1.0:1789518674.018449:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518674.019004:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617444608 00000100:00100000:0.0:1789518674.019014:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617444608 00002000:00100000:0.0:1789518674.019063:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff99fec1a1f100 x1876445617444608/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518674.019075:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1a1f100 with x1876445617444608 ext(1048576->2097151) 00002000:00010000:0.0:1789518674.019082:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1a1f100 00000100:00100000:0.0:1789518674.019268:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 345 00000100:00100000:0.0:1789518674.019278:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2342:x1876445617444608:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518674.028137:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2342:x1876445617444608:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8852us (9689us total) trans 30064771207 rc 0/0 00000100:00100000:2.0:1789518674.028150:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 345 00002000:00100000:2.0:1789518674.028164:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff99fec1a1f100 x1876445617444608/t30064771207(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/448 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.028175:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1a1f100 with x1876445617444608 ext(1048576->2097151) 00002000:00010000:2.0:1789518674.028181:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1a1f100 00000100:00100000:2.0:1789518674.043677:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518674.043743:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617444736 00000100:00100000:0.0:1789518674.043753:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617444736 00002000:00100000:0.0:1789518674.043802:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff99ffd03db100 x1876445617444736/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518674.043814:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03db100 with x1876445617444736 ext(2097152->3145727) 00002000:00010000:0.0:1789518674.043821:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03db100 00000100:00100000:0.0:1789518674.043859:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 346 00000100:00100000:0.0:1789518674.043869:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+20:2344:x1876445617444736:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518674.052232:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2344:x1876445617444736:12345-192.168.206.51@tcp:4:dd.0 Request processed in 8357us (8562us total) trans 30064771208 rc 0/0 00000100:00100000:0.0:1789518674.052246:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 346 00002000:00100000:0.0:1789518674.052259:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff99ffd03db100 x1876445617444736/t30064771208(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/448 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518674.052278:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03db100 with x1876445617444736 ext(2097152->3145727) 00002000:00010000:0.0:1789518674.052285:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd03db100 00000100:00100000:1.0:1789518674.053305:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518674.053385:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617444864 00000100:00100000:3.0:1789518674.053401:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617444864 00002000:00100000:3.0:1789518674.053451:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff99fec1a1d180 x1876445617444864/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518674.053462:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1a1d180 with x1876445617444864 ext(3145728->4194303) 00002000:00010000:3.0:1789518674.053467:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1a1d180 00000100:00100000:3.0:1789518674.053497:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 347 00000100:00100000:3.0:1789518674.053506:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+22:2343:x1876445617444864:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518674.061384:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2343:x1876445617444864:12345-192.168.206.51@tcp:4:dd.0 Request processed in 7863us (8068us total) trans 30064771209 rc 0/0 00000100:00100000:3.0:1789518674.061400:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 347 00002000:00100000:3.0:1789518674.061415:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff99fec1a1d180 x1876445617444864/t30064771209(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/448 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518674.061426:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1a1d180 with x1876445617444864 ext(3145728->4194303) 00002000:00010000:3.0:1789518674.061433:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1a1d180 00000100:00100000:2.0:1789518674.070812:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.070929:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518674.071065:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617445120 00000100:00100000:1.0:1789518674.071086:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617445120 00000100:00100000:1.0:1789518674.071151:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1789518674.071161:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+44:38231:x1876445617445120:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:1.0:1789518674.071583:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:38231:x1876445617445120:12345-192.168.206.51@tcp:35:dd.0 Request processed in 409us (766us total) trans 30064771447 rc 0/0 00000100:00100000:1.0:1789518674.071593:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:3.0:1789518674.072040:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617445248 00000100:00100000:3.0:1789518674.072045:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617445248 00002000:00100000:3.0:1789518674.072082:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff99ffc638b100 x1876445617445248/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518674.072093:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc638b100 with x1876445617445248 ext(4194304->5242879) 00002000:00010000:3.0:1789518674.072099:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc638b100 00000100:00100000:3.0:1789518674.072127:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 348 00000100:00100000:3.0:1789518674.072135:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+24:2342:x1876445617445248:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518674.083653:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2342:x1876445617445248:12345-192.168.206.51@tcp:4:dd.0 Request processed in 11508us (12714us total) trans 30064771210 rc 0/0 00000100:00100000:3.0:1789518674.083667:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 348 00002000:00100000:3.0:1789518674.083693:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff99ffc638b100 x1876445617445248/t30064771210(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/448 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518674.083704:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffc638b100 with x1876445617445248 ext(4194304->5242879) 00002000:00010000:3.0:1789518674.083711:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffc638b100 00000100:00100000:2.0:1789518674.137427:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518674.137665:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617445376 00000100:00100000:1.0:1789518674.137675:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617445376 00000100:00100000:1.0:1789518674.137734:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 426 00000100:00100000:1.0:1789518674.137743:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+45:38241:x1876445617445376:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518674.137765:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518674.137785:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7870f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe02d expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.137845:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7870fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.137859:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7870fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.137871:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7870fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518674.137904:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518674.137908:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518674.137925:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7870fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.137963:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696c00/0x631fd8698c7870f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe02d expref: 47 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.137979:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7870fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe02d expref: 46 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.137986:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518674.137988:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518674.137991:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd0696a00, rc 0) 00000100:00100000:1.0:1789518674.138050:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:38241:x1876445617445376:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 307us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518674.138057:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 426 00000100:00100000:0.0:1789518674.142506:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.142795:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617445504 00000100:00100000:2.0:1789518674.142808:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617445504 00000100:00100000:2.0:1789518674.142915:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 427 00000100:00100000:2.0:1789518674.142926:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:38241:x1876445617445504:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518674.143016:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143036:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143046:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143059:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143064:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143068:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143578:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143589:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143598:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518674.143671:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143686:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143693:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143706:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143713:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.143718:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143726:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143740:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518674.143744:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.143750:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143757:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143805:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143813:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143819:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143824:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076cc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.143827:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143836:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143844:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99fff6905900) 00010000:00010000:2.0:1789518674.143846:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.143849:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143854:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78710a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143871:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143877:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143883:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143888:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076d800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.143891:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143898:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143905:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.143907:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.143909:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.143918:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787111 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518674.144019:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:38241:x1876445617445504:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1092us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518674.144028:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 427 00000100:00100000:3.0:1789518674.186281:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.187301:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617445760 00000100:00100000:2.0:1789518674.187318:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617445760 00000100:00100000:2.0:1789518674.187418:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 428 00000100:00100000:2.0:1789518674.187431:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+46:38247:x1876445617445760:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:2.0:1789518674.187460:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518674.187488:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe034 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.187580:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.187597:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.187611:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.187651:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.187656:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.187664:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188006:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78712d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188014:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78712d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188019:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78712d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518674.188028:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:2.0:1789518674.188117:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188126:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188134:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188141:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076cc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.188147:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188156:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188171:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518674.188174:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.188180:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188187:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c78711f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188200:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188206:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188213:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188219:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.188222:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188228:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188235:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99fff6905900) 00010000:00010000:2.0:1789518674.188236:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.188238:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188242:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787126 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188282:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe034 expref: 49 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188301:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78712d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe034 expref: 48 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.188309:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.188312:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518674.188315:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076c000, rc 0) 00000100:00100000:2.0:1789518674.188420:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38247:x1876445617445760:12345-192.168.206.51@tcp:101:dd.500 Request processed in 992us (2152us total) trans 30064771448 rc 0/0 00000100:00100000:2.0:1789518674.188429:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 428 00000100:00100000:0.0:1789518674.194901:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.195178:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617446016 00000100:00100000:2.0:1789518674.195191:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617446016 00000100:00100000:2.0:1789518674.195282:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 429 00000100:00100000:2.0:1789518674.195293:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38247:x1876445617446016:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:2.0:1789518674.195318:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518674.195321:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1789518674.195367:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7870ee lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe026 expref: 48 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195392:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78712d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe034 expref: 47 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195402:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.195407:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518674.195419:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78713b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe03b expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195461:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195474:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195483:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195495:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195501:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195507:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195514:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.195519:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195527:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195857:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.195862:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518674.195866:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195872:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787142 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195898:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c787149 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195907:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c787149 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.195914:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c787149 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.196088:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c787149 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe03b expref: 49 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.196096:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.196098:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518674.196108:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78713b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe03b expref: 49 pid: 35847 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.196121:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076cc00/0x631fd8698c787149 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe03b expref: 48 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.196144:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.196147:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518674.196149:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076cc00, rc 0) 00000100:00100000:2.0:1789518674.196218:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38247:x1876445617446016:12345-192.168.206.51@tcp:101:dd.500 Request processed in 926us (1332us total) trans 30064771449 rc 0/0 00000100:00100000:2.0:1789518674.196234:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 429 00000100:00100000:0.0:1789518674.205144:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.205244:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617446144 00000100:00100000:2.0:1789518674.205253:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617446144 00002000:00100000:2.0:1789518674.205297:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff99ffd846ca80 x1876445617446144/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.205308:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846ca80 with x1876445617446144 ext(0->1048575) 00002000:00010000:2.0:1789518674.205313:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd846ca80 00000100:00100000:2.0:1789518674.205349:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 349 00000100:00100000:2.0:1789518674.205357:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2343:x1876445617446144:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:2.0:1789518674.214532:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2343:x1876445617446144:12345-192.168.206.51@tcp:3:dd.0 Request processed in 9167us (9386us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518674.214541:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 349 00002000:00100000:2.0:1789518674.214555:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff99ffd846ca80 x1876445617446144/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/440 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.214565:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd846ca80 with x1876445617446144 ext(0->1048575) 00002000:00010000:2.0:1789518674.214585:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffd846ca80 00000100:00100000:3.0:1789518674.227781:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.227918:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617446272 00000100:00100000:2.0:1789518674.227928:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617446272 00002000:00100000:2.0:1789518674.227975:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff99fec48d6a00 x1876445617446272/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.227986:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d6a00 with x1876445617446272 ext(1048576->2097151) 00002000:00010000:2.0:1789518674.227991:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d6a00 00000100:00100000:2.0:1789518674.228045:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 350 00000100:00100000:2.0:1789518674.228052:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2342:x1876445617446272:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:2.0:1789518674.238499:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2342:x1876445617446272:12345-192.168.206.51@tcp:3:dd.0 Request processed in 10435us (10717us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518674.238512:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 350 00002000:00100000:2.0:1789518674.238526:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff99fec48d6a00 x1876445617446272/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/440 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.238536:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d6a00 with x1876445617446272 ext(1048576->2097151) 00002000:00010000:2.0:1789518674.238542:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d6a00 00000100:00100000:3.0:1789518674.253185:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518674.253228:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.253350:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617446400 00000100:00100000:2.0:1789518674.253360:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617446400 00002000:00100000:2.0:1789518674.253407:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff99fec48d6680 x1876445617446400/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.253419:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d6680 with x1876445617446400 ext(2097152->3145727) 00002000:00010000:2.0:1789518674.253426:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d6680 00000100:00100000:2.0:1789518674.253460:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617446528 00000100:00100000:2.0:1789518674.253464:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617446528 00002000:00100000:2.0:1789518674.253481:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff99fec1ec5180 x1876445617446528/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.253489:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec5180 with x1876445617446528 ext(3145728->4194303) 00002000:00010000:2.0:1789518674.253492:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec5180 00000100:00100000:2.0:1789518674.253522:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 351 00000100:00100000:2.0:1789518674.253532:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2343:x1876445617446400:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:1.0:1789518674.253944:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 352 00000100:00100000:1.0:1789518674.253956:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2343:x1876445617446528:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:2.0:1789518674.264357:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+28:2343:x1876445617446528:12345-192.168.206.51@tcp:3:dd.0 Request processed in 10394us (11119us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518674.264370:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 352 00002000:00100000:2.0:1789518674.264383:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff99fec1ec5180 x1876445617446528/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/440 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.264393:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec1ec5180 with x1876445617446528 ext(3145728->4194303) 00002000:00010000:2.0:1789518674.264400:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec1ec5180 00000100:00100000:2.0:1789518674.266155:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2343:x1876445617446400:12345-192.168.206.51@tcp:3:dd.0 Request processed in 12615us (12969us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518674.266166:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 351 00002000:00100000:2.0:1789518674.266177:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff99fec48d6680 x1876445617446400/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/440 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.266188:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d6680 with x1876445617446400 ext(2097152->3145727) 00002000:00010000:2.0:1789518674.266194:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec48d6680 00000100:00100000:3.0:1789518674.296913:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.297029:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617446656 00000100:00100000:2.0:1789518674.297040:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617446656 00002000:00100000:2.0:1789518674.297085:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff99fff78aad80 x1876445617446656/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/0 e 0 to 0 dl 1789518685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.297097:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78aad80 with x1876445617446656 ext(4194304->5242879) 00002000:00010000:2.0:1789518674.297103:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff78aad80 00000100:00100000:2.0:1789518674.297142:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 353 00000100:00100000:2.0:1789518674.297151:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2343:x1876445617446656:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:2.0:1789518674.307041:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+26:2343:x1876445617446656:12345-192.168.206.51@tcp:3:dd.0 Request processed in 9880us (10126us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518674.307054:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 353 00002000:00100000:2.0:1789518674.307068:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff99fff78aad80 x1876445617446656/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:320/0 lens 488/440 e 0 to 0 dl 1789518685 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518674.307079:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78aad80 with x1876445617446656 ext(4194304->5242879) 00002000:00010000:2.0:1789518674.307086:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fff78aad80 00000100:00100000:1.0:1789518674.339125:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518674.339495:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617446912 00000100:00100000:0.0:1789518674.339508:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617446912 00000100:00100000:0.0:1789518674.339772:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:0.0:1789518674.339786:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38247:x1876445617446912:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:0.0:1789518674.340111:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38247:x1876445617446912:12345-192.168.206.51@tcp:35:dd.500 Request processed in 327us (1000us total) trans 30064771450 rc 0/0 00000100:00100000:0.0:1789518674.340120:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:1.0:1789518674.376027:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.376415:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617447040 00000100:00100000:2.0:1789518674.376430:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617447040 00000100:00100000:2.0:1789518674.376510:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 430 00000100:00100000:2.0:1789518674.376523:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38254:x1876445617447040:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518674.376660:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.376681:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.376696:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.376715:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.376723:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.376730:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.377963:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.377984:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.377995:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518674.378066:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378095:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378103:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378110:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378117:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076d800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.378122:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378130:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378143:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518674.378146:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.378151:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378158:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378171:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378178:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378183:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378189:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.378192:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378198:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378206:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99fff6905900) 00010000:00010000:2.0:1789518674.378209:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.378212:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378219:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787157 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378236:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378242:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378248:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378253:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.378256:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378262:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378273:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.378275:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.378279:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.378284:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78715e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518674.378403:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38254:x1876445617447040:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1878us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518674.378414:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 430 00000100:00100000:3.0:1789518674.395499:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518674.395707:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617447296 00000100:00100000:1.0:1789518674.395720:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617447296 00000100:00100000:1.0:1789518674.395796:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 431 00000100:00100000:1.0:1789518674.395808:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38255:x1876445617447296:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518674.395838:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518674.395867:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe042 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.395963:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396055:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396071:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396091:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396098:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396105:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396717:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396732:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396740:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396746:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14dc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518674.396751:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396758:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396774:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518674.396785:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518674.396791:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396797:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c78716c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396812:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396817:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396823:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396828:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518674.396831:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396837:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396845:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99ffc6733400) 00010000:00010000:1.0:1789518674.396848:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518674.396851:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396856:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787173 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396904:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787165 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe042 expref: 50 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396921:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518674.396923:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518674.396928:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe042 expref: 50 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.396938:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14d600, rc 0) 00000100:00100000:1.0:1789518674.397027:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38255:x1876445617447296:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1221us (1542us total) trans 0 rc 301/301 00000100:00100000:1.0:1789518674.397036:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 431 00000100:00100000:1.0:1789518674.400197:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.400306:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617447424 00000100:00100000:2.0:1789518674.400323:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617447424 00000100:00100000:2.0:1789518674.400464:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 432 00000100:00100000:2.0:1789518674.400476:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38255:x1876445617447424:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518674.400572:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.400592:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.400605:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.400667:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401139:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401155:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401595:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401605:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401642:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518674.401686:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00000004:00200000:2.0:1789518674.401692:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518674.401708:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401724:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401732:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401740:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401746:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.401752:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401761:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401775:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518674.401778:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.401785:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401792:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78717a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401805:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401810:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401816:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401824:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.401829:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401841:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401853:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99fff6905900) 00010000:00010000:2.0:1789518674.401856:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.401859:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401866:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787181 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401888:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401895:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401901:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401906:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076d800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.401909:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401915:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401921:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.401923:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.401926:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.401932:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787188 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518674.402034:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38255:x1876445617447424:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1558us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518674.402043:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 432 00000100:00100000:3.0:1789518674.435208:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.436452:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617447552 00000100:00100000:2.0:1789518674.436466:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617447552 00000100:00100000:2.0:1789518674.436658:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 433 00000100:00100000:2.0:1789518674.436672:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38261:x1876445617447552:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518674.436802:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518674.436832:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78718f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe049 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.436915:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.437000:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.437017:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.437037:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.437045:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.437052:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438028:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438044:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438065:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518674.438120:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00000004:00200000:2.0:1789518674.438126:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518674.438152:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438166:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438176:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438183:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438190:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438196:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.438201:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438210:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438223:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518674.438227:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.438233:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438240:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c400/0x631fd8698c787196 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438259:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438265:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438271:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438276:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518674.438279:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438285:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438292:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff99fff6905900) 00010000:00010000:2.0:1789518674.438294:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518674.438297:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438435:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c78719d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438484:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c78718f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe049 expref: 51 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438500:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe049 expref: 50 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.438695:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.438698:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518674.438701:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076c800, rc 0) 00000100:00100000:2.0:1789518674.438810:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:38261:x1876445617447552:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2138us (3613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518674.438820:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 433 00000100:00100000:3.0:1789518674.444450:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518674.444667:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617447808 00000100:00100000:1.0:1789518674.444678:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617447808 00000100:00100000:1.0:1789518674.444778:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 434 00000100:00100000:1.0:1789518674.444789:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:38261:x1876445617447808:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518674.444807:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518674.444825:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7871ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe050 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.444928:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c7871b2 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.444944:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c7871b2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.444955:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c7871b2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518674.444986:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:1.0:1789518674.445107:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7871ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe050 expref: 53 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.445125:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14dc00/0x631fd8698c7871b2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe050 expref: 52 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518674.445133:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:1.0:1789518674.445136:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789518674.445140:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14dc00, rc 0) 00000100:00100000:1.0:1789518674.445216:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38261:x1876445617447808:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 429us (776us total) trans 30064771451 rc 0/0 00000100:00100000:1.0:1789518674.445223:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 434 00000100:00100000:1.0:1789518674.528983:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.529102:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617448064 00000100:00100000:2.0:1789518674.529120:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617448064 00000100:00100000:2.0:1789518674.529213:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 435 00000100:00100000:2.0:1789518674.529226:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:38267:x1876445617448064:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518674.529260:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518674.529287:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c7871c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe057 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.529435:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7871c7 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.529453:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe049 expref: 53 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.529464:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7871c7 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.529506:0:35847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe049 expref: 53 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.529521:0:35847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe049 expref: 53 pid: 35845 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518674.529537:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed931880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627669120:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518674.529727:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc6ab36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518674.536014:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518674.536015:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed931880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627669120:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518674.536057:0:35847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7871c7 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518674.536117:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617448192 00000100:00100000:3.0:1789518674.536128:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617448192 00010000:00010000:3.0:1789518674.536168:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe049 expref: 54 pid: 35845 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518674.536206:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:3.0:1789518674.536215:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:2342:x1876445617448192:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518674.536228:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518674.536235:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe049 expref: 54 pid: 35845 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518674.536248:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe049 expref: 54 pid: 35845 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518674.536269:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c800/0x631fd8698c7871a4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe049 expref: 54 pid: 35845 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518674.536298:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:3.0:1789518674.536304:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7871c7 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518674.536315:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7871c7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518674.536323:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7871c7 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518674.536367:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518674.536418:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:2342:x1876445617448192:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 204us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518674.536426:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00010000:00010000:2.0:1789518674.536740:0:35847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7871c7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.536749:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7871c7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518674.536768:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:2.0:1789518674.536919:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c7871c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe057 expref: 54 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.536936:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c000/0x631fd8698c7871c7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe057 expref: 53 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518674.536944:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff99ffeaa78c00) 00010000:00010000:2.0:1789518674.536947:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518674.536949:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076c000, rc 0) 00000100:00100000:2.0:1789518674.536987:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:38267:x1876445617448064:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 7764us (8013us total) trans 30064771452 rc 0/0 00000100:00100000:2.0:1789518674.536999:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 435 00000001:00080000:2.0:1789518674.585748:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771208 is committed 00000001:00080000:2.0:1789518674.585771:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771199 is committed 00000001:00080000:2.0:1789518674.585784:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771204 is committed 00000001:00080000:2.0:1789518674.585800:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771210 is committed 00010000:00010000:2.0:1789518674.802865:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518675.827368:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518676.083154:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627669248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518676.083223:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518676.083282:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627669248 00000100:00100000:3.0:1789518676.083290:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627669248 00000100:00080000:1.0:1789518676.083379:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518676.084058:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789518676.084346:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627669248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518676.084382:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216334336 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518676.084443:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627669248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 378us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518676.084462:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789518676.084700:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771204 gen 2 00000004:00080000:2.0:1789518676.084707:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec48d4a80, transno 30064771199 00000004:00080000:2.0:1789518676.084718:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffedb2b100, transno 30064771203 00000004:00080000:2.0:1789518676.084722:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffd03d9500, transno 30064771204 00000100:00100000:2.0:1789518676.084736:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627669248:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789518676.085233:0:35867:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:1.0:1789518676.110276:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771267 is committed 00000001:00080000:1.0:1789518676.110291:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771268 is committed 00000040:00080000:3.0:1789518676.275437:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518676.275445:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518676.275897:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 8 00000040:00080000:3.0:1789518676.275903:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518676.594806:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627669376:0@lo:400:kworker.0 00000100:00100000:0.0:1789518676.594871:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518676.594913:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627669888:0@lo:400:kworker.0 00000100:00100000:0.0:1789518676.594937:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518676.594963:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518676.594970:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627669504:0@lo:400:kworker.0 00000100:00100000:0.0:1789518676.594996:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518676.595031:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627669632:0@lo:400:kworker.0 00000100:00100000:0.0:1789518676.595060:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518676.595072:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627670016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518676.595083:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518676.595094:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627669760:0@lo:400:kworker.0 00000100:00100000:0.0:1789518676.595129:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518676.595164:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518676.595184:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627669376 00000100:00100000:0.0:1789518676.595193:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627669376 00000100:00100000:3.0:1789518676.595234:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627670016 00000100:00100000:3.0:1789518676.595242:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627670016 00000100:00100000:0.0:1789518676.595248:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789518676.595262:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627669376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518676.595313:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789518676.595336:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627669376:12345-0@lo:400:kworker.0 Request processed in 65us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518676.595343:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627670016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518676.595355:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00002000:00000024:3.0:1789518676.595391:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3709861888 avail 3707764736 00000100:00100000:0.0:1789518676.595410:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627669504 00000100:00100000:0.0:1789518676.595417:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627669504 00000100:00100000:3.0:1789518676.595451:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627670016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518676.595636:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518676.597308:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627669888 00000100:00100000:2.0:1789518676.597321:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627669888 00000100:00100000:2.0:1789518676.597382:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627669632 00000100:00100000:2.0:1789518676.597386:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627669632 00000100:00100000:2.0:1789518676.597408:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627669760 00000100:00100000:2.0:1789518676.597411:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627669760 00000100:00100000:3.0:1789518676.598449:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789518676.599026:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518676.599035:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518676.599094:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771267 gen 2 00000004:00080000:3.0:1789518676.599102:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec48d4380, transno 30064771267 00000100:00100000:3.0:1789518676.599141:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627670016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518676.599345:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789518676.599367:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627669888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518676.599852:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627669504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518676.599985:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627669888:12345-0@lo:400:kworker.0 Request processed in 626us (5044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518676.599994:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627669504:12345-0@lo:400:kworker.0 Request processed in 4345us (4992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518676.599997:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789518676.600009:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789518676.600048:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789518676.600062:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627669632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518676.600064:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789518676.600081:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627669760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518676.600142:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627669504:0@lo:400:kworker.0 00000100:00100000:3.0:1789518676.600388:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627669376:0@lo:400:kworker.0 00000100:00100000:2.0:1789518676.600390:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627669632:12345-0@lo:400:kworker.0 Request processed in 328us (5325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518676.600407:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789518676.600418:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627669888:0@lo:400:kworker.0 00000100:00100000:0.0:1789518676.600836:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627669760:12345-0@lo:400:kworker.0 Request processed in 758us (5703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518676.600844:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789518676.602978:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627669760:0@lo:400:kworker.0 00000100:00100000:2.0:1789518676.602999:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627669632:0@lo:400:kworker.0 00010000:00010000:2.0:1789518676.850842:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518677.875371:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518677.903632:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518677.903669:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518677.903701:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518677.903744:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617448448 00000100:00100000:2.0:1789518677.903754:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617448448 00000100:00100000:1.0:1789518677.903809:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518677.903856:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617448320 00000100:00100000:3.0:1789518677.903861:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617448320 00000100:00100000:2.0:1789518677.903885:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1789518677.903897:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:2344:x1876445617448448:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518677.903899:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:3.0:1789518677.903910:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617448320:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518677.903983:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617448320:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 75us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518677.903990:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00080000:3.0:1789518677.904019:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518677.904081:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:2344:x1876445617448448:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 186us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518677.904089:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:1.0:1789518677.904500:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518677.904553:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617448832 00000100:00100000:3.0:1789518677.904558:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617448832 00000100:00100000:3.0:1789518677.904596:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:3.0:1789518677.904603:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617448832:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518677.904668:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617448832:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518677.904672:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617448576 00000100:00100000:0.0:1789518677.904672:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617448704 00000100:00100000:3.0:1789518677.904678:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:2.0:1789518677.904680:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617448576 00000100:00100000:0.0:1789518677.904681:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617448704 00000100:00100000:2.0:1789518677.904714:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:2.0:1789518677.904722:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617448576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518677.904728:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:0.0:1789518677.904739:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2344:x1876445617448704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518677.904749:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617448576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518677.904755:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:0.0:1789518677.904780:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2344:x1876445617448704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 43us (1077us total) trans 0 rc 0/0 00000100:00080000:2.0:1789518677.904784:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518677.904788:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518677.904791:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518677.904892:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000001:02000400:2.0:1789518678.170514:0:40046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10f: Tolerate -EDQUOT failure when auto PCC-RO attach with group quota ========================================================== 20:31:18 (1789518678) 00010000:00010000:0.0:1789518678.898931:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518679.150305:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.150396:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617449088 00000100:00100000:2.0:1789518679.150406:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617449088 00000100:00100000:2.0:1789518679.150484:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 436 00000100:00100000:2.0:1789518679.150495:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:38974:x1876445617449088:12345-192.168.206.51@tcp:101:dd.0 00000100:00080000:3.0:1789518679.150514:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789518679.150516:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.150520:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518679.150547:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd0696a00/0x631fd8698c7870fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe02d expref: 53 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.150578:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518679.150589:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518679.150603:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076dc00/0x631fd8698c7871d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe05e expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.150884:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.150897:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.150906:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.150919:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.150926:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.150933:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518679.151639:0:35847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcc:0x0], index 1: 0 00010000:00010000:2.0:1789518679.151871:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c7871ea lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.151880:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c7871ea lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.151887:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c7871ea lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.151915:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.151922:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.151928:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.151934:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.151938:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.151945:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.151953:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905a00) 00010000:00010000:2.0:1789518679.151956:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.151959:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.151965:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518679.151975:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cc5270c reply state 0000000048c46023 transno 30064771453 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518679.151983:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518679.152010:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076dc00/0x631fd8698c7871d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe05e expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.152026:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c7871ea lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe05e expref: 54 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.152034:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.152036:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518679.152039:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076ca00, rc 0) 00000100:00100000:2.0:1789518679.152172:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:38974:x1876445617449088:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1679us (1878us total) trans 30064771453 rc 0/0 00000100:00100000:2.0:1789518679.152180:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 436 00010000:00010000:3.0:1789518679.155093:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518679.155108:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518679.155117:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518679.155122:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518679.155127:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518679.155137:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518679.155151:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99fff6905500) 00010000:00010000:3.0:1789518679.155154:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518679.155158:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518679.155164:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c7871e3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518679.161231:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.161397:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617449216 00000100:00100000:2.0:1789518679.161406:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617449216 00000100:00100000:2.0:1789518679.161470:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:2.0:1789518679.161480:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:38974:x1876445617449216:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518679.161496:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.161514:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a0208c2/0x631fd8698c7871f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe065 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518679.161540:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518679.161562:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcc:0x0].0x0 since=733s v=(0 0) 00010000:00010000:2.0:1789518679.161567:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518679.161576:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a0208c2/0x631fd8698c7871f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe065 expref: 13 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.161598:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a0208c2/0x631fd8698c7871f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe065 expref: 13 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.161610:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076c400, rc 0) 00000100:00100000:2.0:1789518679.161683:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:38974:x1876445617449216:12345-192.168.206.51@tcp:101:dd.0 Request processed in 204us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518679.161690:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00080000:0.0:1789518679.162092:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518679.178245:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.178388:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617449344 00000100:00100000:0.0:1789518679.178398:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617449344 00002000:00100000:0.0:1789518679.178443:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff99ffed931880 x1876445617449344/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.178455:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931880 with x1876445617449344 ext(0->1048575) 00002000:00010000:0.0:1789518679.178461:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed931880 00000100:00100000:0.0:1789518679.178675:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 354 00000100:00100000:0.0:1789518679.178686:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617449344:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518679.187101:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.187156:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617449472 00000100:00100000:0.0:1789518679.187166:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617449472 00002000:00100000:0.0:1789518679.187213:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff99fec48d4380 x1876445617449472/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.187224:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d4380 with x1876445617449472 ext(1048576->2097151) 00002000:00010000:0.0:1789518679.187230:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec48d4380 00000100:00100000:0.0:1789518679.187261:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 355 00000100:00100000:0.0:1789518679.187272:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617449472:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518679.188721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.188881:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617449728 00000100:00100000:2.0:1789518679.188888:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617449728 00000100:00100000:2.0:1789518679.188927:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:2.0:1789518679.188936:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38974:x1876445617449728:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:2.0:1789518679.192387:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:38974:x1876445617449728:12345-192.168.206.51@tcp:35:dd.0 Request processed in 3439us (3657us total) trans 30064771454 rc 0/0 00000100:00100000:2.0:1789518679.192402:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:0.0:1789518679.197589:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2343:x1876445617449344:12345-192.168.206.51@tcp:4:dd.0 Request processed in 18895us (19342us total) trans 30064771269 rc 0/0 00000100:00100000:0.0:1789518679.197604:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 354 00002000:00100000:0.0:1789518679.197640:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff99ffed931880 x1876445617449344/t30064771269(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/448 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.197653:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffed931880 with x1876445617449344 ext(0->1048575) 00002000:00010000:0.0:1789518679.197660:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffed931880 00000001:00080000:3.0:1789518679.200574:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771450 is committed 00000001:00080000:3.0:1789518679.200596:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771451 is committed 00000001:00080000:3.0:1789518679.200605:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771453 is committed 00000100:00100000:2.0:1789518679.203317:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617449472:12345-192.168.206.51@tcp:4:dd.0 Request processed in 16032us (16210us total) trans 30064771270 rc 0/0 00000100:00100000:2.0:1789518679.203331:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 355 00002000:00100000:2.0:1789518679.203344:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff99fec48d4380 x1876445617449472/t30064771270(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/448 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518679.203354:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec48d4380 with x1876445617449472 ext(1048576->2097151) 00002000:00010000:2.0:1789518679.203361:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec48d4380 00000100:00100000:1.0:1789518679.210210:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.210476:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617449856 00000100:00100000:2.0:1789518679.210486:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617449856 00000100:00100000:2.0:1789518679.210774:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 437 00000100:00100000:2.0:1789518679.210785:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38975:x1876445617449856:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518679.210806:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.210828:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe06c expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.210889:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076dc00/0x631fd8698c787206 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.210902:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076dc00/0x631fd8698c787206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.210913:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076dc00/0x631fd8698c787206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518679.210946:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518679.210953:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518679.210998:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076dc00/0x631fd8698c787206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.211021:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c7871ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe06c expref: 50 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.211037:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076dc00/0x631fd8698c787206 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe06c expref: 49 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.211046:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905700) 00010000:00010000:2.0:1789518679.211048:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518679.211052:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076dc00, rc 0) 00000100:00100000:2.0:1789518679.211115:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38975:x1876445617449856:12345-192.168.206.51@tcp:101:chown.0 Request processed in 332us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518679.211122:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 437 00000100:00100000:2.0:1789518679.215813:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518679.216732:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617449984 00000100:00100000:3.0:1789518679.216742:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617449984 00000100:00100000:3.0:1789518679.217145:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 438 00000100:00100000:3.0:1789518679.217155:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38975:x1876445617449984:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:3.0:1789518679.217173:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518679.217193:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c78720d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe073 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.217293:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787214 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.217473:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787214 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.217485:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787214 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.217688:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c78720d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe073 expref: 51 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.217706:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d800/0x631fd8698c787214 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe073 expref: 50 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.217714:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.217717:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518679.217720:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076d800, rc 0) 00000100:00100000:2.0:1789518679.217786:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:38975:x1876445617449984:12345-192.168.206.51@tcp:101:chown.0 Request processed in 632us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518679.217793:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 438 00000100:00100000:1.0:1789518679.220828:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.220939:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617450240 00000100:00100000:2.0:1789518679.220948:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617450240 00000100:00100000:2.0:1789518679.221002:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 439 00000100:00100000:2.0:1789518679.221012:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:38975:x1876445617450240:12345-192.168.206.51@tcp:36:chown.0 00010000:00010000:2.0:1789518679.221059:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518679.221083:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c7871ea lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe05e expref: 50 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.221101:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.221106:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518679.221133:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.221145:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.221155:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518679.221711:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].15, 88 off9416 00000004:00080000:2.0:1789518679.221722:0:35847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733218107893ns, next at 734218105101ns, rc = 0 00000004:00010000:2.0:1789518679.221796:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068341ed3 reply state 00000000a1cc16a4 transno 30064771455 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518679.221806:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518679.221942:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:38975:x1876445617450240:12345-192.168.206.51@tcp:36:chown.0 Request processed in 930us (1121us total) trans 30064771455 rc 0/0 00000100:00100000:2.0:1789518679.221949:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 439 00010000:00010000:2.0:1789518679.224362:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.224376:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.224399:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.224405:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.224409:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.224417:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.224430:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.224433:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518679.224437:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.224443:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78721b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518679.224778:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.224864:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617450368 00000100:00100000:2.0:1789518679.224872:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617450368 00000100:00100000:2.0:1789518679.224929:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 440 00000100:00100000:2.0:1789518679.224939:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:38975:x1876445617450368:12345-192.168.206.51@tcp:101:chown.0 00010000:00010000:2.0:1789518679.224960:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.224975:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c787222 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe07a expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.225024:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c787222 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe07a expref: 51 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.225042:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c787222 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe07a expref: 51 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.225060:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.225063:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518679.225065:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076c200, rc 0) 00000100:00100000:2.0:1789518679.225115:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:38975:x1876445617450368:12345-192.168.206.51@tcp:101:chown.0 Request processed in 177us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518679.225123:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 440 00000100:00100000:1.0:1789518679.227827:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.227931:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617450496 00000100:00100000:2.0:1789518679.227945:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617450496 00000100:00100000:2.0:1789518679.228122:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:2.0:1789518679.228132:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2343:x1876445617450496:12345-192.168.206.51@tcp:2:chown.0 00002000:00010000:2.0:1789518679.228410:0:36735:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1789518679.228414:0:36735:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 0 -> 1789518679 00002000:00010000:2.0:1789518679.228416:0:36735:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518679.228418:0:36735:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 0 -> 1789518679 00002000:00010000:2.0:1789518679.228420:0:36735:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518679.228484:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2343:x1876445617450496:12345-192.168.206.51@tcp:2:chown.0 Request processed in 352us (667us total) trans 30064771271 rc 0/0 00000100:00100000:2.0:1789518679.228491:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:3.0:1789518679.268946:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.269076:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617450752 00000100:00100000:2.0:1789518679.269090:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617450752 00000100:00100000:2.0:1789518679.269201:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 441 00000100:00100000:2.0:1789518679.269214:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+51:38981:x1876445617450752:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:2.0:1789518679.269246:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.269273:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c787229 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe081 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.269380:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.269398:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.269412:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.269431:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.269437:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.269443:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.269908:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c78723e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.269925:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c78723e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.269935:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c78723e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518679.269948:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00010000:00010000:2.0:1789518679.270068:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270077:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270086:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270093:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.270099:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270107:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270122:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905700) 00010000:00010000:2.0:1789518679.270125:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.270132:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270139:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787230 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270153:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270158:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270164:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270174:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076da00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.270177:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270183:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270191:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99fff6905a00) 00010000:00010000:2.0:1789518679.270193:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.270196:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270202:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787237 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270251:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c787229 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe081 expref: 54 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270267:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c78723e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe081 expref: 53 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.270275:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.270277:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518679.270280:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076d400, rc 0) 00000100:00100000:0.0:1789518679.272045:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:38981:x1876445617450752:12345-192.168.206.51@tcp:101:dd.500 Request processed in 2822us (3168us total) trans 30064771456 rc 0/0 00000100:00100000:0.0:1789518679.272056:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 441 00000100:00100000:1.0:1789518679.275711:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.276048:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617451008 00000100:00100000:2.0:1789518679.276065:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617451008 00000100:00100000:2.0:1789518679.276147:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 442 00000100:00100000:2.0:1789518679.276159:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:38981:x1876445617451008:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:2.0:1789518679.276193:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.276197:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1789518679.276231:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c787222 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe07a expref: 53 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276258:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c78723e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe081 expref: 52 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276271:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.276277:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518679.276293:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78724c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe088 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276351:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276367:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276378:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276396:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276403:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276409:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276419:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076de00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.276424:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276431:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276439:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.276442:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518679.276445:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276451:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787253 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276476:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d000/0x631fd8698c78725a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276484:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d000/0x631fd8698c78725a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276490:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d000/0x631fd8698c78725a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276788:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d000/0x631fd8698c78725a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe088 expref: 54 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276796:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.276798:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518679.276809:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78724c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe088 expref: 54 pid: 35847 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276823:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d000/0x631fd8698c78725a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe088 expref: 53 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.276849:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.276852:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518679.276855:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076d000, rc 0) 00000100:00100000:2.0:1789518679.276930:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:38981:x1876445617451008:12345-192.168.206.51@tcp:101:dd.500 Request processed in 773us (1226us total) trans 30064771457 rc 0/0 00000100:00100000:2.0:1789518679.276938:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 442 00000100:00100000:1.0:1789518679.284023:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.284165:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617451136 00000100:00100000:0.0:1789518679.284175:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617451136 00002000:00100000:0.0:1789518679.284220:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff99fec25cd880 x1876445617451136/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.284345:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cd880 with x1876445617451136 ext(0->1048575) 00002000:00010000:0.0:1789518679.284354:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25cd880 00000100:00100000:0.0:1789518679.284391:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 356 00000100:00100000:0.0:1789518679.284401:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2343:x1876445617451136:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:0.0:1789518679.295655:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2343:x1876445617451136:12345-192.168.206.51@tcp:3:dd.0 Request processed in 11245us (11631us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518679.295666:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 356 00002000:00100000:0.0:1789518679.295679:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff99fec25cd880 x1876445617451136/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/440 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.295690:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cd880 with x1876445617451136 ext(0->1048575) 00002000:00010000:0.0:1789518679.295696:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25cd880 00000100:00100000:3.0:1789518679.312851:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.312985:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617451264 00000100:00100000:0.0:1789518679.312995:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617451264 00002000:00100000:0.0:1789518679.313040:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff99fff78a9180 x1876445617451264/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.313058:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78a9180 with x1876445617451264 ext(1048576->2097151) 00002000:00010000:0.0:1789518679.313063:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78a9180 00000100:00100000:0.0:1789518679.313100:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 357 00000100:00100000:0.0:1789518679.313110:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2344:x1876445617451264:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:0.0:1789518679.321717:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2344:x1876445617451264:12345-192.168.206.51@tcp:3:dd.0 Request processed in 8598us (8865us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789518679.321730:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 357 00002000:00100000:0.0:1789518679.321743:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff99fff78a9180 x1876445617451264/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/440 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.321753:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff78a9180 with x1876445617451264 ext(1048576->2097151) 00002000:00010000:0.0:1789518679.321759:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff78a9180 00000100:00100000:3.0:1789518679.338695:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.338947:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617451520 00000100:00100000:2.0:1789518679.338956:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617451520 00000100:00100000:2.0:1789518679.339010:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:2.0:1789518679.339020:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:38981:x1876445617451520:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:2.0:1789518679.339572:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38981:x1876445617451520:12345-192.168.206.51@tcp:35:dd.500 Request processed in 551us (884us total) trans 30064771458 rc 0/0 00000100:00100000:2.0:1789518679.339580:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:3.0:1789518679.393964:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.394068:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617451648 00000100:00100000:0.0:1789518679.394077:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617451648 00000100:00100000:0.0:1789518679.394136:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 443 00000100:00100000:0.0:1789518679.394145:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38991:x1876445617451648:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518679.394215:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394231:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394242:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394257:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394274:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394282:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394579:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394589:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394597:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518679.394662:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394674:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394681:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394688:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394699:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.394703:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394710:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394722:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905700) 00010000:00010000:0.0:1789518679.394725:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.394730:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394736:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394746:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394752:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394758:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394763:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.394766:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394772:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394778:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518679.394780:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.394783:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394789:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787268 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394806:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394812:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394818:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394822:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.394824:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394830:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394836:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.394838:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.394841:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.394846:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78726f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518679.395183:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38991:x1876445617451648:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 1038us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518679.395193:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 443 00000100:00100000:1.0:1789518679.421768:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.421869:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617451904 00000100:00100000:0.0:1789518679.421879:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617451904 00000100:00100000:0.0:1789518679.421935:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 444 00000100:00100000:0.0:1789518679.421945:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38992:x1876445617451904:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518679.421963:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518679.421982:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787276 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe08f expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422042:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422056:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422068:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422081:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422087:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422094:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422369:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422377:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422384:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422406:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.422411:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422418:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422430:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905700) 00010000:00010000:0.0:1789518679.422433:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.422445:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422452:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c78727d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422466:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422471:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422477:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422486:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.422489:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422495:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422505:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518679.422508:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.422511:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422517:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c787284 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422545:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787276 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe08f expref: 55 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422555:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905700) 00010000:00010000:0.0:1789518679.422557:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518679.422561:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787276 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe08f expref: 55 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.422570:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28d200, rc 0) 00000100:00100000:0.0:1789518679.422738:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38992:x1876445617451904:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 792us (978us total) trans 0 rc 301/301 00000100:00100000:0.0:1789518679.422746:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 444 00000100:00100000:3.0:1789518679.426768:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.427222:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617452032 00000100:00100000:2.0:1789518679.427235:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617452032 00000100:00100000:2.0:1789518679.427298:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 445 00000100:00100000:2.0:1789518679.427307:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38992:x1876445617452032:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:2.0:1789518679.427387:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.427403:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.427417:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.427432:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.427673:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.427683:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429453:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429472:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429482:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518679.429525:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00000004:00200000:2.0:1789518679.429529:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518679.429543:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429569:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429576:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429587:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429593:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076c600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.429596:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429605:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429631:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905700) 00010000:00010000:2.0:1789518679.429634:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.429639:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429645:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c78728b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429655:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.429661:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430283:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430290:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076de00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.430293:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430305:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430324:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99fff6905a00) 00010000:00010000:2.0:1789518679.430327:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.430330:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430337:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c787292 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430358:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430365:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430371:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430376:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076d400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.430378:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430384:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430391:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.430394:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.430397:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.430407:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c787299 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518679.430560:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38992:x1876445617452032:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 3250us (3804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518679.430568:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 445 00000100:00100000:3.0:1789518679.461763:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.461893:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617452288 00000100:00100000:0.0:1789518679.461906:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617452288 00000100:00100000:0.0:1789518679.461988:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 446 00000100:00100000:0.0:1789518679.462000:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:38998:x1876445617452288:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1789518679.462029:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518679.462034:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518679.462070:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076dc00/0x631fd8698c787206 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe06c expref: 54 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462093:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905700) 00010000:00010000:0.0:1789518679.462106:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518679.462123:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c7872a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe096 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462558:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462575:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462586:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462599:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462606:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462663:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462868:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c7872b5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462879:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c7872b5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.462886:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c7872b5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518679.462898:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00010000:00010000:0.0:1789518679.463012:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463021:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463028:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463035:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.463040:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463049:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463059:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518679.463062:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.463066:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463072:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463084:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463091:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463102:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463106:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.463109:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463115:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463122:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518679.463125:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.463127:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463133:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463210:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c7872a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe096 expref: 56 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463228:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c7872b5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe096 expref: 55 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.463236:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.463238:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518679.463240:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28ce00, rc 0) 00000100:00100000:0.0:1789518679.463338:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:38998:x1876445617452288:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1338us (1588us total) trans 30064771459 rc 0/0 00000100:00100000:0.0:1789518679.463351:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 446 00000100:00100000:1.0:1789518679.469021:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.469088:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617452544 00000100:00100000:2.0:1789518679.469101:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617452544 00000100:00100000:2.0:1789518679.469170:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 447 00000100:00100000:2.0:1789518679.469182:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:38998:x1876445617452544:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:2.0:1789518679.469252:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789518679.469286:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d000/0x631fd8698c78725a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe088 expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.469320:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ce00/0x631fd8698c7872b5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe096 expref: 54 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.469342:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.469348:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518679.469601:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.469661:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.469684:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518679.469760:0:39157:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771460 00000004:00010000:2.0:1789518679.469786:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000990b0b13 reply state 00000000a5568c45 transno 30064771461 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518679.469796:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518679.469908:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:38998:x1876445617452544:12345-192.168.206.51@tcp:36:dd.0 Request processed in 727us (900us total) trans 30064771461 rc 0/0 00000100:00100000:2.0:1789518679.469916:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 447 00000020:00080000:2.0:1789518679.469922:0:39157:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789518679.471732:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.471754:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.471763:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.471769:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076d400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.471775:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.471783:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.471800:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.471803:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.471809:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.471817:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d400/0x631fd8698c7872c3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518679.472180:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.472669:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617452672 00000100:00100000:2.0:1789518679.472681:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617452672 00000100:00100000:2.0:1789518679.472742:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 448 00000100:00100000:2.0:1789518679.472754:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:38998:x1876445617452672:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518679.472782:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.472804:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c7872ca lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe09d expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.472933:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c7872ca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe09d expref: 56 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.472950:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c7872ca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe09d expref: 56 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.472971:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.472975:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518679.472978:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076de00, rc 0) 00000100:00100000:2.0:1789518679.473322:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:38998:x1876445617452672:12345-192.168.206.51@tcp:101:dd.0 Request processed in 560us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518679.473332:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 448 00000100:00100000:3.0:1789518679.475126:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.475268:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617452928 00000100:00100000:0.0:1789518679.475280:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617452928 00000100:00100000:0.0:1789518679.475392:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 449 00000100:00100000:0.0:1789518679.475406:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:38998:x1876445617452928:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1789518679.475435:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518679.475439:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518679.475471:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076de00/0x631fd8698c7872ca lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe09d expref: 56 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.475493:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.475499:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518679.475515:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c7872d1 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0a4 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.475724:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872d8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.475741:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872d8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.475753:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872d8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.476412:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872d8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0a4 expref: 58 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.476424:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.476428:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789518679.476441:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c7872d1 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0a4 expref: 58 pid: 35845 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.476460:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872d8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0a4 expref: 57 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.476492:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.476496:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789518679.476498:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28ca00, rc 0) 00000100:00100000:0.0:1789518679.476750:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:38998:x1876445617452928:12345-192.168.206.51@tcp:101:dd.0 Request processed in 1346us (1632us total) trans 30064771462 rc 0/0 00000100:00100000:0.0:1789518679.476759:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 449 00000100:00100000:3.0:1789518679.487138:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.487338:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617453184 00000100:00100000:2.0:1789518679.487353:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617453184 00000100:00100000:2.0:1789518679.487434:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 450 00000100:00100000:2.0:1789518679.487447:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:38998:x1876445617453184:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:2.0:1789518679.487479:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.487483:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518679.487517:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c7872d8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0a4 expref: 57 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.487539:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.487545:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518679.487559:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d000/0x631fd8698c7872df lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0ab expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.487655:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c7872e6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.487672:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c7872e6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.487684:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c7872e6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789518679.488213:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].16, 88 off9504 00000004:00080000:2.0:1789518679.488224:0:39157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 733484609430ns, next at 734218105101ns, rc = 0 00000001:00080000:3.0:1789518679.523875:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771462 is committed 00000001:00080000:3.0:1789518679.523905:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771463 is committed 00000004:00080000:3.0:1789518679.523909:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00080000:3.0:1789518679.523930:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000100:00100000:3.0:1789518679.524015:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627670144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518679.524349:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518679.524526:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627670144 00000100:00100000:0.0:1789518679.524535:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627670144 00010000:00010000:2.0:1789518679.524545:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c7872e6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ab expref: 49 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.524570:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.524574:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518679.524593:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d000/0x631fd8698c7872df lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ab expref: 49 pid: 39157 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.524611:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c7872e6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ab expref: 48 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518679.524706:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789518679.524715:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627670144:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789518679.524870:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.524873:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1789518679.524876:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076c600, rc 0) 00000100:00100000:2.0:1789518679.524936:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38998:x1876445617453184:12345-192.168.206.51@tcp:101:dd.0 Request processed in 37492us (37812us total) trans 30064771463 rc 0/0 00002000:00010000:0.0:1789518679.524941:0:36533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1789518679.524947:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 450 00002000:00010000:0.0:1789518679.524947:0:36533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1789518679 -> 1789518679 00002000:00010000:0.0:1789518679.524953:0:36533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518679.524956:0:36533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1789518679 -> 1789518679 00002000:00010000:0.0:1789518679.524958:0:36533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:3.0:1789518679.525193:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789518679.525225:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffd846ce00/2, rc 0, transno 30064771272 00000100:00100000:3.0:1789518679.525242:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627670144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789518679.525285:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627670144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 571us (936us total) trans 30064771272 rc 0/0 00000100:00100000:0.0:1789518679.525292:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789518679.525464:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffedb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627670272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518679.525491:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518679.525596:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627670272 00000100:00100000:2.0:1789518679.525601:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627670272 00000100:00100000:2.0:1789518679.525669:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789518679.525678:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627670272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789518679.525794:0:36532:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1789518679.525798:0:36532:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1789518679 -> 1789518679 00002000:00010000:2.0:1789518679.525800:0:36532:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789518679.525802:0:36532:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1789518679 -> 1789518679 00002000:00010000:2.0:1789518679.525804:0:36532:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789518679.525841:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627670272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (348us total) trans 30064771273 rc 0/0 00000100:00100000:2.0:1789518679.525852:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000004:00080000:3.0:1789518679.525873:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffedb2b100/2, rc 0, transno 30064771273 00000100:00100000:3.0:1789518679.525879:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffedb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627670272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789518679.527357:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.527449:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617453312 00000100:00100000:0.0:1789518679.527456:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617453312 00002000:00010000:0.0:1789518679.527480:0:36538:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/204 (0->18446744073709551615) 00002000:00100000:0.0:1789518679.527485:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25ce680 with x1876445617453312 ext(0->18446744073709551615) 00002000:00010000:0.0:1789518679.527495:0:36538:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25ce680. 00000100:00100000:0.0:1789518679.527515:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 358 00000100:00100000:0.0:1789518679.527525:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2345:x1876445617453312:12345-192.168.206.51@tcp:10:dd.0 00002000:00010000:0.0:1789518679.527834:0:36538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:0.0:1789518679.527838:0:36538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1789518679 -> 1789518680 00002000:00010000:0.0:1789518679.527841:0:36538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789518679.527843:0:36538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1789518679 -> 1789518680 00002000:00010000:0.0:1789518679.527846:0:36538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789518679.527959:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2345:x1876445617453312:12345-192.168.206.51@tcp:10:dd.0 Request processed in 434us (605us total) trans 30064771274 rc 0/0 00000100:00100000:0.0:1789518679.527967:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 358 00002000:00010000:0.0:1789518679.527970:0:36538:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/204 (0->18446744073709551615) 00002000:00100000:0.0:1789518679.527973:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25ce680 with x1876445617453312 ext(0->18446744073709551615) 00002000:00010000:0.0:1789518679.527977:0:36538:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25ce680. 00000100:00100000:1.0:1789518679.552356:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.552463:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617453440 00000100:00100000:2.0:1789518679.552473:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617453440 00002000:00100000:2.0:1789518679.552519:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff99fec25cf100 x1876445617453440/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518679.552530:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cf100 with x1876445617453440 ext(0->1048575) 00002000:00010000:2.0:1789518679.552535:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25cf100 00000100:00100000:2.0:1789518679.552574:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 359 00000100:00100000:2.0:1789518679.552715:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+19:2344:x1876445617453440:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518679.564834:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2344:x1876445617453440:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12241us (12479us total) trans 30064771275 rc 0/0 00000100:00100000:3.0:1789518679.564847:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 359 00002000:00100000:3.0:1789518679.564874:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff99fec25cf100 x1876445617453440/t30064771275(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/448 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518679.564885:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cf100 with x1876445617453440 ext(0->1048575) 00002000:00010000:3.0:1789518679.564892:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25cf100 00000100:00100000:1.0:1789518679.573552:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.573983:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617453568 00000100:00100000:2.0:1789518679.573996:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617453568 00002000:00100000:2.0:1789518679.574062:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff99fec25cd180 x1876445617453568/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518679.574075:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cd180 with x1876445617453568 ext(1048576->2097151) 00002000:00010000:2.0:1789518679.574082:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25cd180 00000100:00100000:2.0:1789518679.574158:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 360 00000100:00100000:2.0:1789518679.574171:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+21:2343:x1876445617453568:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:3.0:1789518679.584760:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2343:x1876445617453568:12345-192.168.206.51@tcp:4:dd.0 Request processed in 10580us (11211us total) trans 30064771276 rc 0/0 00000100:00100000:3.0:1789518679.584774:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 360 00002000:00100000:3.0:1789518679.584789:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff99fec25cd180 x1876445617453568/t30064771276(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/448 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518679.584800:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cd180 with x1876445617453568 ext(1048576->2097151) 00002000:00010000:3.0:1789518679.584807:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25cd180 00000100:00100000:2.0:1789518679.593009:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.593938:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617453696 00000100:00100000:0.0:1789518679.593953:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617453696 00002000:00100000:0.0:1789518679.594024:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff99ffd03d9500 x1876445617453696/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.594038:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d9500 with x1876445617453696 ext(2097152->3145727) 00002000:00010000:0.0:1789518679.594051:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd03d9500 00000100:00100000:0.0:1789518679.594154:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 361 00000100:00100000:0.0:1789518679.594166:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+23:2342:x1876445617453696:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518679.602231:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.602332:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617453824 00000100:00100000:0.0:1789518679.602345:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617453824 00002000:00100000:0.0:1789518679.602408:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff99fff690ad80 x1876445617453824/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.602422:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff690ad80 with x1876445617453824 ext(3145728->4194303) 00002000:00010000:0.0:1789518679.602429:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff690ad80 00000100:00100000:0.0:1789518679.602462:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 362 00000100:00100000:0.0:1789518679.602473:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+25:2345:x1876445617453824:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:2.0:1789518679.606722:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2342:x1876445617453696:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12542us (13709us total) trans 30064771277 rc 0/0 00000100:00100000:2.0:1789518679.606739:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 361 00002000:00100000:2.0:1789518679.606757:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff99ffd03d9500 x1876445617453696/t30064771277(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/448 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518679.606775:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd03d9500 with x1876445617453696 ext(2097152->3145727) 00002000:00010000:2.0:1789518679.606784:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffd03d9500 00000100:00100000:1.0:1789518679.612730:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518679.612779:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.612815:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617454208 00000100:00100000:0.0:1789518679.612830:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617454208 00000100:00100000:0.0:1789518679.612889:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:0.0:1789518679.612902:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+48:38998:x1876445617454208:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:3.0:1789518679.613452:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617453952 00000100:00100000:3.0:1789518679.613459:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617453952 00002000:00100000:3.0:1789518679.613501:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff99fec25cc700 x1876445617453952/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518679.613533:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cc700 with x1876445617453952 ext(4194304->5242879) 00002000:00010000:3.0:1789518679.613540:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25cc700 00000100:00100000:3.0:1789518679.613575:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 363 00000100:00100000:3.0:1789518679.613584:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+27:2344:x1876445617453952:12345-192.168.206.51@tcp:4:dd.0 00000100:00100000:0.0:1789518679.614527:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:38998:x1876445617454208:12345-192.168.206.51@tcp:35:dd.0 Request processed in 1622us (1741us total) trans 30064771464 rc 0/0 00000100:00100000:0.0:1789518679.614539:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:0.0:1789518679.618130:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2345:x1876445617453824:12345-192.168.206.51@tcp:4:dd.0 Request processed in 15643us (15899us total) trans 30064771278 rc 0/0 00000100:00100000:0.0:1789518679.618146:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 362 00002000:00100000:0.0:1789518679.618163:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff99fff690ad80 x1876445617453824/t30064771278(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/448 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.618175:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff690ad80 with x1876445617453824 ext(3145728->4194303) 00002000:00010000:0.0:1789518679.618184:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff690ad80 00000100:00100000:3.0:1789518679.626531:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2344:x1876445617453952:12345-192.168.206.51@tcp:4:dd.0 Request processed in 12931us (13798us total) trans 30064771279 rc 0/0 00000100:00100000:3.0:1789518679.626548:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 363 00002000:00100000:3.0:1789518679.626564:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff99fec25cc700 x1876445617453952/t30064771279(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/448 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518679.626576:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec25cc700 with x1876445617453952 ext(4194304->5242879) 00002000:00010000:3.0:1789518679.626584:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec25cc700 00000100:00100000:2.0:1789518679.669028:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.669090:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617454336 00000100:00100000:0.0:1789518679.669103:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617454336 00000100:00100000:0.0:1789518679.669176:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 451 00000100:00100000:0.0:1789518679.669189:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+49:39008:x1876445617454336:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518679.669216:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518679.669250:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0b2 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.669343:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7872f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.669360:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7872f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.669374:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7872f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518679.669411:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518679.669414:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518679.669436:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7872f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.669466:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d600/0x631fd8698c7872ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0b2 expref: 51 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.669484:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7872f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0b2 expref: 50 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.669493:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518679.669496:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518679.669500:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28c600, rc 0) 00000100:00100000:0.0:1789518679.669558:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:39008:x1876445617454336:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 372us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518679.669564:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 451 00000100:00100000:3.0:1789518679.672074:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.672561:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617454464 00000100:00100000:0.0:1789518679.672574:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617454464 00000100:00100000:0.0:1789518679.672651:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 452 00000100:00100000:0.0:1789518679.672664:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:39008:x1876445617454464:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518679.672760:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.672781:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.672796:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.672814:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.672822:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.672829:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673175:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673187:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673195:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518679.673247:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673263:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673269:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673277:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673289:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28dc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.673295:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673303:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673331:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518679.673335:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.673341:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673348:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c7872fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673363:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673370:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673377:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673382:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.673385:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673393:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673412:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518679.673415:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.673419:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673426:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c787302 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673445:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673453:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673459:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673465:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.673468:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673474:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673482:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.673484:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.673487:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.673494:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787309 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518679.673603:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:39008:x1876445617454464:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 940us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518679.673648:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 452 00000100:00100000:3.0:1789518679.718901:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.719497:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617454720 00000100:00100000:2.0:1789518679.719511:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617454720 00000100:00100000:2.0:1789518679.719586:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 453 00000100:00100000:2.0:1789518679.719598:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+50:39014:x1876445617454720:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:2.0:1789518679.719670:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.719691:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787310 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0b9 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.719779:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.719799:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.719810:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.719825:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.719832:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.719839:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720220:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c787325 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720231:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c787325 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720238:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c787325 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518679.720530:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:2.0:1789518679.720692:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720700:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720706:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720711:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076da00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.720715:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720722:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720734:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:2.0:1789518679.720736:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.720741:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720751:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076da00/0x631fd8698c787317 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720762:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720768:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720772:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720776:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffd076d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.720779:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720784:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720790:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99fff6905100) 00010000:00010000:2.0:1789518679.720793:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.720795:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720800:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076d600/0x631fd8698c78731e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720840:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076ca00/0x631fd8698c787310 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0b9 expref: 53 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720860:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c787325 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0b9 expref: 52 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.720867:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.720869:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518679.720872:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffd076c200, rc 0) 00000100:00100000:2.0:1789518679.720948:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:39014:x1876445617454720:12345-192.168.206.51@tcp:101:dd.500 Request processed in 1351us (2060us total) trans 30064771465 rc 0/0 00000100:00100000:2.0:1789518679.720956:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 453 00000100:00100000:2.0:1789518679.723951:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.724056:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617454976 00000100:00100000:0.0:1789518679.724066:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617454976 00000100:00100000:0.0:1789518679.724127:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 454 00000100:00100000:0.0:1789518679.724137:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:39014:x1876445617454976:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:0.0:1789518679.724158:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518679.724161:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1789518679.724185:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c600/0x631fd8698c7872e6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ab expref: 52 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724205:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffd076c200/0x631fd8698c787325 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0b9 expref: 51 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724216:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.724221:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518679.724233:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787333 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0c0 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724270:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724283:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724294:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724408:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724417:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724423:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724429:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc28d200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.724433:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724441:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724449:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.724452:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518679.724456:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724461:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28d200/0x631fd8698c78733a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724484:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c787341 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724492:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c787341 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724499:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c787341 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724830:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c787341 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0c0 expref: 53 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724840:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.724842:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789518679.724852:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28ca00/0x631fd8698c787333 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0c0 expref: 53 pid: 35847 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724934:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28dc00/0x631fd8698c787341 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0c0 expref: 52 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.724959:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.724962:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1789518679.724965:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc28dc00, rc 0) 00000100:00100000:0.0:1789518679.725078:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:39014:x1876445617454976:12345-192.168.206.51@tcp:101:dd.500 Request processed in 942us (1135us total) trans 30064771466 rc 0/0 00000100:00100000:0.0:1789518679.725086:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 454 00000100:00100000:3.0:1789518679.735336:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.736054:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617455104 00000100:00100000:2.0:1789518679.736064:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617455104 00002000:00100000:2.0:1789518679.736112:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff99fff79afb80 x1876445617455104/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518679.736123:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff79afb80 with x1876445617455104 ext(0->1048575) 00002000:00010000:2.0:1789518679.736128:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff79afb80 00000100:00100000:2.0:1789518679.736162:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 364 00000100:00100000:2.0:1789518679.736172:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2345:x1876445617455104:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:2.0:1789518679.742923:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2345:x1876445617455104:12345-192.168.206.51@tcp:3:dd.0 Request processed in 6741us (7585us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518679.742936:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 364 00002000:00100000:2.0:1789518679.742950:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff99fff79afb80 x1876445617455104/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/440 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518679.742968:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff79afb80 with x1876445617455104 ext(0->1048575) 00002000:00010000:2.0:1789518679.742975:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff79afb80 00000100:00100000:0.0:1789518679.750723:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.750895:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617455232 00000100:00100000:2.0:1789518679.750904:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617455232 00002000:00100000:2.0:1789518679.750953:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff99fff7881c00 x1876445617455232/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518679.750964:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7881c00 with x1876445617455232 ext(1048576->2097151) 00002000:00010000:2.0:1789518679.750969:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7881c00 00000100:00100000:2.0:1789518679.751004:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 365 00000100:00100000:2.0:1789518679.751014:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2344:x1876445617455232:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:2.0:1789518679.759058:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2344:x1876445617455232:12345-192.168.206.51@tcp:3:dd.0 Request processed in 8035us (8336us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789518679.759072:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 365 00002000:00100000:2.0:1789518679.759086:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff99fff7881c00 x1876445617455232/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/440 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518679.759097:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff7881c00 with x1876445617455232 ext(1048576->2097151) 00002000:00010000:2.0:1789518679.759104:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff7881c00 00000100:00100000:3.0:1789518679.774844:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518679.775186:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518679.776595:0:39057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617455488 00000100:00100000:0.0:1789518679.776595:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617455360 00000100:00100000:1.0:1789518679.776606:0:39057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617455488 00000100:00100000:0.0:1789518679.776606:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617455360 00002000:00100000:0.0:1789518679.776669:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff99fff79ace00 x1876445617455360/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518679.776680:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff79ace00 with x1876445617455360 ext(2097152->3145727) 00002000:00010000:0.0:1789518679.776687:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff79ace00 00002000:00100000:1.0:1789518679.776720:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff99fff79adf80 x1876445617455488/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518679.776729:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff79adf80 with x1876445617455488 ext(3145728->4194303) 00002000:00010000:1.0:1789518679.776733:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff79adf80 00000100:00100000:0.0:1789518679.776760:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 366 00000100:00100000:0.0:1789518679.776769:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+30:2343:x1876445617455360:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:1.0:1789518679.777863:0:39057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 367 00000100:00100000:1.0:1789518679.777877:0:39057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2342:x1876445617455488:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:1.0:1789518679.791451:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+31:2343:x1876445617455360:12345-192.168.206.51@tcp:3:dd.0 Request processed in 14673us (16606us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518679.791465:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 366 00002000:00100000:1.0:1789518679.791478:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff99fff79ace00 x1876445617455360/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/440 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518679.791506:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff79ace00 with x1876445617455360 ext(2097152->3145727) 00002000:00010000:1.0:1789518679.791513:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff79ace00 00000100:00100000:1.0:1789518679.794353:0:39057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2342:x1876445617455488:12345-192.168.206.51@tcp:3:dd.0 Request processed in 16470us (19158us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789518679.794365:0:39057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 367 00002000:00100000:1.0:1789518679.794379:0:39057:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff99fff79adf80 x1876445617455488/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/440 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518679.794390:0:39057:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff79adf80 with x1876445617455488 ext(3145728->4194303) 00002000:00010000:1.0:1789518679.794396:0:39057:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff79adf80 00000100:00100000:2.0:1789518679.819491:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518679.820065:0:36539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617455616 00000100:00100000:3.0:1789518679.820075:0:36539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617455616 00002000:00100000:2.0:1789518679.820223:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff99fff6909500 x1876445617455616/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/0 e 0 to 0 dl 1789518690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518679.820300:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff6909500 with x1876445617455616 ext(4194304->5242879) 00002000:00010000:2.0:1789518679.820319:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff6909500 00000100:00100000:2.0:1789518679.820435:0:36539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 368 00000100:00100000:2.0:1789518679.820447:0:36539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2345:x1876445617455616:12345-192.168.206.51@tcp:3:dd.0 00000100:00100000:3.0:1789518679.829282:0:36539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+29:2345:x1876445617455616:12345-192.168.206.51@tcp:3:dd.0 Request processed in 8827us (9791us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789518679.829295:0:36539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 368 00002000:00100000:3.0:1789518679.829320:0:36539:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff99fff6909500 x1876445617455616/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:325/0 lens 488/440 e 0 to 0 dl 1789518690 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789518679.829351:0:36539:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fff6909500 with x1876445617455616 ext(4194304->5242879) 00002000:00010000:3.0:1789518679.829358:0:36539:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fff6909500 00000100:00100000:2.0:1789518679.850209:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.851185:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617455872 00000100:00100000:0.0:1789518679.851196:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617455872 00000100:00100000:0.0:1789518679.851258:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:0.0:1789518679.851268:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd0c35050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:39014:x1876445617455872:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:0.0:1789518679.851692:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd0c35050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:39014:x1876445617455872:12345-192.168.206.51@tcp:35:dd.500 Request processed in 424us (1489us total) trans 30064771467 rc 0/0 00000100:00100000:0.0:1789518679.851705:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 108 00000100:00100000:1.0:1789518679.894083:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.894518:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617456000 00000100:00100000:0.0:1789518679.894535:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617456000 00000100:00100000:0.0:1789518679.894739:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 455 00000100:00100000:0.0:1789518679.894752:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:39020:x1876445617456000:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518679.894850:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.894873:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.894888:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.894904:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.894911:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.894918:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896114:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896132:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896141:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518679.896199:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896214:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896221:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896228:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896235:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.896240:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896248:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896260:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518679.896264:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.896269:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896276:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787348 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896290:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896295:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896301:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896306:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.896321:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896328:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896335:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518679.896338:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.896341:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896347:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c78734f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896364:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896370:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896377:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896382:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.896385:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896391:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896397:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.896400:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.896403:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.896409:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787356 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518679.896869:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:39020:x1876445617456000:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 2105us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518679.896881:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 455 00000100:00100000:2.0:1789518679.914570:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518679.914682:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617456256 00000100:00100000:1.0:1789518679.914699:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617456256 00000100:00100000:1.0:1789518679.914836:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 456 00000100:00100000:1.0:1789518679.914849:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:39021:x1876445617456256:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518679.914875:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518679.914900:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c78735d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0c7 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.914990:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915007:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915021:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915060:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915069:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915077:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915439:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915448:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915455:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915462:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518679.915467:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915475:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915488:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:1.0:1789518679.915492:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518679.915498:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915504:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915525:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915531:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915538:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915543:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518679.915546:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915552:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915560:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99ffc6733400) 00010000:00010000:1.0:1789518679.915562:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518679.915565:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915571:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c78736b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915684:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c78735d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0c7 expref: 54 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915697:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:1.0:1789518679.915699:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518679.915712:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c78735d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0c7 expref: 54 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.915722:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380e00, rc 0) 00000100:00100000:1.0:1789518679.915807:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:39021:x1876445617456256:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 961us (1244us total) trans 0 rc 301/301 00000100:00100000:1.0:1789518679.915816:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 456 00000100:00100000:2.0:1789518679.919396:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518679.919557:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617456384 00000100:00100000:0.0:1789518679.919570:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617456384 00000100:00100000:0.0:1789518679.919659:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 457 00000100:00100000:0.0:1789518679.919671:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff6908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:39021:x1876445617456384:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:0.0:1789518679.919768:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.919788:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.919803:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.919818:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.919825:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.919832:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920275:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920284:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920292:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518679.920344:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00000004:00200000:0.0:1789518679.920349:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518679.920362:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920376:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920384:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920396:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920402:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.920406:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920414:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920425:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518679.920428:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.920433:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920439:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920451:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920458:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920464:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920468:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.920471:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920481:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920487:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518679.920489:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.920492:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920497:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787379 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920510:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920515:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920520:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920525:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518679.920527:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920533:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920540:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:0.0:1789518679.920542:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518679.920544:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518679.920554:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787380 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518679.920657:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff6908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:39021:x1876445617456384:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 987us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518679.920666:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 457 00010000:00010000:2.0:1789518679.923836:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518679.950570:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518679.950718:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617456512 00000100:00100000:2.0:1789518679.950731:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617456512 00000100:00100000:2.0:1789518679.950800:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 458 00000100:00100000:2.0:1789518679.950812:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:39027:x1876445617456512:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518679.950837:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518679.950862:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c787387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0ce expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.950941:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.950957:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.950971:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.950987:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.950994:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.951001:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.951998:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952013:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952022:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518679.952068:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00000004:00200000:2.0:1789518679.952073:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518679.952172:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952186:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952196:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952203:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952210:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952216:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.952221:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952229:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952244:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:2.0:1789518679.952247:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.952253:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952259:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c78738e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952273:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952280:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952286:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952291:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518679.952294:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952300:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952317:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff99fff6905100) 00010000:00010000:2.0:1789518679.952319:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518679.952323:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952329:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c787395 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952373:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c787387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ce expref: 55 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952389:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ce expref: 54 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518679.952397:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518679.952399:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518679.952401:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901a00, rc 0) 00000100:00100000:2.0:1789518679.952554:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:39027:x1876445617456512:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1742us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518679.952563:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 458 00000100:00100000:3.0:1789518679.956211:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518679.960402:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617456768 00000100:00100000:1.0:1789518679.960424:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617456768 00000100:00100000:1.0:1789518679.960518:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 459 00000100:00100000:1.0:1789518679.960534:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:39027:x1876445617456768:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518679.960562:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518679.960588:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0d5 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.960734:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c7873aa lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.960753:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c7873aa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.960768:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c7873aa lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518679.960780:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:1.0:1789518679.960945:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0d5 expref: 57 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.960966:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381400/0x631fd8698c7873aa lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0d5 expref: 56 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518679.960992:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:1.0:1789518679.960996:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789518679.961000:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381400, rc 0) 00000100:00100000:1.0:1789518679.961087:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:39027:x1876445617456768:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 559us (4890us total) trans 30064771468 rc 0/0 00000100:00100000:1.0:1789518679.961095:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 459 00000100:00100000:3.0:1789518680.038740:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518680.038919:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617457024 00000100:00100000:2.0:1789518680.038933:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617457024 00000100:00100000:2.0:1789518680.039014:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 460 00000100:00100000:2.0:1789518680.039027:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:39033:x1876445617457024:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518680.039059:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518680.039085:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7873b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0dc expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518680.039202:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c7873bf lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518680.039214:0:39157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ce expref: 57 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518680.039222:0:39157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c7873bf lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518680.039256:0:39157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ce expref: 57 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518680.039267:0:39157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ce expref: 57 pid: 35845 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518680.039278:0:39157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff690b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:39157:1876445627670400:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518680.039408:0:39157:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5dc780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518680.041689:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518680.041879:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617457152 00000100:00100000:2.0:1789518680.041897:0:39157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff690b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:39157:1876445627670400:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518680.041899:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617457152 00010000:00010000:2.0:1789518680.041937:0:39157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c7873bf lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518680.041945:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ce expref: 58 pid: 35845 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518680.041993:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1789518680.042003:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2342:x1876445617457152:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518680.042037:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518680.042046:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ce expref: 58 pid: 35845 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518680.042060:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ce expref: 58 pid: 35845 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518680.042090:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c78739c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ce expref: 58 pid: 35845 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518680.042118:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:1.0:1789518680.042123:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c7873bf lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518680.042148:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c7873bf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518680.042157:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c7873bf lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518680.042187:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518680.042231:0:39157:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c7873bf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518680.042241:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c7873bf lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518680.042249:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2342:x1876445617457152:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 245us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518680.042259:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000004:00200000:2.0:1789518680.042265:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:2.0:1789518680.042577:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7873b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0dc expref: 58 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518680.042596:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900c00/0x631fd8698c7873bf lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0dc expref: 57 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518680.042608:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff99fff6905800) 00010000:00010000:2.0:1789518680.042660:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789518680.042665:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900c00, rc 0) 00000100:00100000:2.0:1789518680.042698:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:39033:x1876445617457024:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 3674us (3972us total) trans 30064771469 rc 0/0 00000100:00100000:2.0:1789518680.042707:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 460 00010000:00010000:2.0:1789518680.947348:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518681.202756:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518681.202778:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff690b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627670528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518681.202844:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518681.202928:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627670528 00000100:00100000:0.0:1789518681.202936:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627670528 00000100:00100000:0.0:1789518681.203081:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789518681.203091:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627670528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518681.203185:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216334336 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518681.203256:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627670528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518681.203263:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789518681.203631:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518681.203674:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff690b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627670528:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789518681.248545:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771278 is committed 00000001:00080000:0.0:1789518681.248563:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771272 is committed 00000001:00080000:0.0:1789518681.248575:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771273 is committed 00000001:00080000:0.0:1789518681.248586:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771279 is committed 00000100:00100000:3.0:1789518681.714851:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627670656:0@lo:400:kworker.0 00000100:00100000:2.0:1789518681.714851:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627670912:0@lo:400:kworker.0 00000100:00100000:0.0:1789518681.714854:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627671040:0@lo:400:kworker.0 00000100:00100000:3.0:1789518681.715551:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518681.715551:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518681.715609:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627671168:0@lo:400:kworker.0 00000100:00100000:0.0:1789518681.715666:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518681.715673:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789518681.715687:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627670784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518681.715714:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518681.715735:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518681.715778:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627670656 00000100:00100000:2.0:1789518681.715779:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627671296:0@lo:400:kworker.0 00000100:00100000:0.0:1789518681.715792:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627670656 00000100:00100000:2.0:1789518681.715810:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518681.715856:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627670912 00000100:00100000:2.0:1789518681.715864:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627670912 00000100:00100000:0.0:1789518681.715870:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789518681.715917:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518681.715928:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627670912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518681.715975:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627670912:12345-0@lo:400:kworker.0 Request processed in 50us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518681.715981:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518681.716003:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627671040 00000100:00100000:2.0:1789518681.716006:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627671040 00000100:00100000:2.0:1789518681.716027:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627671168 00000100:00100000:2.0:1789518681.716030:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627671168 00000100:00100000:2.0:1789518681.716050:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627671296 00000100:00100000:2.0:1789518681.716053:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627671296 00000100:00100000:3.0:1789518681.716058:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789518681.716068:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627671040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518681.716073:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789518681.716082:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627671168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518681.716123:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627671168:12345-0@lo:400:kworker.0 Request processed in 42us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518681.716129:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789518681.716145:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789518681.716154:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff690b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627671296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518681.716157:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627671040:12345-0@lo:400:kworker.0 Request processed in 89us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518681.716165:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789518681.716189:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff690b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627671296:12345-0@lo:400:kworker.0 Request processed in 38us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518681.716196:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789518681.716213:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627671040:0@lo:400:kworker.0 00000100:00080000:2.0:1789518681.716216:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518681.716223:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518681.716252:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627671168:0@lo:400:kworker.0 00000100:00100000:2.0:1789518681.716263:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627671296:0@lo:400:kworker.0 00000100:00100000:0.0:1789518681.716281:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627670656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518681.716282:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771273 gen 2 00000004:00080000:2.0:1789518681.716293:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffd846ce00, transno 30064771272 00000004:00080000:2.0:1789518681.716325:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffedb2b100, transno 30064771273 00000100:00100000:2.0:1789518681.716333:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627670912:0@lo:400:kworker.0 00000100:00100000:0.0:1789518681.716370:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627670656:12345-0@lo:400:kworker.0 Request processed in 489us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518681.716380:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789518681.716439:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627670784 00000100:00100000:0.0:1789518681.716445:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627670784 00000100:00100000:0.0:1789518681.716490:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518681.716499:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627670784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518681.716532:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518681.716915:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627670784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 415us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518681.716924:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518681.717069:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627670784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518681.717123:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627670656:0@lo:400:kworker.0 00010000:00010000:0.0:1789518681.971339:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518682.995537:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518683.022756:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518683.022799:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518683.022853:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518683.022891:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617457408 00000100:00100000:2.0:1789518683.022901:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617457408 00000100:00100000:2.0:1789518683.022993:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1789518683.023004:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2345:x1876445617457408:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:3.0:1789518683.023077:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518683.023084:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2345:x1876445617457408:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518683.023092:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:0.0:1789518683.023336:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617457280 00000100:00100000:0.0:1789518683.023342:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617457280 00000100:00100000:0.0:1789518683.023381:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:0.0:1789518683.023389:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617457280:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518683.023425:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617457280:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518683.023433:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:2.0:1789518683.023447:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617457664 00000100:00100000:2.0:1789518683.023453:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617457664 00000100:00080000:0.0:1789518683.023483:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518683.023530:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:2.0:1789518683.023538:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617457664:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518683.023565:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617457664:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518683.023571:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:3.0:1789518683.025820:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518683.025868:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518683.025964:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617457536 00000100:00100000:0.0:1789518683.025971:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617457536 00000100:00100000:0.0:1789518683.026073:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:0.0:1789518683.026083:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617457536:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518683.026140:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617457536:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 59us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518683.026150:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:1.0:1789518683.026377:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617457792 00000100:00100000:1.0:1789518683.026383:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617457792 00000100:00080000:3.0:1789518683.026561:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518683.026567:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518683.027907:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1789518683.027920:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617457792:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518683.028065:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617457792:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 148us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518683.028073:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000001:02000400:1.0:1789518683.628450:0:40245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 11: Test attach fault injection with simulated PCC file path ========================================================== 20:31:23 (1789518683) 00010000:00010000:3.0:1789518684.021298:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518684.385322:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518684.386180:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617458048 00000100:00100000:0.0:1789518684.386195:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617458048 00000100:00100000:0.0:1789518684.386265:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 461 00000100:00100000:0.0:1789518684.386276:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:39713:x1876445617458048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518684.386304:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518684.386326:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7873cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0e3 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386397:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386411:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386423:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386438:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386445:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386451:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386806:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c7873e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386819:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c7873e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386825:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c7873e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518684.386834:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789518684.386914:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386921:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386928:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386934:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518684.386938:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386945:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386955:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:0.0:1789518684.386959:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518684.386964:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386970:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7873d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386981:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386987:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386993:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.386998:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518684.387002:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.387007:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.387014:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc2d97200) 00010000:00010000:0.0:1789518684.387017:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518684.387019:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.387025:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c7873db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.387452:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7873cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0e3 expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.387468:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c7873e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0e3 expref: 59 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.387475:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:0.0:1789518684.387478:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518684.387481:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23200, rc 0) 00000100:00100000:0.0:1789518684.387545:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:39713:x1876445617458048:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1271us (2237us total) trans 30064771470 rc 0/0 00000100:00100000:0.0:1789518684.387553:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 461 00000100:00100000:0.0:1789518684.392081:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518684.392773:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617458176 00000100:00100000:3.0:1789518684.392786:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617458176 00000100:00100000:3.0:1789518684.393249:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:3.0:1789518684.393262:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:2342:x1876445617458176:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518684.393282:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518684.393324:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c7873e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0e3 expref: 59 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.393348:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:3.0:1789518684.393353:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518684.393596:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2342:x1876445617458176:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 335us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518684.393605:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1789518684.394139:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.394312:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617458304 00000100:00100000:1.0:1789518684.394321:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617458304 00000100:00100000:1.0:1789518684.394371:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 462 00000100:00100000:1.0:1789518684.394380:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:39713:x1876445617458304:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789518684.394498:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:39713:x1876445617458304:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 118us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518684.394506:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 462 00000100:00100000:0.0:1789518684.454842:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.454961:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617458560 00000100:00100000:1.0:1789518684.454971:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617458560 00000100:00100000:1.0:1789518684.455096:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 463 00000100:00100000:1.0:1789518684.455107:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:39727:x1876445617458560:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518684.455126:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518684.455129:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789518684.455156:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc28c600/0x631fd8698c7872f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0b2 expref: 58 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.455175:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:1.0:1789518684.455186:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518684.455201:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7873f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0ea expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.455712:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.455727:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.455736:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.455787:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.455796:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.455803:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518684.456560:0:37723:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcd:0x0], index 0: 0 00010000:00010000:1.0:1789518684.456843:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.456856:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.456864:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.456904:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.456912:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.456919:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.456924:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518684.456930:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.456938:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.456948:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:1.0:1789518684.456951:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518684.456955:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.456972:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7873f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518684.456987:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3f754e4 reply state 00000000050ff125 transno 30064771471 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.456996:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518684.457031:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7873f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ea expref: 60 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.457048:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ea expref: 59 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.457055:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:1.0:1789518684.457057:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518684.457059:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381c00, rc 0) 00000100:00100000:1.0:1789518684.457146:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:39727:x1876445617458560:12345-192.168.206.51@tcp:101:bash.0 Request processed in 2041us (2312us total) trans 30064771471 rc 0/0 00000100:00100000:1.0:1789518684.457154:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 463 00010000:00010000:2.0:1789518684.460373:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.460391:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.460398:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.460404:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518684.460408:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.460481:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.460499:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff99ffc6733400) 00010000:00010000:2.0:1789518684.460503:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518684.460508:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.460514:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c7873fe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518684.462030:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.462980:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617458688 00000100:00100000:2.0:1789518684.462990:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617458688 00000100:00100000:2.0:1789518684.463073:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:2.0:1789518684.463083:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617458688:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518684.463102:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518684.463120:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0f1 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518684.463147:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518684.463166:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1789518684.463170:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518684.463179:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f1 expref: 11 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.463194:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f1 expref: 11 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.463206:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901000, rc 0) 00000100:00100000:2.0:1789518684.463275:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617458688:12345-192.168.206.51@tcp:101:bash.0 Request processed in 193us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518684.463282:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:0.0:1789518684.466478:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.466638:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617458816 00000100:00100000:2.0:1789518684.466647:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617458816 00000100:00100000:2.0:1789518684.466698:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:2.0:1789518684.466707:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:39727:x1876445617458816:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518684.466724:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518684.466743:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0f8 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.466773:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f1 expref: 12 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.466782:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518684.466787:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518684.466792:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 4/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 12 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.466824:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f1 expref: 12 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.466836:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f1 expref: 12 pid: 37973 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518684.466851:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627671424:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518684.467012:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc865b180 going to sleep for 11 seconds 00000040:00080000:1.0:1789518684.467243:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518684.467247:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518684.467270:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 8 00000040:00080000:1.0:1789518684.467274:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518684.468876:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627671424:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518684.468928:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 3/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 12 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.468954:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900400, rc 0) 00000100:00100000:2.0:1789518684.469028:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:39727:x1876445617458816:12345-192.168.206.51@tcp:101:bash.0 Request processed in 2321us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518684.469038:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:3.0:1789518684.469808:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518684.469902:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617458944 00000100:00100000:0.0:1789518684.469912:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617458944 00010000:00010000:0.0:1789518684.469954:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f1 expref: 12 pid: 37973 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518684.470001:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:0.0:1789518684.470010:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617458944:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518684.470026:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518684.470054:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f1 expref: 12 pid: 37973 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.470068:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f1 expref: 12 pid: 37973 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.470094:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787413 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f1 expref: 12 pid: 37973 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.470112:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518684.470118:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518684.470129:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 11 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.470141:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 11 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.470181:0:35830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 11 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518684.470195:0:35830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35830:1876445627671552:192.168.206.51@tcp:105: 00000100:00100000:0.0:1789518684.470298:0:35830:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4924780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518684.473315:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.473535:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617459200 00000100:00100000:2.0:1789518684.473548:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617459200 00000100:00100000:2.0:1789518684.473655:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:2.0:1789518684.473667:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:39727:x1876445617459200:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:0.0:1789518684.473793:0:35830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35830:1876445627671552:192.168.206.51@tcp:105: 00010000:00010000:0.0:1789518684.473823:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518684.473990:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617458944:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3979us (4183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518684.474002:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:2.0:1789518684.474131:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:39727:x1876445617459200:12345-192.168.206.51@tcp:35:bash.0 Request processed in 466us (828us total) trans 30064771472 rc 0/0 00000100:00100000:2.0:1789518684.474139:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1789518684.492596:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518684.492781:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617459328 00000100:00100000:0.0:1789518684.492794:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617459328 00000100:00100000:0.0:1789518684.492874:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 464 00000100:00100000:0.0:1789518684.492887:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:39730:x1876445617459328:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518684.492918:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518684.492944:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe0ff expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.493022:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787428 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.493039:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.493052:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518684.493092:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518684.493096:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518684.493116:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.493142:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ff expref: 62 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.493162:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787428 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ff expref: 61 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.493172:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518684.493175:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518684.493179:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23000, rc 0) 00000100:00100000:0.0:1789518684.493314:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:39730:x1876445617459328:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 430us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518684.493323:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 464 00000100:00100000:3.0:1789518684.608120:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.608752:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617459584 00000100:00100000:1.0:1789518684.608765:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617459584 00000100:00100000:1.0:1789518684.608909:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 465 00000100:00100000:1.0:1789518684.608922:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:39753:x1876445617459584:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518684.608969:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518684.608995:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78742f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe106 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.609122:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787436 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.609139:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787436 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.609153:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787436 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518684.609165:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:1.0:1789518684.609348:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78742f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe106 expref: 64 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.609371:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787436 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe106 expref: 63 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.609380:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:1.0:1789518684.609383:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518684.609389:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381a00, rc 0) 00000100:00100000:1.0:1789518684.609481:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:39753:x1876445617459584:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 562us (1375us total) trans 30064771473 rc 0/0 00000100:00100000:1.0:1789518684.609489:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 465 00000100:00100000:3.0:1789518684.612727:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518684.612779:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.613055:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617459712 00000100:00100000:1.0:1789518684.613067:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617459712 00000100:00100000:1.0:1789518684.613146:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1789518684.613174:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:2343:x1876445617459712:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518684.613192:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518684.613222:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787436 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe106 expref: 63 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.613244:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:1.0:1789518684.613249:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518684.613348:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:2343:x1876445617459712:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 176us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518684.613355:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1789518684.613692:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617459968 00000100:00100000:2.0:1789518684.613698:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617459968 00000100:00100000:2.0:1789518684.613776:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 466 00000100:00100000:2.0:1789518684.613784:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:39753:x1876445617459968:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518684.613808:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518684.613827:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787444 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe10d expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.613940:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78744b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.613956:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78744b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.613969:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78744b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518684.613984:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:2.0:1789518684.614138:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787444 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe10d expref: 65 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.614155:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78744b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe10d expref: 64 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.614164:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:2.0:1789518684.614167:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518684.614170:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901e00, rc 0) 00000100:00100000:2.0:1789518684.614249:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:39753:x1876445617459968:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 465us (1469us total) trans 30064771474 rc 0/0 00000100:00100000:2.0:1789518684.614257:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 466 00000100:00100000:3.0:1789518684.617246:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.617393:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617460096 00000100:00100000:2.0:1789518684.617407:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617460096 00000100:00100000:2.0:1789518684.618301:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:2.0:1789518684.618315:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617460096:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:2.0:1789518684.618387:0:36533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.618412:0:36533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 11 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.618423:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518684.618429:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518684.618434:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.618481:0:36533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 11 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.618497:0:36533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 11 pid: 36532 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518684.618515:0:36533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:36533:1876445627671680:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518684.618655:0:36533:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd138fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789518684.621297:0:36533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:36533:1876445627671680:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518684.621337:0:36533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518684.621801:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.621904:0:38854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617460224 00000100:00100000:2.0:1789518684.621914:0:38854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617460224 00002000:00100000:2.0:1789518684.621963:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcd:0x0] (0->4) req@ffff99ffd1008e00 x1876445617460224/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:330/0 lens 496/0 e 0 to 0 dl 1789518695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518684.621970:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1008e00 with x1876445617460224 ext(0->4) 00010000:00010000:2.0:1789518684.621977:0:38854:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 12 pid: 36532 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.621988:0:38854:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 12 pid: 36532 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518684.621994:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffd1008e00 00000100:00100000:2.0:1789518684.622022:0:38854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1789518684.622029:0:38854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617460224:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:2.0:1789518684.623191:0:38854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617460224:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 1154us (1385us total) trans 30064771211 rc 0/0 00000100:00100000:2.0:1789518684.623204:0:38854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00002000:00100000:2.0:1789518684.623215:0:38854:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcd:0x0] (0->4) req@ffff99ffd1008e00 x1876445617460224/t30064771211(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:330/0 lens 496/448 e 0 to 0 dl 1789518695 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789518684.623225:0:38854:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffd1008e00 with x1876445617460224 ext(0->4) 00010000:00010000:2.0:1789518684.623234:0:38854:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 14 pid: 36532 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.623251:0:38854:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 14 pid: 36532 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518684.623260:0:38854:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99ffd1008e00 00000100:00100000:3.0:1789518684.625833:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518684.626771:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617460352 00000100:00100000:0.0:1789518684.626786:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617460352 00010000:00010000:0.0:1789518684.627922:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 14 pid: 36532 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518684.627994:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:0.0:1789518684.628011:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2344:x1876445617460352:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518684.628031:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789518684.628056:0:35830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1789518684.628060:0:35830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb mtime from disk: 0 -> 1789518685 00002000:00010000:0.0:1789518684.628063:0:35830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb atime from disk: 0 -> 1789518685 00002000:00010000:0.0:1789518684.628065:0:35830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb ctime from disk: 0 -> 1789518685 00010000:00010000:0.0:1789518684.628073:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 14 pid: 36532 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.628089:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 14 pid: 36532 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.628118:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049747750/0x631fd8698c78741a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0f8 expref: 14 pid: 36532 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.628137:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518684.628143:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518684.628151:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.628162:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.628199:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518684.628250:0:36533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.628261:0:36533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.628298:0:36533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518684.628299:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2344:x1876445617460352:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 295us (2477us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518684.628308:0:36533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518684.628308:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00010000:00010000:2.0:1789518684.628317:0:36533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.628325:0:36533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518684.628329:0:36533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.628340:0:36533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.628353:0:36533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.628361:0:36533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdfe27ac/0x631fd8698c787459 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518684.628426:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617460096:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 10114us (11190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518684.628435:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:0.0:1789518684.630426:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.630864:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617460608 00000100:00100000:1.0:1789518684.630888:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617460608 00000100:00100000:1.0:1789518684.630952:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:1.0:1789518684.630963:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:39753:x1876445617460608:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:1.0:1789518684.631041:0:35849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x2e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78744b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe10d expref: 64 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518684.631367:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771475 00000001:00080000:1.0:1789518684.631413:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771476 00000001:00080000:1.0:1789518684.633026:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771477 00010000:00010000:1.0:1789518684.633113:0:35849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.633137:0:35849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ea expref: 68 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.633149:0:35849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.633203:0:35849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ea expref: 68 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.633224:0:35849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ea expref: 68 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.633241:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25cca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35849:1876445627671808:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518684.634324:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789518684.639584:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25cca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35849:1876445627671808:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518684.639665:0:35849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518684.640264:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.640507:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617460736 00000100:00100000:1.0:1789518684.640517:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617460736 00010000:00010000:1.0:1789518684.640565:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ea expref: 69 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.640644:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:1.0:1789518684.640656:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:2342:x1876445617460736:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518684.640676:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518684.640685:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ea expref: 69 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.640699:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ea expref: 69 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.640752:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787405 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ea expref: 69 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.640773:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:1.0:1789518684.640779:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.640791:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.640799:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.640847:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518684.640983:0:35849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.640992:0:35849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518684.641160:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771478 00000001:00080000:2.0:1789518684.641421:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771479 00000100:00100000:2.0:1789518684.641551:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627671936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789518684.643281:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:2342:x1876445617460736:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2613us (3005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518684.643307:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1789518684.643386:0:35849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518684.643437:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627671936 00000100:00100000:2.0:1789518684.643446:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd807aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789518684.643448:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627671936 00000100:00080000:3.0:1789518684.643495:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518684.643516:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789518684.643525:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35849:x1876445627671936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789518684.643671:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35849:x1876445627671936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 146us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518684.643678:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789518684.643764:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627671936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518684.644512:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771480 00000100:00100000:2.0:1789518684.644956:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627672064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518684.645006:0:35849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518684.645037:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd807a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789518684.645165:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627672064 00000100:00100000:3.0:1789518684.645173:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627672064 00000100:00100000:3.0:1789518684.645221:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789518684.645239:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35849:x1876445627672064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789518684.645421:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35849:x1876445627672064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 184us (414us total) trans 30064771212 rc 0/0 00000100:00100000:3.0:1789518684.645430:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789518684.645492:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627672064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789518684.645571:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771481 00010000:00010000:1.0:1789518684.645651:0:35849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.645673:0:35849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.645680:0:35849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.645684:0:35849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518684.645688:0:35849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.645694:0:35849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.645709:0:35849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:1.0:1789518684.645712:0:35849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789518684.645716:0:35849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.645720:0:35849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787460 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789518684.646018:0:35849:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x2f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789518684.646191:0:35849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].17, 64 off9496 00000004:00080000:1.0:1789518684.646205:0:35849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 738642590221ns, next at 739642587717ns, rc = 0 00000001:00080000:1.0:1789518684.646212:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771482 00010000:00010000:1.0:1789518684.646268:0:35849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99ffc6733900) 00010000:00010000:1.0:1789518684.646271:0:35849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518684.646279:0:35849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78744b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe10d expref: 72 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.646442:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+71:39753:x1876445617460608:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 15481us (16027us total) trans 30064771483 rc 0/0 00000100:00100000:1.0:1789518684.646451:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000020:00080000:1.0:1789518684.646457:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789518684.649890:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.650151:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617460864 00000100:00100000:2.0:1789518684.650161:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617460864 00000100:00100000:2.0:1789518684.650226:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 467 00000100:00100000:2.0:1789518684.650235:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+71:39753:x1876445617460864:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518684.650260:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518684.650282:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c787467 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe114 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.650353:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c787467 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe114 expref: 72 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.650368:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c787467 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe114 expref: 72 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.650388:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905a00) 00010000:00010000:2.0:1789518684.650391:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518684.650395:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901000, rc 0) 00000100:00100000:2.0:1789518684.650457:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:39753:x1876445617460864:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 223us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518684.650464:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 467 00000100:00100000:3.0:1789518684.652982:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.653070:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617461120 00000100:00100000:2.0:1789518684.653079:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617461120 00000100:00100000:2.0:1789518684.653127:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:2.0:1789518684.653137:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:39753:x1876445617461120:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518684.653420:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:39753:x1876445617461120:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 283us (449us total) trans 30064771484 rc 0/0 00000100:00100000:2.0:1789518684.653428:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:0.0:1789518684.693030:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.693674:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617461248 00000100:00100000:1.0:1789518684.693684:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617461248 00000100:00100000:1.0:1789518684.693745:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 468 00000100:00100000:1.0:1789518684.693756:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:39763:x1876445617461248:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1789518684.693825:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.693843:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.693854:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.693869:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.693875:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.693882:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.693975:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694002:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694010:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518684.694053:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694065:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694072:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694079:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694085:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518684.694090:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694097:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694108:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:1.0:1789518684.694111:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518684.694116:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694121:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78746e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694154:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694162:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694168:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694174:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518684.694177:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694183:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694190:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff99ffc6733900) 00010000:00010000:1.0:1789518684.694193:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518684.694196:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694201:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787475 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694215:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694220:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694226:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694237:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518684.694240:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694246:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694254:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905a00) 00010000:00010000:1.0:1789518684.694256:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518684.694272:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.694279:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c78747c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.694376:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:39763:x1876445617461248:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 621us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518684.694385:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 468 00000100:00100000:0.0:1789518684.734884:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.740718:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617461504 00000100:00100000:2.0:1789518684.740731:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617461504 00000100:00100000:2.0:1789518684.740862:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 469 00000100:00100000:2.0:1789518684.740871:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:39770:x1876445617461504:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1789518684.740890:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518684.740908:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787483 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe11b expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.740973:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.740986:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.740997:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741011:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741023:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741030:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741141:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741150:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741157:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518684.741166:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:2.0:1789518684.741258:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741266:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741274:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741280:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518684.741293:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741301:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741317:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:2.0:1789518684.741320:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518684.741325:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741331:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c78748a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741343:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741350:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741355:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741361:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518684.741363:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741369:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741376:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff99fff6905c00) 00010000:00010000:2.0:1789518684.741378:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518684.741381:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741387:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787491 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741427:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787483 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe11b expref: 76 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741440:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe11b expref: 75 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.741446:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905a00) 00010000:00010000:2.0:1789518684.741448:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518684.741451:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901400, rc 0) 00000100:00100000:2.0:1789518684.741524:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:39770:x1876445617461504:12345-192.168.206.51@tcp:101:cat.0 Request processed in 653us (6647us total) trans 30064771485 rc 0/0 00000100:00100000:2.0:1789518684.741595:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 469 00000100:00100000:3.0:1789518684.744111:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.744193:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617461760 00000100:00100000:1.0:1789518684.744202:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617461760 00000100:00100000:1.0:1789518684.744255:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:1.0:1789518684.744264:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:39770:x1876445617461760:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:1.0:1789518684.744489:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:39770:x1876445617461760:12345-192.168.206.51@tcp:35:cat.0 Request processed in 225us (386us total) trans 30064771486 rc 0/0 00000100:00100000:1.0:1789518684.744497:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 112 00000100:00100000:3.0:1789518684.792381:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518684.792416:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617462016 00000100:00100000:3.0:1789518684.792426:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617462016 00000100:00100000:3.0:1789518684.792473:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 470 00000100:00100000:3.0:1789518684.792483:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:39776:x1876445617462016:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518684.792508:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518684.792526:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7874a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe122 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.792641:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.792655:0:35846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe11b expref: 77 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.792665:0:35846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.792693:0:35846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe11b expref: 77 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.792706:0:35846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe11b expref: 77 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518684.792728:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627672192:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518684.792805:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbbf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518684.796994:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518684.797021:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617462144 00000100:00100000:0.0:1789518684.797029:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617462144 00010000:00010000:0.0:1789518684.797058:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe11b expref: 78 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518684.797088:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:0.0:1789518684.797096:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:2343:x1876445617462144:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518684.797107:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518684.797113:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe11b expref: 78 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.797125:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe11b expref: 78 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.797145:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905a00) 00010000:00010000:0.0:1789518684.797151:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.797161:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.797169:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.797188:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518684.797233:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:2343:x1876445617462144:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 137us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518684.797240:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00010000:00010000:3.0:1789518684.797563:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787498 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe11b expref: 77 pid: 37723 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518684.797579:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627672192:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518684.797597:0:35846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.797606:0:35846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.797640:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518684.797657:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:3.0:1789518684.797811:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7874a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe122 expref: 78 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.797827:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe122 expref: 77 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.797846:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905a00) 00010000:00010000:3.0:1789518684.797849:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518684.797852:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14d800, rc 0) 00000100:00100000:3.0:1789518684.797883:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:39776:x1876445617462016:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 5402us (5513us total) trans 30064771487 rc 0/0 00000100:00100000:3.0:1789518684.797897:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 470 00000100:00100000:1.0:1789518684.813069:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.813103:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617462272 00000100:00100000:1.0:1789518684.813112:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617462272 00000100:00100000:1.0:1789518684.813174:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 471 00000100:00100000:1.0:1789518684.813183:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:39777:x1876445617462272:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1789518684.813205:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518684.813224:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7874bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe129 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.813541:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.813556:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.813568:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.813582:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.813589:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.813595:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.813990:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.814002:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe122 expref: 78 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.814011:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.814048:0:35847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe122 expref: 78 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.814063:0:35847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe122 expref: 78 pid: 35846 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.814078:0:35847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627672320:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518684.815023:0:35847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1eb3c00 going to sleep for 11 seconds 00000001:00080000:1.0:1789518684.815577:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771470 is committed 00000001:00080000:1.0:1789518684.815595:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771486 is committed 00000004:00080000:1.0:1789518684.815601:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000020:00080000:1.0:1789518684.815653:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffd807aa80 refcount 2 committed 0 result 0 batchid 25769803905 00000020:00080000:1.0:1789518684.815658:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeec0fe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd807a000 00000020:00080000:1.0:1789518684.815661:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeec0f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec87d9800 00000020:00080000:1.0:1789518684.816022:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803905 committed batchid 25769803904 00000100:00100000:2.0:1789518684.816052:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627672448:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1789518684.816305:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000100:00100000:2.0:1789518684.816333:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518684.816409:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627672448 00000100:00100000:1.0:1789518684.816416:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627672448 00000100:00100000:1.0:1789518684.816455:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789518684.816463:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627672448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789518684.816491:0:37973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:205 count 1 00002000:00010000:1.0:1789518684.816519:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcd:0x0] initial LVB size: 5, mtime: 0x6aa9e35d, atime: 0x6aa9e35d, ctime: 0x6aa9e35d, blocks: 0xb 00010000:00010000:1.0:1789518684.816526:0:37973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.816553:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=738s v=(0 0) 00010000:00010000:1.0:1789518684.816558:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518684.816563:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.816577:0:37973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.816588:0:37973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.816596:0:37973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518684.817512:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.817986:0:35847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35847:1876445627672320:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518684.818007:0:35847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.818104:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518684.818108:0:37973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789518684.818111:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.818120:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518684.818123:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.818132:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.818150:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.818157:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014d88232/0x631fd8698c7874d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.818178:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518684.818179:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518684.818181:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518684.818750:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3281:x1876445627672448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2286us (2653us total) trans 30064771213 rc 0/0 00000100:00100000:1.0:1789518684.818759:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789518684.818790:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617462528 00000100:00100000:1.0:1789518684.818795:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617462528 00000100:00100000:1.0:1789518684.818832:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000004:00080000:2.0:1789518684.818934:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec25cce00/2, rc 0, transno 30064771213 00000100:00100000:2.0:1789518684.818941:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627672448:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789518684.818985:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdb026050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:31050:x1876445617462528:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789518684.819212:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdb026050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:31050:x1876445617462528:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 230us (1703us total) trans 30064771488 rc 0/0 00000100:00100000:3.0:1789518684.821746:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.821859:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617462656 00000100:00100000:2.0:1789518684.821868:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617462656 00010000:00010000:2.0:1789518684.821906:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe122 expref: 58 pid: 35846 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518684.821936:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:2.0:1789518684.821946:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2343:x1876445617462656:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518684.821959:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518684.821966:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe122 expref: 58 pid: 35846 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.821979:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe122 expref: 58 pid: 35846 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.822184:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c7874ad lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe122 expref: 58 pid: 35846 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.822265:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905a00) 00010000:00010000:2.0:1789518684.822272:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.822292:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.822300:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.822374:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518684.822427:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2343:x1876445617462656:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 482us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518684.822434:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00010000:00010000:3.0:1789518684.822481:0:35847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.822490:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518684.822530:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00000004:00200000:3.0:1789518684.822534:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518684.822554:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.822566:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.822574:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.822581:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.822588:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.822594:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518684.822598:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.822605:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00010000:00010000:3.0:1789518684.822608:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825588:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:3.0:1789518684.825591:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518684.825603:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825638:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7874c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825739:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825749:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825757:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825763:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518684.825767:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825774:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825784:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff99ffc6733900) 00010000:00010000:3.0:1789518684.825787:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518684.825791:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825797:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7874c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825919:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7874bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe129 expref: 56 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825939:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe129 expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.825945:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905a00) 00010000:00010000:3.0:1789518684.825947:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518684.825949:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380200, rc 0) 00000100:00100000:3.0:1789518684.826136:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:39777:x1876445617462272:12345-192.168.206.51@tcp:101:rm.0 Request processed in 12953us (13074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518684.826145:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 471 00000001:00080000:2.0:1789518684.829806:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771211 is committed 00000001:00080000:2.0:1789518684.829826:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771212 is committed 00000100:00100000:3.0:1789518684.832480:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.832579:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617462912 00000100:00100000:2.0:1789518684.832589:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617462912 00000100:00100000:2.0:1789518684.832682:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 472 00000100:00100000:2.0:1789518684.832693:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:39777:x1876445617462912:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:2.0:1789518684.832747:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789518684.832772:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7874d0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe129 expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.832794:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c787467 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe114 expref: 54 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.832805:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905a00) 00010000:00010000:2.0:1789518684.832819:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787428 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe0ff expref: 53 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.832828:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:2.0:1789518684.832834:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518684.832856:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.832868:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.832878:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.833010:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.833019:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.833031:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.833327:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.833337:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.833344:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835337:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835364:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835376:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835384:0:37723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835390:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835396:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835423:0:37723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789518684.835444:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835451:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835458:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835463:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518684.835467:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835475:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.835571:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518684.835577:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835664:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:2.0:1789518684.835668:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789518684.835674:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835680:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901200/0x631fd8698c7874ec lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835700:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835706:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835712:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835718:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518684.835721:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835727:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835735:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905d00) 00010000:00010000:2.0:1789518684.835737:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518684.835740:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.835747:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c7874de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518684.835762:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001acaec01 reply state 00000000266207e0 transno 30064771489 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518684.835771:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789518684.835859:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:39777:x1876445617462912:12345-192.168.206.51@tcp:36:rm.0 Request processed in 3164us (3383us total) trans 30064771489 rc 0/0 00000100:00100000:2.0:1789518684.835868:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 472 00010000:00010000:3.0:1789518684.836105:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901600 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518684.836110:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.836117:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.836125:0:36743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:3.0:1789518684.836127:0:36743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518684.836130:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.836148:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c7874f3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.836161:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518684.836162:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518684.836164:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518684.840348:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.840946:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.840956:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.840963:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518684.840969:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.840977:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.840992:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff99fff6905200) 00010000:00010000:0.0:1789518684.840995:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518684.841000:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518684.841007:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7874e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518684.868360:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518684.868570:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617463040 00000100:00100000:3.0:1789518684.868580:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617463040 00000100:00100000:3.0:1789518684.868676:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 473 00000100:00100000:3.0:1789518684.868686:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:39783:x1876445617463040:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518684.868714:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518684.868736:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7874fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe130 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.868792:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787501 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.868804:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.868815:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518684.869009:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789518684.869014:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518684.869033:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.869056:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7874fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe130 expref: 55 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.869085:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787501 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe130 expref: 54 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.869092:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:3.0:1789518684.869095:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518684.869098:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c200, rc 0) 00000100:00100000:3.0:1789518684.869195:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:39783:x1876445617463040:12345-192.168.206.51@tcp:101:bash.0 Request processed in 510us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518684.869202:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 473 00000100:00100000:1.0:1789518684.872982:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518684.873063:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617463296 00000100:00100000:3.0:1789518684.873072:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617463296 00000100:00100000:3.0:1789518684.873142:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 474 00000100:00100000:3.0:1789518684.873151:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:39783:x1876445617463296:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518684.873170:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518684.873178:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518684.873210:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787501 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe130 expref: 54 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.873230:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:3.0:1789518684.873239:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518684.873252:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787508 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe137 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.873378:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.873407:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.873417:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.873431:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.873438:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.873444:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518684.874049:0:35847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcd:0x0], index 1: 0 00010000:00010000:3.0:1789518684.874160:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c78751d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874167:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c78751d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874172:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c78751d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874192:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874196:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874201:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874214:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518684.874218:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874226:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874235:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdc200) 00010000:00010000:3.0:1789518684.874238:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518684.874242:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874248:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c78750f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518684.874259:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de4bb3ec reply state 0000000048327186 transno 30064771490 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518684.874268:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789518684.874303:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787508 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe137 expref: 56 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874319:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c78751d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe137 expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518684.874326:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518684.874328:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518684.874330:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c000, rc 0) 00000100:00100000:3.0:1789518684.874393:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:39783:x1876445617463296:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1242us (1418us total) trans 30064771490 rc 0/0 00000100:00100000:3.0:1789518684.874405:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 474 00010000:00010000:2.0:1789518684.876254:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.876268:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.876274:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.876280:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14ce00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518684.876839:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.876850:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.876864:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff99ffc2fdcb00) 00010000:00010000:2.0:1789518684.876867:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518684.876873:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.876879:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787516 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.877026:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.877081:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617463424 00000100:00100000:2.0:1789518684.877089:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617463424 00000100:00100000:2.0:1789518684.877135:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:2.0:1789518684.877144:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617463424:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518684.877158:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518684.877174:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe13e expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518684.877202:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518684.877221:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=738s v=(0 0) 00010000:00010000:2.0:1789518684.877226:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518684.877235:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe13e expref: 14 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.877249:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe13e expref: 14 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.877265:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901a00, rc 0) 00000100:00100000:2.0:1789518684.877370:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617463424:12345-192.168.206.51@tcp:101:bash.0 Request processed in 226us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518684.877377:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:0.0:1789518684.879028:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.879273:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617463552 00000100:00100000:2.0:1789518684.879280:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617463552 00000100:00100000:2.0:1789518684.879374:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:2.0:1789518684.879383:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:39783:x1876445617463552:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518684.879395:0:36533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518684.879409:0:36533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe145 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.879437:0:36533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe13e expref: 15 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.879446:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518684.879450:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518684.879455:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 15 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.879483:0:36533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe13e expref: 15 pid: 36532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.879495:0:36533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe13e expref: 15 pid: 36532 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518684.879508:0:36533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff738b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627672576:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518684.879590:0:36533:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789518684.883304:0:36533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff738b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627672576:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518684.883342:0:36533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 15 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.883361:0:36533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901200, rc 0) 00000100:00100000:2.0:1789518684.883424:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:39783:x1876445617463552:12345-192.168.206.51@tcp:101:bash.0 Request processed in 4041us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518684.883432:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:0.0:1789518684.883544:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518684.883932:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617463680 00000100:00100000:1.0:1789518684.883939:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617463680 00010000:00010000:1.0:1789518684.883970:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe13e expref: 15 pid: 36532 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.884001:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518684.884011:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617463680:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518684.884023:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518684.884043:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe13e expref: 15 pid: 36532 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.884056:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe13e expref: 15 pid: 36532 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.884077:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002baa2023/0x631fd8698c78752b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe13e expref: 15 pid: 36532 timeout: 838 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.884090:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518684.884094:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518684.884101:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 14 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.884111:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 14 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518684.884160:0:35831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 14 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518684.884174:0:35831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627672704:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518684.884239:0:35831:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1eb39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518684.886153:0:35831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627672704:192.168.206.51@tcp:105: 00010000:00010000:1.0:1789518684.886172:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518684.886214:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617463680:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2205us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518684.886223:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:2.0:1789518684.888418:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518684.888521:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617463936 00000100:00100000:0.0:1789518684.888539:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617463936 00000100:00100000:0.0:1789518684.888589:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1789518684.888598:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:39783:x1876445617463936:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:0.0:1789518684.888962:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:39783:x1876445617463936:12345-192.168.206.51@tcp:35:bash.0 Request processed in 364us (549us total) trans 30064771491 rc 0/0 00000100:00100000:0.0:1789518684.888969:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:3.0:1789518684.920656:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518684.924893:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617464064 00000100:00100000:2.0:1789518684.924906:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617464064 00000100:00100000:2.0:1789518684.924958:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 475 00000100:00100000:2.0:1789518684.924968:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:39786:x1876445617464064:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518684.924990:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518684.925012:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe14c expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.925069:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787540 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.925082:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.925096:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518684.925126:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518684.925130:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518684.925144:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.925164:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe14c expref: 58 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.925180:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe14c expref: 57 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518684.925187:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905b00) 00010000:00010000:2.0:1789518684.925190:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518684.925193:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901c00, rc 0) 00000100:00100000:2.0:1789518684.925260:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:39786:x1876445617464064:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 293us (4647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518684.925267:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 475 00010000:00010000:3.0:1789518685.043133:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518685.073024:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518685.073277:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617464320 00000100:00100000:0.0:1789518685.073399:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617464320 00000100:00100000:0.0:1789518685.073557:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 476 00000100:00100000:0.0:1789518685.073570:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:39815:x1876445617464320:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518685.073595:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518685.073650:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe153 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.073774:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c78754e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.073790:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c78754e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.073804:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c78754e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518685.073816:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x30:0x0]: returning size 13 00010000:00010000:0.0:1789518685.073977:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe153 expref: 60 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.073997:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c78754e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe153 expref: 59 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.074009:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:0.0:1789518685.074012:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518685.074017:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23c00, rc 0) 00000100:00100000:0.0:1789518685.074188:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:39815:x1876445617464320:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 620us (1174us total) trans 30064771492 rc 0/0 00000100:00100000:0.0:1789518685.074195:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 476 00000100:00080000:3.0:1789518685.074206:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518685.076273:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518685.076390:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617464576 00000100:00100000:3.0:1789518685.076401:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617464576 00000100:00100000:3.0:1789518685.076480:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 477 00000100:00100000:3.0:1789518685.076491:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:39815:x1876445617464576:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518685.076518:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518685.076638:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c78755c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe15a expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518685.076712:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518685.076764:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787563 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.076781:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787563 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.076838:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787563 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518685.076854:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x30:0x0]: returning size 13 00000100:00100000:1.0:1789518685.076897:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617464704 00000100:00100000:1.0:1789518685.076902:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617464704 00000100:00100000:1.0:1789518685.076974:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518685.076982:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:2342:x1876445617464704:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518685.076993:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518685.077005:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c78755c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe15a expref: 63 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.077013:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c78754e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe153 expref: 63 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.077024:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787563 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe15a expref: 61 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.077024:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:1.0:1789518685.077029:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518685.077052:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:3.0:1789518685.077055:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518685.077057:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c600, rc 0) 00000100:00100000:3.0:1789518685.077095:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:39815:x1876445617464576:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 606us (832us total) trans 30064771493 rc 0/0 00000100:00100000:3.0:1789518685.077103:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 477 00000100:00100000:1.0:1789518685.077154:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:2342:x1876445617464704:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 173us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518685.077161:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1789518685.079142:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518685.079306:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617464832 00000100:00100000:0.0:1789518685.079317:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617464832 00000100:00100000:0.0:1789518685.079431:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1789518685.079444:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:39815:x1876445617464832:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:0.0:1789518685.079461:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518685.079487:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787563 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe15a expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.079519:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:0.0:1789518685.079525:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518685.079590:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:39815:x1876445617464832:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 149us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518685.079598:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1789518685.081440:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518685.081584:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617465088 00000100:00100000:0.0:1789518685.081594:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617465088 00000100:00100000:0.0:1789518685.081934:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:0.0:1789518685.081948:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:39815:x1876445617465088:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518685.082231:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:39815:x1876445617465088:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 286us (812us total) trans 30064771494 rc 0/0 00000100:00100000:0.0:1789518685.082241:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:1.0:1789518685.085335:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518685.085586:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617465344 00000100:00100000:2.0:1789518685.085598:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617465344 00000100:00100000:2.0:1789518685.085688:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:2.0:1789518685.085701:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:39815:x1876445617465344:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518685.086360:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:39815:x1876445617465344:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 659us (1035us total) trans 30064771495 rc 0/0 00000100:00100000:2.0:1789518685.086374:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 116 00000100:00100000:2.0:1789518685.128866:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518685.128982:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617465600 00000100:00100000:0.0:1789518685.128995:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617465600 00000100:00100000:0.0:1789518685.129066:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 478 00000100:00100000:0.0:1789518685.129079:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:39822:x1876445617465600:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1789518685.129467:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518685.129502:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c78751d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe137 expref: 61 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129525:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff99ffc2fdce00) 00010000:00010000:0.0:1789518685.129544:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787540 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe14c expref: 60 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129553:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905b00) 00010000:00010000:0.0:1789518685.129561:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518685.129590:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129720:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129734:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129752:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129759:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129766:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129889:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129898:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.129905:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518685.130989:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].17, 64 off9568 00000004:00080000:0.0:1789518685.131004:0:39157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 739127389335ns, next at 740127386174ns, rc = 0 00010000:00010000:0.0:1789518685.131076:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131146:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131158:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131167:0:39157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131175:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131182:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131219:0:39157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518685.131247:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131255:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131263:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131271:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518685.131276:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131296:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131309:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518685.131313:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518685.131318:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131326:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78757f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.131327:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518685.131339:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131351:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.131364:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518685.131366:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.131370:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131390:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.131396:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131398:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518685.131404:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.131414:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:0.0:1789518685.131415:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.131420:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518685.131426:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131429:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518685.131435:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518685.131439:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787586 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131440:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.131457:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787571 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518685.131474:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018477566 reply state 000000001b2efef8 transno 30064771496 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518685.131478:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518685.131482:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518685.131486:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518685.131487:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518685.131591:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:39822:x1876445617465600:12345-192.168.206.51@tcp:36:rm.0 Request processed in 2511us (2735us total) trans 30064771496 rc 0/0 00000100:00100000:0.0:1789518685.131600:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 478 00010000:00010000:0.0:1789518685.134332:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.134357:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.134372:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.134378:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518685.134384:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.134394:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.134414:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518685.134418:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518685.134423:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.134430:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787578 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518685.159217:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518685.159382:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617465728 00000100:00100000:1.0:1789518685.159395:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617465728 00000100:00100000:1.0:1789518685.159468:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 479 00000100:00100000:1.0:1789518685.159480:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:39828:x1876445617465728:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518685.159510:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518685.159538:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78758d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe161 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.159648:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787594 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.159664:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.159677:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518685.159721:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518685.159726:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518685.159749:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.159776:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78758d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe161 expref: 62 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.159796:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe161 expref: 61 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.159826:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:1.0:1789518685.159829:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518685.159833:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381c00, rc 0) 00000100:00100000:1.0:1789518685.159972:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:39828:x1876445617465728:12345-192.168.206.51@tcp:101:bash.0 Request processed in 493us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518685.159980:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 479 00000100:00100000:3.0:1789518685.163233:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518685.164072:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617465984 00000100:00100000:2.0:1789518685.164085:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617465984 00000100:00100000:2.0:1789518685.164162:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 480 00000100:00100000:2.0:1789518685.164174:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:39828:x1876445617465984:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518685.164200:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518685.164204:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518685.164238:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787594 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe161 expref: 61 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.164262:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:2.0:1789518685.164275:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518685.164305:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c78759b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe168 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.164450:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.164466:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.164478:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.164505:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.164518:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.164525:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518685.165166:0:35847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xce:0x0], index 0: 0 00010000:00010000:2.0:1789518685.165359:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7875b0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165371:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7875b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165378:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7875b0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165416:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165425:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165431:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165437:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518685.165442:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165450:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165464:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905400) 00010000:00010000:2.0:1789518685.165467:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518685.165471:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165477:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c7875a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518685.165489:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc83aa7e reply state 00000000037b1681 transno 30064771497 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518685.165500:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789518685.165533:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c78759b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe168 expref: 63 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165552:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7875b0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe168 expref: 62 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.165561:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff99fff6905b00) 00010000:00010000:2.0:1789518685.165563:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518685.165566:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900800, rc 0) 00000100:00100000:2.0:1789518685.165691:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:39828:x1876445617465984:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1518us (2471us total) trans 30064771497 rc 0/0 00000100:00100000:2.0:1789518685.165700:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 480 00010000:00010000:2.0:1789518685.168813:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.168833:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.168841:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.168848:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518685.168853:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.168861:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.168879:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff99fff6905300) 00010000:00010000:2.0:1789518685.168883:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518685.168888:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.168894:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875a9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518685.170316:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518685.170722:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617466112 00000100:00100000:1.0:1789518685.170736:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617466112 00000100:00100000:1.0:1789518685.170877:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:1.0:1789518685.170891:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617466112:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1789518685.170915:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518685.170941:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 2/0,0 mode: --/PR res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe16f expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518685.170978:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789518685.171006:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789518685.171012:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518685.171023:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe16f expref: 11 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.171048:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe16f expref: 11 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789518685.171054:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789518685.171065:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381a00, rc 0) 00000100:00100000:1.0:1789518685.171258:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2345:x1876445617466112:12345-192.168.206.51@tcp:101:bash.0 Request processed in 369us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518685.171414:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:0.0:1789518685.176041:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518685.176239:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617466240 00000100:00100000:2.0:1789518685.176252:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617466240 00000100:00100000:2.0:1789518685.176340:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:2.0:1789518685.176351:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:39828:x1876445617466240:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518685.176375:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518685.176400:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe176 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.176449:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe16f expref: 12 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.176466:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518685.176471:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518685.176477:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 12 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.176529:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe16f expref: 12 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.176545:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe16f expref: 12 pid: 37973 timeout: 839 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518685.176561:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7389180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627672832:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518685.176718:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518685.179242:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7389180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627672832:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518685.179299:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 12 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.179324:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901800, rc 0) 00000100:00100000:0.0:1789518685.179401:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:39828:x1876445617466240:12345-192.168.206.51@tcp:101:bash.0 Request processed in 3051us (3373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518685.179411:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:3.0:1789518685.180215:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518685.180331:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617466368 00000100:00100000:1.0:1789518685.180341:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617466368 00010000:00010000:1.0:1789518685.180378:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe16f expref: 12 pid: 37973 timeout: 839 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518685.180419:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:1.0:1789518685.180428:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617466368:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518685.180444:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518685.180466:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe16f expref: 12 pid: 37973 timeout: 839 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.180480:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe16f expref: 12 pid: 37973 timeout: 839 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.180504:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000345aaf53/0x631fd8698c7875be lrc: 0/0,0 mode: --/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe16f expref: 12 pid: 37973 timeout: 839 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.180521:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518685.180525:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518685.180533:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 11 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.180544:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 11 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518685.181057:0:35832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 11 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518685.181073:0:35832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:35832:1876445627672960:192.168.206.51@tcp:105: 00000100:00100000:1.0:1789518685.181153:0:35832:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec1eb39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518685.184230:0:35832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:35832:1876445627672960:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518685.184266:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518685.184361:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617466368:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3932us (4153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518685.184374:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 82 00000100:00100000:3.0:1789518685.184481:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518685.184838:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617466624 00000100:00100000:0.0:1789518685.184847:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617466624 00000100:00100000:0.0:1789518685.184895:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:0.0:1789518685.184902:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:39828:x1876445617466624:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:0.0:1789518685.185537:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:39828:x1876445617466624:12345-192.168.206.51@tcp:35:bash.0 Request processed in 631us (1061us total) trans 30064771498 rc 0/0 00000100:00100000:0.0:1789518685.185558:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1789518685.205448:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518685.205553:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617466752 00000100:00100000:0.0:1789518685.205562:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617466752 00000100:00100000:0.0:1789518685.205654:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 481 00000100:00100000:0.0:1789518685.205668:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:39831:x1876445617466752:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518685.205691:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518685.205712:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c7875cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe17d expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.205780:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7875d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.205793:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7875d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.205806:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7875d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518685.205837:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518685.205841:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518685.205857:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7875d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.205879:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c7875cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe17d expref: 65 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.205897:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7875d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe17d expref: 64 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.205906:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518685.205909:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518685.205913:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22800, rc 0) 00000100:00100000:0.0:1789518685.206238:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:39831:x1876445617466752:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 574us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518685.206246:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 481 00000100:00100000:1.0:1789518685.307372:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518685.307533:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617467008 00000100:00100000:2.0:1789518685.307543:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617467008 00000100:00100000:2.0:1789518685.307607:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 482 00000100:00100000:2.0:1789518685.307648:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:39853:x1876445617467008:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518685.307668:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518685.307687:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe184 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.307789:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c7875e1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.307803:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c7875e1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.307816:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c7875e1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518685.307827:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x31:0x0]: returning size 20 00010000:00010000:2.0:1789518685.307947:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe184 expref: 67 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.307966:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c7875e1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe184 expref: 66 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.307974:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff99fff6905b00) 00010000:00010000:2.0:1789518685.307977:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518685.307980:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901000, rc 0) 00000100:00100000:2.0:1789518685.308044:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:39853:x1876445617467008:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 399us (681us total) trans 30064771499 rc 0/0 00000100:00100000:2.0:1789518685.308052:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 482 00000100:00100000:1.0:1789518685.313782:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518685.313889:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518685.313977:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617467136 00000100:00100000:0.0:1789518685.313987:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617467136 00000100:00100000:0.0:1789518685.314092:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:2.0:1789518685.314106:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617467392 00000100:00100000:2.0:1789518685.314112:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617467392 00000100:00100000:0.0:1789518685.314243:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1080850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:2343:x1876445617467136:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518685.314260:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518685.314383:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c7875e1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe184 expref: 67 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.314401:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff99fff6905b00) 00010000:00010000:0.0:1789518685.314405:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518685.314465:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 483 00000100:00100000:2.0:1789518685.314477:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:39853:x1876445617467392:12345-192.168.206.51@tcp:101:lfs.0 00000100:00100000:0.0:1789518685.314493:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1080850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:2343:x1876445617467136:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 391us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518685.314499:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00010000:00010000:2.0:1789518685.314500:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518685.314517:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875ef lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe18b expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.314603:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7875f6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.314638:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7875f6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.314650:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7875f6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518685.314663:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x31:0x0]: returning size 20 00010000:00010000:2.0:1789518685.314775:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c7875ef lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe18b expref: 68 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.314790:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7875f6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe18b expref: 67 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.314798:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff99fff6905b00) 00010000:00010000:2.0:1789518685.314801:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789518685.314803:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900e00, rc 0) 00000100:00100000:2.0:1789518685.314829:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:39853:x1876445617467392:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 356us (940us total) trans 30064771500 rc 0/0 00000100:00100000:2.0:1789518685.314835:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 483 00000100:00100000:3.0:1789518685.323799:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518685.324531:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617467520 00000100:00100000:2.0:1789518685.324547:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617467520 00000100:00100000:2.0:1789518685.324654:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518685.324666:0:35830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789518685.324669:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:39853:x1876445617467520:12345-192.168.206.51@tcp:103:lfs.0 00000100:00100000:3.0:1789518685.324684:0:35830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789518685.324691:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518685.324723:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900e00/0x631fd8698c7875f6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe18b expref: 67 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.324741:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff99fff6905b00) 00010000:00010000:2.0:1789518685.324746:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518685.324830:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:39853:x1876445617467520:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 164us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518685.324976:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:3.0:1789518685.326433:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518685.326524:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617467776 00000100:00100000:2.0:1789518685.326534:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617467776 00000100:00100000:2.0:1789518685.326586:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:2.0:1789518685.326596:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:39853:x1876445617467776:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1789518685.326841:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:39853:x1876445617467776:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 246us (417us total) trans 30064771501 rc 0/0 00000100:00100000:2.0:1789518685.326850:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:3.0:1789518685.329141:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518685.329433:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617468032 00000100:00100000:0.0:1789518685.329449:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617468032 00000100:00100000:0.0:1789518685.329521:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:0.0:1789518685.329533:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdb025850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:39853:x1876445617468032:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518685.329868:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdb025850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:39853:x1876445617468032:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 336us (738us total) trans 30064771502 rc 0/0 00000100:00100000:0.0:1789518685.329878:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:3.0:1789518685.344847:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518685.344978:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617468288 00000100:00100000:0.0:1789518685.344991:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617468288 00000100:00100000:0.0:1789518685.345103:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 484 00000100:00100000:0.0:1789518685.345114:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:39854:x1876445617468288:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1789518685.345190:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518685.345224:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7875b0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe168 expref: 68 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345249:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff99fff6905b00) 00010000:00010000:0.0:1789518685.345269:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7875d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe17d expref: 67 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345289:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518685.345297:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518685.345327:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345341:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345352:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345365:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345373:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345379:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345499:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345507:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.345515:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518685.346277:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].18, 64 off9560 00010000:00010000:0.0:1789518685.346369:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346382:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346392:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346401:0:39157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346409:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346416:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346448:0:39157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518685.346471:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346479:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346486:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346493:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518685.346499:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346507:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346518:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518685.346521:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518685.346525:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346531:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22200/0x631fd8698c787612 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346550:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346557:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346568:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346574:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518685.346577:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346583:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346590:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518685.346592:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518685.346595:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.346601:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787604 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518685.346660:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa91dd75 reply state 0000000078384bbf transno 30064771503 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518685.346672:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518685.346781:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:39854:x1876445617468288:12345-192.168.206.51@tcp:36:rm.0 Request processed in 1665us (1945us total) trans 30064771503 rc 0/0 00000100:00100000:0.0:1789518685.346791:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 484 00010000:00010000:2.0:1789518685.346880:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789518685.346888:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.346894:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:2.0:1789518685.346898:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.346905:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.346920:0:36743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518685.346922:0:36743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789518685.346925:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.346931:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787619 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518685.346944:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518685.346946:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518685.346948:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518685.348224:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.348240:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.348252:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.348258:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518685.348263:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.348271:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.348307:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518685.348311:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518685.348315:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518685.348322:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c78760b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518686.068342:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789518686.322850:0:35868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740319234224ns, next at 741319232210ns, rc = 0 00000100:00100000:0.0:1789518686.323061:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518686.323080:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627673088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518686.323141:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518686.323230:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627673088 00000100:00100000:2.0:1789518686.323239:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627673088 00000100:00100000:2.0:1789518686.323320:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789518686.323331:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627673088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518686.323363:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518686.323415:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627673088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518686.323422:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789518686.323518:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518686.323553:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771212 gen 2 00000004:00080000:1.0:1789518686.323558:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771212 committed transno 30064771212 00000100:00100000:1.0:1789518686.323582:0:3283:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fec25cce00 x1876445627672448/t30064771213(30064771213) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518700 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789518686.323599:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627673088:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789518686.514799:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518686.514808:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518686.515471:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 5 00000040:00080000:1.0:1789518686.515479:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789518686.834785:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff738b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627673216:0@lo:400:kworker.0 00000100:00100000:2.0:1789518686.834821:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627673344:0@lo:400:kworker.0 00000100:00100000:1.0:1789518686.834867:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518686.834869:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518686.834968:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff738b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627673728:0@lo:400:kworker.0 00000100:00100000:1.0:1789518686.835004:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789518686.835004:0:35870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740831388243ns, next at 741831385284ns, rc = 0 00000100:00100000:2.0:1789518686.835008:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627673856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518686.835041:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518686.835146:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627673600:0@lo:400:kworker.0 00000100:00100000:3.0:1789518686.835181:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518686.835197:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627673216 00000100:00100000:1.0:1789518686.835205:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627673216 00000100:00100000:3.0:1789518686.835231:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627673728 00000100:00100000:3.0:1789518686.835237:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627673728 00000100:00100000:3.0:1789518686.835931:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627673600 00000100:00100000:3.0:1789518686.835937:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627673600 00000100:00100000:1.0:1789518686.835939:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789518686.835949:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518686.835955:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627673216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518686.835962:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627673472:0@lo:400:kworker.0 00000100:00100000:3.0:1789518686.835976:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789518686.835986:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627673728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518686.835998:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518686.836028:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627673216:12345-0@lo:400:kworker.0 Request processed in 77us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518686.836037:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789518686.836042:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627673728:12345-0@lo:400:kworker.0 Request processed in 57us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518686.836049:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789518686.836050:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627673344 00000100:00100000:2.0:1789518686.836056:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627673344 00000100:00100000:3.0:1789518686.836066:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627673472 00000100:00100000:3.0:1789518686.836071:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627673472 00000100:00100000:2.0:1789518686.836101:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789518686.836102:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789518686.836105:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff738b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627673728:0@lo:400:kworker.0 00000100:00100000:3.0:1789518686.836119:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627673600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518686.836119:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627673344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518686.836123:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff738b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627673216:0@lo:400:kworker.0 00000100:00100000:3.0:1789518686.836174:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627673600:12345-0@lo:400:kworker.0 Request processed in 61us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518686.836186:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627673344:12345-0@lo:400:kworker.0 Request processed in 70us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518686.836190:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789518686.836200:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789518686.836202:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789518686.836207:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627673472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789518686.836224:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518686.836229:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518686.836247:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627673856 00000100:00100000:1.0:1789518686.836253:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627673472:12345-0@lo:400:kworker.0 Request processed in 50us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518686.836254:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627673856 00000100:00100000:3.0:1789518686.836262:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627673600:0@lo:400:kworker.0 00000100:00100000:1.0:1789518686.836264:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789518686.836304:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518686.836319:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627673856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518686.836350:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518686.836393:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627673856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518686.836399:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518686.836431:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff738a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627673472:0@lo:400:kworker.0 00000100:00100000:2.0:1789518686.836452:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627673856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518686.836467:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627673344:0@lo:400:kworker.0 00010000:00010000:3.0:1789518687.091357:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518687.684764:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518687.685349:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617468416 00000100:00100000:1.0:1789518687.685359:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617468416 00000100:00100000:1.0:1789518687.685469:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 485 00000100:00100000:1.0:1789518687.685479:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:40277:x1876445617468416:12345-192.168.206.51@tcp:101:lctl.0 00010000:00010000:1.0:1789518687.685502:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518687.685523:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe192 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518687.685584:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787627 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518687.685599:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518687.685635:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518687.685684:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518687.685688:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518687.685710:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518687.685733:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe192 expref: 69 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518687.685749:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe192 expref: 68 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518687.685756:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518687.685759:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518687.685763:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380400, rc 0) 00000100:00100000:1.0:1789518687.685827:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:40277:x1876445617468416:12345-192.168.206.51@tcp:101:lctl.0 Request processed in 350us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518687.685835:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 485 00000100:00080000:3.0:1789518687.685898:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518687.732448:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518687.732563:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617468544 00000100:00100000:3.0:1789518687.732572:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617468544 00000100:00100000:1.0:1789518687.732669:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 486 00000100:00100000:1.0:1789518687.732681:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:39713:x1876445617468544:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789518687.732784:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:39713:x1876445617468544:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 105us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518687.732904:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 486 00000100:00100000:0.0:1789518687.736151:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518687.736338:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617468800 00000100:00100000:2.0:1789518687.736347:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617468800 00000100:00100000:2.0:1789518687.736417:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:2.0:1789518687.736427:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:39713:x1876445617468800:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789518687.736670:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:39713:x1876445617468800:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 244us (1065us total) trans 30064771504 rc 0/0 00000100:00100000:2.0:1789518687.736682:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00010000:00010000:2.0:1789518688.115708:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518688.142823:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518688.142879:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518688.142970:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518688.143013:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518688.143050:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518688.143072:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617469312 00000100:00100000:1.0:1789518688.143086:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617469312 00000100:00100000:2.0:1789518688.143118:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617469184 00000100:00100000:2.0:1789518688.143123:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617469184 00000100:00100000:1.0:1789518688.143167:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518688.143180:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2344:x1876445617469312:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518688.143194:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617469056 00000100:00100000:3.0:1789518688.143199:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617469056 00000100:00100000:3.0:1789518688.143237:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617469440 00000100:00100000:3.0:1789518688.143241:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617469440 00000100:00100000:3.0:1789518688.143280:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518688.143289:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:2344:x1876445617469056:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518688.143413:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617468928 00000100:00100000:0.0:1789518688.143418:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617468928 00000100:00100000:0.0:1789518688.143451:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:0.0:1789518688.143460:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617468928:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518688.143586:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2344:x1876445617469312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 408us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518688.143594:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:1.0:1789518688.143650:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:1.0:1789518688.143658:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2345:x1876445617469184:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518688.143805:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:2344:x1876445617469056:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 516us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518688.143813:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:3.0:1789518688.143829:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1789518688.143836:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617469440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518688.143863:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617469440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518688.143870:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00080000:3.0:1789518688.143888:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518688.143894:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518688.143896:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518688.144516:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2345:x1876445617469184:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 854us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518688.144525:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:0.0:1789518688.144792:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617468928:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1331us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518688.144802:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 145 00000001:02000400:1.0:1789518688.737080:0:40444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 12: RW-PCC attach races with concurrent HSM remove ========================================================== 20:31:28 (1789518688) 00000100:00100000:2.0:1789518688.891074:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518688.891293:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617469696 00000100:00100000:1.0:1789518688.891303:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617469696 00000100:00100000:1.0:1789518688.891393:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 487 00000100:00100000:1.0:1789518688.891402:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:40482:x1876445617469696:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518688.891421:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518688.891439:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c78762e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe199 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891497:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891510:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891520:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891550:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891557:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891563:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891881:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787643 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891898:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787643 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891905:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787643 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518688.891914:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789518688.891988:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.891995:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892002:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892007:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518688.892011:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892027:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892038:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:1.0:1789518688.892041:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518688.892045:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892051:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787635 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892062:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892068:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892073:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892079:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518688.892082:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892087:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892094:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc6733400) 00010000:00010000:1.0:1789518688.892097:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518688.892100:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892127:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c78763c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892478:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c78762e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe199 expref: 72 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892493:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787643 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe199 expref: 71 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.892500:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518688.892502:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518688.892505:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381e00, rc 0) 00000100:00100000:1.0:1789518688.892581:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+71:40482:x1876445617469696:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1179us (1517us total) trans 30064771505 rc 0/0 00000100:00100000:1.0:1789518688.892590:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 487 00000100:00100000:3.0:1789518688.900725:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518688.901359:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518688.901478:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617469952 00000100:00100000:1.0:1789518688.901493:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617469952 00000100:00100000:0.0:1789518688.901560:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617469824 00000100:00100000:0.0:1789518688.901570:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617469824 00000100:00100000:1.0:1789518688.901657:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:3.0:1789518688.901680:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 488 00000100:00100000:1.0:1789518688.901681:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:2343:x1876445617469952:12345-192.168.206.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789518688.901699:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:40482:x1876445617469824:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00010000:00010000:1.0:1789518688.901708:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518688.901735:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787643 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe199 expref: 72 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.901754:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518688.901760:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518688.901833:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+71:2343:x1876445617469952:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 166us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518688.901853:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:3.0:1789518688.902078:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:40482:x1876445617469824:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 383us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518688.902087:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 488 00000100:00100000:0.0:1789518688.949876:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518688.950329:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617470208 00000100:00100000:3.0:1789518688.950344:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617470208 00000100:00100000:3.0:1789518688.950431:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 489 00000100:00100000:3.0:1789518688.950445:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:40316:x1876445617470208:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1789518688.950472:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518688.950476:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518688.950509:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787627 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe192 expref: 70 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518688.950533:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518688.950545:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518688.950566:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787651 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1a0 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518688.950775:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518688.950791:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518688.950803:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518688.951761:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518688.951772:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518688.951783:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518688.952539:0:35845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xce:0x0], index 1: 0 00010000:00010000:0.0:1789518688.952972:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.952989:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953001:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953043:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953051:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953059:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953067:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518688.953072:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953081:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953100:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdc000) 00010000:00010000:0.0:1789518688.953103:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518688.953109:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953114:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787658 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518688.953130:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d405a1fe reply state 00000000eb45543a transno 30064771506 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518688.953141:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518688.953183:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787651 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a0 expref: 72 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953204:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a0 expref: 71 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518688.953212:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518688.953214:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518688.953217:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22600, rc 0) 00000100:00100000:0.0:1789518688.953393:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:40316:x1876445617470208:12345-192.168.206.51@tcp:101:bash.0 Request processed in 2950us (3528us total) trans 30064771506 rc 0/0 00000100:00100000:0.0:1789518688.953403:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 489 00010000:00010000:2.0:1789518688.955941:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518688.955962:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518688.955971:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518688.955978:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518688.955983:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518688.955991:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518688.956012:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff99ffc2fdcc00) 00010000:00010000:2.0:1789518688.956015:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518688.956021:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518688.956029:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c78765f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518688.958076:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518688.958231:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617470336 00000100:00100000:2.0:1789518688.958244:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617470336 00000100:00100000:2.0:1789518688.958661:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:2.0:1789518688.958675:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:40316:x1876445617470336:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1789518688.958705:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518688.958732:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1a7 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518688.958765:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789518688.958792:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1789518688.958798:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518688.958810:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 15 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518688.958829:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 15 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518688.958845:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900e00, rc 0) 00000100:00100000:2.0:1789518688.958996:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:40316:x1876445617470336:12345-192.168.206.51@tcp:101:bash.0 Request processed in 323us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518688.959245:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:3.0:1789518688.962743:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518688.962913:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617470592 00000100:00100000:2.0:1789518688.962926:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617470592 00000100:00100000:2.0:1789518688.962996:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:2.0:1789518688.963009:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+71:40316:x1876445617470592:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:2.0:1789518688.963821:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:40316:x1876445617470592:12345-192.168.206.51@tcp:35:bash.0 Request processed in 809us (1085us total) trans 30064771507 rc 0/0 00000100:00100000:2.0:1789518688.963841:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:0.0:1789518688.975908:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518688.976976:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617470720 00000100:00100000:1.0:1789518688.976989:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617470720 00000100:00100000:1.0:1789518688.977058:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 490 00000100:00100000:1.0:1789518688.977069:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:40493:x1876445617470720:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518688.977090:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518688.977110:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c78767b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1ae expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.977410:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787682 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.977435:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.977446:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518688.977482:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789518688.977486:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518688.977503:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.977527:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c78767b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ae expref: 74 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.977544:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ae expref: 73 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518688.977570:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733400) 00010000:00010000:1.0:1789518688.977573:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518688.977576:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380c00, rc 0) 00000100:00100000:1.0:1789518688.978643:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:40493:x1876445617470720:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1570us (2737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518688.978654:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 490 00000100:00100000:0.0:1789518689.073609:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518689.073751:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617470976 00000100:00100000:3.0:1789518689.073765:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617470976 00000100:00080000:0.0:1789518689.073817:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518689.073917:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 491 00000100:00100000:3.0:1789518689.073928:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:40509:x1876445617470976:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518689.073946:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518689.073964:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787689 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1b5 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.074093:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787690 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.074107:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787690 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.074121:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787690 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518689.074131:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1789518689.074312:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1b5 expref: 76 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.074340:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787690 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1b5 expref: 75 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.074347:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518689.074350:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518689.074354:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14d000, rc 0) 00000100:00100000:3.0:1789518689.074409:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:40509:x1876445617470976:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 484us (808us total) trans 30064771508 rc 0/0 00000100:00100000:3.0:1789518689.074416:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 491 00000100:00100000:0.0:1789518689.077487:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.077708:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617471104 00000100:00100000:1.0:1789518689.077721:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617471104 00000100:00100000:1.0:1789518689.077801:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:1.0:1789518689.077813:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:2345:x1876445617471104:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518689.077940:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518689.077971:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787690 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1b5 expref: 75 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.077995:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:1.0:1789518689.078002:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518689.078270:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:2345:x1876445617471104:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 449us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.078280:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:0.0:1789518689.078448:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.078580:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617471360 00000100:00100000:1.0:1789518689.078586:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617471360 00000100:00100000:1.0:1789518689.078786:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 492 00000100:00100000:1.0:1789518689.078795:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:40509:x1876445617471360:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518689.078822:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518689.078842:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c78769e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1bc expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.078981:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876a5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.078998:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.079010:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518689.079025:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:1.0:1789518689.079194:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c78769e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1bc expref: 77 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.079213:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876a5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1bc expref: 76 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.079221:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:1.0:1789518689.079225:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518689.079227:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381000, rc 0) 00000100:00100000:1.0:1789518689.079303:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:40509:x1876445617471360:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 508us (855us total) trans 30064771509 rc 0/0 00000100:00100000:1.0:1789518689.079310:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 492 00000100:00100000:3.0:1789518689.089562:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.089954:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617471488 00000100:00100000:0.0:1789518689.089967:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617471488 00000100:00100000:0.0:1789518689.090040:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:0.0:1789518689.090052:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617471488:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:0.0:1789518689.090112:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.090136:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 15 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.090145:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xce:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789518689.090150:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518689.090155:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.090198:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 15 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.090214:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 15 pid: 36531 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.090230:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:36532:1876445627673984:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518689.090477:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4c41d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789518689.092597:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:36532:1876445627673984:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518689.092660:0:36532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.096158:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.096548:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617471616 00000100:00100000:1.0:1789518689.096561:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617471616 00002000:00100000:1.0:1789518689.096656:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xce:0x0] (0->23) req@ffff99fec82fad80 x1876445617471616/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:335/0 lens 512/0 e 0 to 0 dl 1789518700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518689.096670:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82fad80 with x1876445617471616 ext(0->23) 00010000:00010000:1.0:1789518689.096700:0:39460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 16 pid: 36531 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.096720:0:39460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 16 pid: 36531 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518689.097083:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99fec82fad80 00000100:00100000:1.0:1789518689.097180:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:1.0:1789518689.097192:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617471616:12345-192.168.206.51@tcp:4:lfs.0 00000100:00100000:1.0:1789518689.097845:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2342:x1876445617471616:12345-192.168.206.51@tcp:4:lfs.0 Request processed in 653us (1697us total) trans 30064771280 rc 0/0 00000100:00100000:1.0:1789518689.097854:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00002000:00100000:1.0:1789518689.097863:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xce:0x0] (0->23) req@ffff99fec82fad80 x1876445617471616/t30064771280(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:335/0 lens 512/448 e 0 to 0 dl 1789518700 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518689.097872:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec82fad80 with x1876445617471616 ext(0->23) 00010000:00010000:1.0:1789518689.097881:0:39460:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 18 pid: 36531 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.097895:0:39460:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 18 pid: 36531 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789518689.097902:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99fec82fad80 00000100:00100000:3.0:1789518689.101878:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.102028:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617471744 00000100:00100000:2.0:1789518689.102041:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617471744 00010000:00010000:2.0:1789518689.102089:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 18 pid: 36531 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518689.102142:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 83 00000100:00100000:2.0:1789518689.102153:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+18:2343:x1876445617471744:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518689.102170:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789518689.102196:0:35832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:2.0:1789518689.102200:0:35832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb mtime from disk: 0 -> 1789518689 00002000:00010000:2.0:1789518689.102202:0:35832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb atime from disk: 0 -> 1789518689 00002000:00010000:2.0:1789518689.102205:0:35832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb ctime from disk: 0 -> 1789518689 00010000:00010000:2.0:1789518689.102212:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 18 pid: 36531 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.102227:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 18 pid: 36531 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.102258:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ee0f38a/0x631fd8698c787674 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a7 expref: 18 pid: 36531 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.102299:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518689.102304:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789518689.102541:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.102555:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.102701:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518689.102772:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2343:x1876445617471744:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 620us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518689.102780:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 83 00010000:00010000:0.0:1789518689.103373:0:36532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.103387:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.103424:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.103433:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.103441:0:36532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.103448:0:36532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23800 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518689.103868:0:36532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.103882:0:36532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.103901:0:36532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.103911:0:36532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092dc0030/0x631fd8698c7876b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.104096:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2343:x1876445617471488:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 14043us (14548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.104107:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:3.0:1789518689.105688:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.105783:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617472000 00000100:00100000:1.0:1789518689.105795:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617472000 00000100:00100000:1.0:1789518689.105924:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:1.0:1789518689.105937:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:40509:x1876445617472000:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:1.0:1789518689.106035:0:35849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x32:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876a5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1bc expref: 76 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518689.108086:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771510 00000001:00080000:1.0:1789518689.108123:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771511 00000001:00080000:1.0:1789518689.109045:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771512 00010000:00010000:1.0:1789518689.109127:0:35849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.109153:0:35849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a0 expref: 80 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.109163:0:35849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.109216:0:35849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a0 expref: 80 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.109235:0:35849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a0 expref: 80 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.109251:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35849:1876445627674112:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518689.109460:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5180 going to sleep for 11 seconds 00000100:00100000:2.0:1789518689.113103:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28adf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35849:1876445627674112:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518689.113144:0:35849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.113446:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.114403:0:40259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617472128 00000100:00100000:0.0:1789518689.114414:0:40259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617472128 00010000:00010000:0.0:1789518689.114463:0:40259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a0 expref: 81 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.114501:0:40259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:0.0:1789518689.114511:0:40259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+81:2342:x1876445617472128:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518689.114531:0:40259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518689.114539:0:40259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a0 expref: 81 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.114552:0:40259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a0 expref: 81 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.114577:0:40259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787666 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1a0 expref: 81 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.114595:0:40259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518689.114601:0:40259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.114642:0:40259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.114651:0:40259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.114675:0:40259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518689.114729:0:35849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.114748:0:35849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.114792:0:40259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+80:2342:x1876445617472128:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 281us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.114801:0:40259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000001:00080000:2.0:1789518689.114915:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771513 00000001:00080000:2.0:1789518689.115420:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771514 00000100:00100000:2.0:1789518689.115728:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627674240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518689.115801:0:35849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518689.115835:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfffb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518689.116231:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627674240 00000100:00100000:1.0:1789518689.116239:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627674240 00000100:00100000:1.0:1789518689.116353:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789518689.116365:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35849:x1876445627674240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789518689.116462:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35849:x1876445627674240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (661us total) trans 0 rc 0/0 00000100:00080000:2.0:1789518689.116468:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518689.116488:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789518689.116528:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627674240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789518689.117304:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771515 00000100:00100000:2.0:1789518689.117415:0:35849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627674368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789518689.117462:0:35849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518689.117492:0:35849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc64c7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518689.117524:0:39259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627674368 00000100:00100000:1.0:1789518689.117531:0:39259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627674368 00000100:00100000:1.0:1789518689.117576:0:39259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789518689.117585:0:39259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35849:x1876445627674368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789518689.117809:0:39259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35849:x1876445627674368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 224us (345us total) trans 30064771281 rc 0/0 00000100:00100000:1.0:1789518689.117818:0:39259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789518689.117867:0:35849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35849:1876445627674368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789518689.117941:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771516 00010000:00010000:3.0:1789518689.117988:0:35849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.117999:0:35849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.118008:0:35849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.118015:0:35849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518689.118021:0:35849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.118045:0:35849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.118064:0:35849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518689.118067:0:35849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789518689.118073:0:35849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.118080:0:35849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7876ba lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518689.118380:0:35849:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x33:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789518689.118462:0:35849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].18, 64 off9632 00000004:00080000:3.0:1789518689.118476:0:35849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743114861843ns, next at 744114858704ns, rc = 0 00000001:00080000:3.0:1789518689.118493:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771517 00010000:00010000:3.0:1789518689.118528:0:35849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518689.118531:0:35849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789518689.118539:0:35849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876a5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1bc expref: 84 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.118666:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+83:40509:x1876445617472000:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 12733us (12986us total) trans 30064771518 rc 0/0 00000100:00100000:3.0:1789518689.118674:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000020:00080000:3.0:1789518689.118677:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789518689.121189:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.121299:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617472256 00000100:00100000:1.0:1789518689.121312:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617472256 00000100:00100000:1.0:1789518689.121379:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 493 00000100:00100000:1.0:1789518689.121391:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+83:40509:x1876445617472256:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518689.121419:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518689.121446:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c7876c1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1c3 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.121520:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c7876c1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1c3 expref: 84 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.121539:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c7876c1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1c3 expref: 84 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.121562:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518689.121566:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518689.121571:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380000, rc 0) 00000100:00100000:1.0:1789518689.121702:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+84:40509:x1876445617472256:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 313us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.121728:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 493 00000100:00100000:1.0:1789518689.124279:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.124421:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617472512 00000100:00100000:2.0:1789518689.124433:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617472512 00000100:00100000:0.0:1789518689.124721:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:0.0:1789518689.124737:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+84:40509:x1876445617472512:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518689.125271:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+85:40509:x1876445617472512:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 528us (1005us total) trans 30064771519 rc 0/0 00000100:00100000:0.0:1789518689.125280:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00010000:00010000:0.0:1789518689.138854:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518689.167496:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.167735:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617472640 00000100:00100000:1.0:1789518689.167749:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617472640 00000100:00100000:1.0:1789518689.167953:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 494 00000100:00100000:1.0:1789518689.167967:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+85:40515:x1876445617472640:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518689.168000:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518689.168026:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7876c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1ca expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168109:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168133:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168148:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168165:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168172:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168179:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168302:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168329:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168336:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518689.168380:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:1.0:1789518689.168385:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518689.168407:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168420:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168429:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168436:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168443:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168448:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518689.168453:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168460:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168473:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733400) 00010000:00010000:1.0:1789518689.168485:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518689.168492:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168499:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7876cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168516:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168521:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168527:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168532:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518689.168534:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168540:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168548:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff99ffc6733200) 00010000:00010000:1.0:1789518689.168550:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518689.168554:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168695:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c7876d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168738:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c7876c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ca expref: 87 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168767:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ca expref: 86 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.168775:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518689.168778:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518689.168781:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380200, rc 0) 00000100:00100000:1.0:1789518689.168860:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+86:40515:x1876445617472640:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 896us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.168869:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 494 00000100:00100000:3.0:1789518689.171478:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.171920:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617472896 00000100:00100000:1.0:1789518689.171936:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617472896 00000100:00100000:1.0:1789518689.172149:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 495 00000100:00100000:1.0:1789518689.172161:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+86:40515:x1876445617472896:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518689.172190:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518689.172211:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380800/0x631fd8698c7876e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1d1 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.172318:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.172334:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ca expref: 87 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.172343:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.172375:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ca expref: 87 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.172404:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ca expref: 87 pid: 37723 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.172417:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627674496:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518689.172529:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518689.176808:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627674496:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518689.176837:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.177649:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.177910:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617473024 00000100:00100000:1.0:1789518689.177918:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617473024 00010000:00010000:1.0:1789518689.177949:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ca expref: 88 pid: 37723 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.178026:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1789518689.178034:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+88:2342:x1876445617473024:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518689.178058:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518689.178065:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ca expref: 88 pid: 37723 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.178078:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ca expref: 88 pid: 37723 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.178099:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c7876dd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ca expref: 88 pid: 37723 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.178126:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518689.178131:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.178140:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.178150:0:35831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.178186:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518689.178243:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+87:2342:x1876445617473024:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 209us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.178250:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00010000:00010000:0.0:1789518689.178315:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.178324:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518689.178346:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:0.0:1789518689.178479:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380800/0x631fd8698c7876e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d1 expref: 88 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.178494:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d1 expref: 87 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.178506:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518689.178509:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518689.178511:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381000, rc 0) 00000100:00100000:0.0:1789518689.178556:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+87:40515:x1876445617472896:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 6398us (7093us total) trans 30064771520 rc 0/0 00000100:00100000:0.0:1789518689.178564:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 495 00000100:00100000:3.0:1789518689.200476:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.201483:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617473280 00000100:00100000:2.0:1789518689.201494:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617473280 00000100:00100000:2.0:1789518689.201562:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 496 00000100:00100000:2.0:1789518689.201573:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+87:40518:x1876445617473280:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518689.201607:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518689.201662:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7876f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1d8 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.201728:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.201749:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.201760:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.201775:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.201790:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.201798:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.201997:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c78770e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.202008:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c78770e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.202021:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c78770e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518689.202031:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1789518689.202127:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.202135:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.202141:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.202148:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518689.202152:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.202160:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.202172:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733400) 00010000:00010000:2.0:1789518689.202175:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518689.202180:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.202186:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203530:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203538:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203545:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203550:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518689.203553:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203560:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203571:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff99fff6905c00) 00010000:00010000:2.0:1789518689.203574:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518689.203577:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203583:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787707 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203675:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c7876f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d8 expref: 90 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203695:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c78770e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d8 expref: 89 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.203702:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518689.203704:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789518689.203707:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900a00, rc 0) 00000100:00100000:2.0:1789518689.203783:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:40518:x1876445617473280:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 2211us (3315us total) trans 30064771521 rc 0/0 00000100:00100000:2.0:1789518689.203791:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 496 00000100:00100000:3.0:1789518689.207074:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.207231:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617473408 00000100:00100000:1.0:1789518689.207241:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617473408 00000100:00100000:1.0:1789518689.207388:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 497 00000100:00100000:1.0:1789518689.207399:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:40518:x1876445617473408:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:1.0:1789518689.207465:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.207482:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d1 expref: 89 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.207492:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.207524:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d1 expref: 89 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.207565:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d1 expref: 89 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.207581:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627674624:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518689.207694:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518689.211774:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627674624:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518689.211808:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.211920:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.212215:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617473664 00000100:00100000:0.0:1789518689.212223:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617473664 00000100:00100000:0.0:1789518689.212284:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:0.0:1789518689.212295:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdb025450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+90:31568:x1876445617473664:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789518689.212512:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdb025450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+91:31568:x1876445617473664:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 220us (593us total) trans 30064771522 rc 0/0 00000100:00100000:0.0:1789518689.212519:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:3.0:1789518689.214491:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.214675:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617473792 00000100:00100000:1.0:1789518689.214683:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617473792 00010000:00010000:1.0:1789518689.214712:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d1 expref: 91 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.214779:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:1.0:1789518689.214786:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+91:2342:x1876445617473792:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518689.214797:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518689.214802:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d1 expref: 91 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.214811:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d1 expref: 91 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.214829:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381000/0x631fd8698c7876eb lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d1 expref: 91 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.214865:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518689.214870:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.214879:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.214885:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.214909:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518689.214936:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.214944:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.214963:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+90:2342:x1876445617473792:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 177us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.214970:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00010000:00010000:3.0:1789518689.214972:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.214979:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.214984:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.214990:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518689.214994:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.215002:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.215010:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:3.0:1789518689.215013:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518689.215016:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.215022:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380200/0x631fd8698c78771c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.215132:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:40518:x1876445617473408:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 7736us (8068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518689.215140:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 497 00000100:00100000:3.0:1789518689.217168:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.217319:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617474048 00000100:00100000:1.0:1789518689.217328:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617474048 00000100:00100000:1.0:1789518689.217378:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:1.0:1789518689.217387:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:40518:x1876445617474048:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518689.217668:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+90:40518:x1876445617474048:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 281us (505us total) trans 30064771523 rc 0/0 00000100:00100000:1.0:1789518689.217676:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:2.0:1789518689.295887:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.296044:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617474304 00000100:00100000:0.0:1789518689.296054:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617474304 00000100:00100000:0.0:1789518689.296157:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 498 00000100:00100000:0.0:1789518689.296168:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+90:40530:x1876445617474304:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518689.296191:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518689.296210:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1df expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296288:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296304:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296316:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296328:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296335:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296342:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296444:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296453:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296460:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518689.296469:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:0.0:1789518689.296546:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296554:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296562:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296568:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518689.296573:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296581:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296592:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733400) 00010000:00010000:0.0:1789518689.296595:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518689.296600:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296606:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c78772a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296642:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296649:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296655:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296660:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518689.296663:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296668:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296688:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518689.296691:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518689.296694:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296701:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787731 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296737:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1df expref: 93 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296750:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1df expref: 92 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.296757:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518689.296760:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518689.296762:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23c00, rc 0) 00000100:00100000:0.0:1789518689.296831:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+92:40530:x1876445617474304:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 664us (951us total) trans 30064771524 rc 0/0 00000100:00100000:0.0:1789518689.296838:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 498 00000100:00100000:3.0:1789518689.304311:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.304374:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617474432 00000100:00100000:2.0:1789518689.304384:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617474432 00000100:00100000:2.0:1789518689.304436:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 499 00000100:00100000:2.0:1789518689.304716:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+92:40530:x1876445617474432:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1789518689.304781:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.304797:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.304806:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.304829:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.304836:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.304843:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.304849:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518689.304853:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.304861:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.304979:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518689.304983:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518689.304989:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.304996:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787746 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518689.305071:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+92:40530:x1876445617474432:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 625us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518689.305078:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 499 00000100:00100000:1.0:1789518689.308340:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.308444:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617474688 00000100:00100000:0.0:1789518689.308454:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617474688 00000100:00100000:0.0:1789518689.308510:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:0.0:1789518689.308520:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+92:40530:x1876445617474688:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518689.308762:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+93:40530:x1876445617474688:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 243us (429us total) trans 30064771525 rc 0/0 00000100:00100000:0.0:1789518689.308770:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:3.0:1789518689.328402:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.328577:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617474944 00000100:00100000:1.0:1789518689.328588:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617474944 00000100:00100000:1.0:1789518689.328668:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 500 00000100:00100000:1.0:1789518689.328679:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+93:40536:x1876445617474944:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518689.328718:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518689.328738:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c78774d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1e6 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.328846:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.328862:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1df expref: 94 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.328870:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.328900:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1df expref: 94 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.328911:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1df expref: 94 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.328924:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627674752:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518689.329258:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffffbb5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789518689.333132:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627674752:192.168.206.51@tcp:104: 00010000:00010000:1.0:1789518689.333159:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.333595:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.333685:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617475072 00000100:00100000:2.0:1789518689.333691:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617475072 00010000:00010000:2.0:1789518689.333720:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1df expref: 95 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518689.333746:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:2.0:1789518689.333753:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+95:2343:x1876445617475072:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518689.333764:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518689.333770:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1df expref: 95 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.333780:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1df expref: 95 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.333797:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787738 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1df expref: 95 pid: 35845 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.333810:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518689.333814:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.333822:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.333828:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.333864:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518689.333918:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+94:2343:x1876445617475072:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 164us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518689.333936:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00010000:00010000:3.0:1789518689.334635:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.334646:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518689.334662:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1789518689.334792:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c78774d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1e6 expref: 95 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.334808:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1e6 expref: 94 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.334817:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:3.0:1789518689.334820:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789518689.334823:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380600, rc 0) 00000100:00100000:3.0:1789518689.334865:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+94:40536:x1876445617474944:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 6188us (6471us total) trans 30064771526 rc 0/0 00000100:00100000:3.0:1789518689.334872:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 500 00000100:00100000:3.0:1789518689.337787:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.337879:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617475328 00000100:00100000:0.0:1789518689.337889:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617475328 00000100:00100000:0.0:1789518689.337950:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 501 00000100:00100000:0.0:1789518689.337960:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+94:40536:x1876445617475328:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518689.337983:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518689.337986:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789518689.338014:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787754 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1e6 expref: 94 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.338032:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518689.338038:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518689.338050:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787762 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1ed expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.338134:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787769 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.338147:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787769 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.338157:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787769 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518689.338168:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:0.0:1789518689.338285:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787762 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ed expref: 96 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.338300:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787769 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ed expref: 95 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.338307:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518689.338309:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789518689.338312:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23800, rc 0) 00000100:00100000:0.0:1789518689.338473:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+95:40536:x1876445617475328:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 514us (694us total) trans 30064771527 rc 0/0 00000100:00100000:0.0:1789518689.338480:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 501 00000100:00100000:1.0:1789518689.341963:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.342043:0:40259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617475584 00000100:00100000:0.0:1789518689.342052:0:40259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617475584 00000100:00100000:0.0:1789518689.342148:0:40259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:0.0:1789518689.342158:0:40259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+95:40536:x1876445617475584:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:0.0:1789518689.342173:0:40259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518689.342197:0:40259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c78770e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1d8 expref: 95 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.342218:0:40259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c7876c1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1c3 expref: 94 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.342236:0:40259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518689.342241:0:40259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518689.342351:0:40259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+93:40536:x1876445617475584:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 194us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.342360:0:40259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:2.0:1789518689.344765:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518689.344869:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617475712 00000100:00100000:3.0:1789518689.344878:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617475712 00000100:00100000:3.0:1789518689.344934:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 502 00000100:00100000:3.0:1789518689.344943:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+93:40536:x1876445617475712:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:3.0:1789518689.345025:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.345037:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.345045:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518689.345322:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].10, 136 off9552 00000100:00100000:3.0:1789518689.345399:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+93:40536:x1876445617475712:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 455us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518689.345406:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 502 00000100:00100000:3.0:1789518689.350559:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.350931:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617475840 00000100:00100000:1.0:1789518689.350939:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617475840 00000100:00100000:1.0:1789518689.350996:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 503 00000100:00100000:1.0:1789518689.351005:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+93:40536:x1876445617475840:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1789518689.351024:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518689.351041:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1f4 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.351090:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.351102:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 94 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.351120:0:37723:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.351133:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 94 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.351145:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518689.351148:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518689.351152:0:37723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 94 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.351159:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380a00, rc 0) 00000100:00100000:1.0:1789518689.351271:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+94:40536:x1876445617475840:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 267us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.351279:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 503 00000040:00080000:0.0:1789518689.586852:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518689.586861:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518689.586901:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 6 00000040:00080000:0.0:1789518689.586907:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518689.587017:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627674880:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518689.587105:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc4c413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518689.589384:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627674880:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518689.592359:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.592471:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617475968 00000100:00100000:1.0:1789518689.592493:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617475968 00000100:00100000:1.0:1789518689.592553:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 504 00000100:00100000:1.0:1789518689.592563:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+94:40538:x1876445617475968:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518689.592595:0:39157:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518689.592720:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+94:40538:x1876445617475968:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 157us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.592727:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 504 00000100:00100000:3.0:1789518689.596136:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.597570:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617476096 00000100:00100000:2.0:1789518689.597582:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617476096 00000100:00100000:2.0:1789518689.597998:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 505 00000100:00100000:2.0:1789518689.598011:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+94:40538:x1876445617476096:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789518689.598081:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598097:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598109:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598125:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598133:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598140:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598162:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598172:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598191:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518689.598229:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:2.0:1789518689.598234:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518689.598247:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598266:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598274:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598281:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598286:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518689.598290:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598298:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598309:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:2.0:1789518689.598312:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518689.598318:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598324:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c787785 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598337:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598343:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598349:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598354:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518689.598359:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598365:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598372:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x26c361d7 (ffff99fff6905c00) 00010000:00010000:2.0:1789518689.598375:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518689.598378:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598384:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c78778c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598398:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598405:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598411:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598416:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518689.598419:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598424:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598432:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:2.0:1789518689.598434:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518689.598438:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.598444:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787793 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518689.598532:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+94:40538:x1876445617476096:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 523us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518689.598540:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 505 00000100:00100000:3.0:1789518689.600982:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.601526:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617476352 00000100:00100000:1.0:1789518689.601536:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617476352 00000100:00100000:1.0:1789518689.601603:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 506 00000100:00100000:1.0:1789518689.601632:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+94:40538:x1876445617476352:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518689.601655:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518689.601679:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c78779a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe1fb expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.601779:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.601793:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.601804:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518689.601827:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:1.0:1789518689.601921:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.601929:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.601949:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.601955:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518689.601958:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.601965:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.601976:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518689.601978:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518689.601982:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.602003:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c7877a1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.602042:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c78779a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1fb expref: 96 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.602051:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518689.602053:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518689.602057:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c78779a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1fb expref: 96 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.602065:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381200, rc 0) 00000100:00100000:1.0:1789518689.602126:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+95:40538:x1876445617476352:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 515us (1152us total) trans 30064771528 rc 301/301 00000100:00100000:1.0:1789518689.602142:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 506 00000100:00100000:3.0:1789518689.607135:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.607330:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617476480 00000100:00100000:0.0:1789518689.607340:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617476480 00000100:00100000:0.0:1789518689.607442:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 507 00000100:00100000:0.0:1789518689.607453:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+95:40538:x1876445617476480:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789518689.607501:0:35846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789518689.607599:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+95:40538:x1876445617476480:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 147us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.607606:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 507 00000100:00100000:3.0:1789518689.610671:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.610730:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617476736 00000100:00100000:2.0:1789518689.610740:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617476736 00000100:00100000:2.0:1789518689.610799:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 508 00000100:00100000:2.0:1789518689.610812:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+95:40538:x1876445617476736:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518689.610832:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518689.610835:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789518689.610858:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787682 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ae expref: 95 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.610875:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc6733400) 00010000:00010000:2.0:1789518689.610885:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518689.610899:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7877af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe202 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789518689.611287:0:35847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcf:0x0], index 0: 0 00010000:00010000:2.0:1789518689.611501:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c7877b6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.611515:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c7877b6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.611529:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c7877b6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.611585:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7877af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe202 expref: 97 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.611603:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c7877b6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe202 expref: 96 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.611632:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905000) 00010000:00010000:2.0:1789518689.611636:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789518689.611639:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901e00, rc 0) 00000100:00100000:2.0:1789518689.611751:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+96:40538:x1876445617476736:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 941us (1088us total) trans 30064771529 rc 0/0 00000100:00100000:2.0:1789518689.611758:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 508 00000100:00100000:3.0:1789518689.614375:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.614495:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617476864 00000100:00100000:0.0:1789518689.614511:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617476864 00000100:00100000:0.0:1789518689.614781:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 509 00000100:00100000:0.0:1789518689.614795:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+96:40538:x1876445617476864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518689.614827:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518689.614855:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe209 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.614951:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c7877cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.614968:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c7877cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.614987:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c7877cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518689.615044:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518689.615049:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518689.615072:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c7877cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.615106:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe209 expref: 98 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.615192:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c7877cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe209 expref: 97 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.615200:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518689.615202:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518689.615205:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22e00, rc 0) 00000100:00100000:0.0:1789518689.615281:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+97:40538:x1876445617476864:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 491us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.615287:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 509 00000100:00100000:3.0:1789518689.617531:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.617650:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617477120 00000100:00100000:0.0:1789518689.617663:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617477120 00000100:00100000:0.0:1789518689.617765:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 510 00000100:00100000:0.0:1789518689.617775:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+97:40538:x1876445617477120:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518689.617839:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518689.617870:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901e00/0x631fd8698c7877b6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe202 expref: 97 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.617889:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905000) 00010000:00010000:0.0:1789518689.617907:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c7877cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe209 expref: 96 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.617916:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518689.617923:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518689.617950:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.617963:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.617974:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.617985:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.617992:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.617999:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618078:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618086:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618093:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618100:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518689.618105:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618114:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618124:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518689.618126:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518689.618130:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618136:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c7877d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618148:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618154:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618159:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618165:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518689.618167:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618173:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618180:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa7bc415 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518689.618182:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518689.618185:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.618191:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877d9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfa7bc415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.618301:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+95:40538:x1876445617477120:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 527us (778us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789518689.618311:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 510 00000100:00100000:3.0:1789518689.620134:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.620287:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617477248 00000100:00100000:2.0:1789518689.620302:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617477248 00000100:00100000:2.0:1789518689.620376:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 511 00000100:00100000:2.0:1789518689.620386:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+95:40538:x1876445617477248:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518689.620407:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518689.620429:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7877e0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe210 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.620463:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.620475:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.620487:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.620581:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7877e0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe210 expref: 97 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.620600:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe210 expref: 96 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.620608:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:2.0:1789518689.620653:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518689.620657:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900400, rc 0) 00000100:00100000:2.0:1789518689.620713:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+96:40538:x1876445617477248:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 328us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518689.620720:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 511 00000100:00100000:1.0:1789518689.622490:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.623041:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617477504 00000100:00100000:0.0:1789518689.623058:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617477504 00000100:00100000:0.0:1789518689.623205:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 512 00000100:00100000:0.0:1789518689.623218:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+96:40538:x1876445617477504:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518689.623346:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.623376:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.623391:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518689.623981:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].19, 88 off9648 00000004:00080000:0.0:1789518689.623994:0:39157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743620379217ns, next at 744620376433ns, rc = 0 00000004:00010000:0.0:1789518689.624092:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c0248f2 reply state 000000006e0c322d transno 30064771530 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.624101:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518689.624326:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+98:40538:x1876445617477504:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1108us (1839us total) trans 30064771530 rc 0/0 00000100:00100000:0.0:1789518689.624335:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 512 00010000:00010000:0.0:1789518689.628444:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.628466:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.628474:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.628479:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518689.628484:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.628490:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.628506:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:0.0:1789518689.628509:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789518689.628514:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.628520:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877ee lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.628694:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.629386:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617477632 00000100:00100000:0.0:1789518689.629396:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617477632 00000100:00100000:0.0:1789518689.629451:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 513 00000100:00100000:0.0:1789518689.629460:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+97:40538:x1876445617477632:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518689.629481:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518689.629497:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe217 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.629791:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe217 expref: 98 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.629805:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe217 expref: 98 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.629824:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:0.0:1789518689.629827:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789518689.629830:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22600, rc 0) 00000100:00100000:0.0:1789518689.629927:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+98:40538:x1876445617477632:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 466us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.629936:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 513 00000100:00100000:3.0:1789518689.632579:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.632696:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617477760 00000100:00100000:1.0:1789518689.632707:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617477760 00000100:00100000:1.0:1789518689.632761:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:1.0:1789518689.632772:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617477760:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789518689.633089:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617477760:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 318us (517us total) trans 30064771214 rc 0/0 00000100:00100000:1.0:1789518689.633097:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:1.0:1789518689.634909:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.635103:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617478016 00000100:00100000:0.0:1789518689.635113:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617478016 00000100:00100000:0.0:1789518689.635183:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:0.0:1789518689.635196:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+98:40538:x1876445617478016:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518689.635482:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+99:40538:x1876445617478016:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 288us (585us total) trans 30064771531 rc 0/0 00000100:00100000:0.0:1789518689.635491:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:3.0:1789518689.637995:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.638356:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617478272 00000100:00100000:1.0:1789518689.638366:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617478272 00000100:00100000:1.0:1789518689.638422:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 514 00000100:00100000:1.0:1789518689.638432:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+99:40538:x1876445617478272:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518689.638540:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+99:40538:x1876445617478272:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 110us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.638547:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 514 00000100:00100000:3.0:1789518689.640768:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.640898:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617478400 00000100:00100000:0.0:1789518689.640909:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617478400 00000100:00100000:0.0:1789518689.640972:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 515 00000100:00100000:0.0:1789518689.640982:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+99:40538:x1876445617478400:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518689.641001:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518689.641021:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877fc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe21e expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.641090:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787803 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.641104:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787803 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.641116:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787803 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518689.641149:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518689.641171:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787803 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.641196:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c7877fc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe21e expref: 101 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.641213:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787803 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe21e expref: 100 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.641221:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:0.0:1789518689.641224:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789518689.641228:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23c00, rc 0) 00000100:00100000:0.0:1789518689.641300:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+100:40538:x1876445617478400:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 319us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.641307:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 515 00000100:00100000:2.0:1789518689.644123:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.644331:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617478528 00000100:00100000:0.0:1789518689.644341:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617478528 00000100:00100000:0.0:1789518689.644420:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:0.0:1789518689.644428:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2343:x1876445617478528:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518689.644443:0:36531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518689.644459:0:36531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe225 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518689.644479:0:36531:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e362, blocks: 0x1 00010000:00010000:0.0:1789518689.644494:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1789518689.644498:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518689.644505:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe225 expref: 13 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.644517:0:36531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe225 expref: 13 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.644526:0:36531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22e00, rc 0) 00000100:00100000:0.0:1789518689.644578:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617478528:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 151us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.644582:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:3.0:1789518689.646912:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.646994:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617478784 00000100:00100000:0.0:1789518689.647003:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617478784 00000100:00100000:0.0:1789518689.647110:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 516 00000100:00100000:0.0:1789518689.647121:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+100:40538:x1876445617478784:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518689.647236:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+100:40538:x1876445617478784:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 116us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.647244:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 516 00000100:00100000:3.0:1789518689.651096:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.651200:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617478912 00000100:00100000:0.0:1789518689.651210:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617478912 00000100:00100000:0.0:1789518689.651275:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:0.0:1789518689.651286:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:40538:x1876445617478912:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518689.651307:0:36532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518689.651326:0:36532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe22c expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.651356:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe225 expref: 14 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.651365:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518689.651370:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518689.651375:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 14 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.651407:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe225 expref: 14 pid: 36531 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.651416:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe225 expref: 14 pid: 36531 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.651426:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627675008:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518689.651647:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff7ac00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518689.653401:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627675008:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518689.653427:0:36532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 14 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.653442:0:36532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23400, rc 0) 00000100:00100000:0.0:1789518689.653483:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:40538:x1876445617478912:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2199us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518689.653491:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:3.0:1789518689.653871:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.653947:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617479040 00000100:00100000:2.0:1789518689.653955:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617479040 00010000:00010000:2.0:1789518689.653983:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe225 expref: 14 pid: 36531 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518689.654127:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1789518689.654139:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617479040:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789518689.654153:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789518689.654175:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe225 expref: 14 pid: 36531 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.654193:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe225 expref: 14 pid: 36531 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.654215:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd7eca7/0x631fd8698c78780a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe225 expref: 14 pid: 36531 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.654230:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518689.654234:0:35832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518689.654242:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 13 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.654251:0:35832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 13 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.654527:0:35832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 13 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518689.654541:0:35832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f88700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:35832:1876445627675136:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518689.654659:0:35832:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fff4924780 going to sleep for 11 seconds 00000100:00100000:2.0:1789518689.657432:0:35832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f88700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:35832:1876445627675136:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518689.657458:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518689.657515:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617479040:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 3377us (3643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518689.657525:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:1.0:1789518689.659029:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.659413:0:36537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617479168 00000100:00100000:0.0:1789518689.659423:0:36537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617479168 00002000:00100000:0.0:1789518689.659484:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcf:0x0] (0->23) req@ffff99fec28adc00 x1876445617479168/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:335/0 lens 512/0 e 0 to 0 dl 1789518700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518689.659496:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28adc00 with x1876445617479168 ext(0->23) 00002000:00010000:0.0:1789518689.659502:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec28adc00 00000100:00100000:0.0:1789518689.659534:0:36537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 369 00000100:00100000:0.0:1789518689.659544:0:36537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617479168:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789518689.660096:0:36537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617479168:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 551us (1072us total) trans 30064771215 rc 0/0 00000100:00100000:0.0:1789518689.660104:0:36537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 369 00002000:00100000:0.0:1789518689.660113:0:36537:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcf:0x0] (0->23) req@ffff99fec28adc00 x1876445617479168/t30064771215(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:335/0 lens 512/448 e 0 to 0 dl 1789518700 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518689.660122:0:36537:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec28adc00 with x1876445617479168 ext(0->23) 00002000:00010000:0.0:1789518689.660126:0:36537:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec28adc00 00000100:00100000:3.0:1789518689.664942:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.665058:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617479296 00000100:00100000:1.0:1789518689.665068:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617479296 00000100:00100000:1.0:1789518689.665127:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 517 00000100:00100000:1.0:1789518689.665137:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+100:40538:x1876445617479296:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789518689.707629:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771531 is committed 00000004:00080000:2.0:1789518689.707645:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000004:00080000:2.0:1789518689.707674:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000004:00080000:2.0:1789518689.707698:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000020:00080000:2.0:1789518689.707733:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803905 batchid updated 00000020:00080000:2.0:1789518689.707754:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffdfffb240 refcount 2 committed 0 result 0 batchid 25769803906 00000020:00080000:2.0:1789518689.707758:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffd1090700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffdfffb0c0 00000020:00080000:2.0:1789518689.707761:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffff768800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec828a400 00000004:00080000:2.0:1789518689.707773:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000004:00080000:2.0:1789518689.707792:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000020:00080000:1.0:1789518689.707999:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803906 committed batchid 25769803905 00000020:00080000:1.0:1789518689.708168:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803905 00000100:00100000:1.0:1789518689.708191:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518689.708210:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627675264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789518689.708288:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518689.708345:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518689.708354:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627675392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789518689.708377:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518689.708406:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627675264 00000100:00100000:1.0:1789518689.708413:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627675264 00000100:00100000:1.0:1789518689.708458:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627675392 00000100:00100000:1.0:1789518689.708462:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627675392 00000100:00100000:1.0:1789518689.708484:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789518689.708492:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1876445627675264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789518689.708517:0:36735:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:206 count 1 00010000:00010000:1.0:1789518689.708543:0:36735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.708565:0:36735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 14 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.708573:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xce:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1789518689.708578:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518689.708583:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.708609:0:36735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 14 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.708647:0:36735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 14 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.708666:0:36735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36735:1876445627675520:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518689.708718:0:36735:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffe035ea80 going to sleep for 11 seconds 00000100:00080000:1.0:1789518689.708730:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518689.708750:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789518689.708759:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3283:x1876445627675392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789518689.708842:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:40538:x1876445617479296:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 43704us (43906us total) trans 0 rc 0/0 00002000:00010000:1.0:1789518689.708875:0:37973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:1.0:1789518689.708879:0:37973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb mtime from disk: 0 -> 1789518690 00002000:00010000:1.0:1789518689.708881:0:37973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789518689.708884:0:37973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb ctime from disk: 1789518690 -> 1789518690 00002000:00010000:1.0:1789518689.708886:0:37973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789518689.708920:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 517 00000100:00100000:1.0:1789518689.708921:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3283:x1876445627675392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (539us total) trans 30064771216 rc 0/0 00000100:00100000:1.0:1789518689.708931:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000004:00080000:1.0:1789518689.708973:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec28ad180/2, rc 0, transno 30064771216 00000100:00100000:1.0:1789518689.708979:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627675392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789518689.709499:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518689.709509:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627675776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789518689.709541:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518689.709570:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627675776 00000100:00100000:0.0:1789518689.709574:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627675776 00000100:00100000:0.0:1789518689.709598:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789518689.709605:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627675776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789518689.709640:0:36532:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:206 count 1 00002000:00010000:0.0:1789518689.709664:0:36532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xce:0x0] initial LVB size: 24, mtime: 0x6aa9e361, atime: 0x6aa9e361, ctime: 0x6aa9e361, blocks: 0x1 00010000:00010000:0.0:1789518689.709670:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.709681:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1789518689.709684:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518689.709690:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.709704:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.709713:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.709722:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.709737:0:36532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518689.710052:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518689.710062:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627675648:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789518689.710094:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518689.710131:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627675648 00000100:00100000:3.0:1789518689.710135:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627675648 00000100:00100000:3.0:1789518689.710160:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789518689.710166:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedcdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3282:x1876445627675648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789518689.710178:0:36533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:205 count 1 00010000:00010000:3.0:1789518689.710190:0:36533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.710203:0:36533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 15 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.710210:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xcd:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1789518689.710213:0:36533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518689.710216:0:36533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.710237:0:36533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 15 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.710271:0:36533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 15 pid: 36533 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.710283:0:36533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627675904:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518689.710328:0:36533:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a0240 going to sleep for 11 seconds 00010000:00010000:3.0:1789518689.710341:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518689.710346:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.710354:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518689.710358:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.710367:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.710383:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.710391:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a9cd63/0x631fd8698c78781f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.710407:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518689.710408:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518689.710410:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518689.711413:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3281:x1876445627675776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1804us (1868us total) trans 30064771282 rc 0/0 00000100:00100000:0.0:1789518689.711423:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789518689.711748:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.711804:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.711914:0:36735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36735:1876445627675520:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518689.712048:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617479424 00000100:00100000:3.0:1789518689.712054:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617479424 00010000:00010000:3.0:1789518689.712084:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 15 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.712114:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1789518689.712122:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617479424:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518689.712134:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518689.712140:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 15 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.712152:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 15 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.712169:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb8d4def/0x631fd8698c7875c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe176 expref: 15 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.712181:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518689.712186:0:35830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518689.712190:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.712200:0:35830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.712218:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789518689.712255:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617479424:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 134us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518689.712284:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 89 00000100:00100000:3.0:1789518689.712410:0:36533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:36533:1876445627675904:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518689.712428:0:36533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.712457:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617479552 00000100:00100000:3.0:1789518689.712461:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617479552 00010000:00010000:1.0:1789518689.712525:0:36735:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.712534:0:36735:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.712541:0:36735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.712556:0:36735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.712564:0:36735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.712580:0:36735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789518689.713112:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3280:x1876445627675264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4619us (4822us total) trans 30064771217 rc 0/0 00000100:00100000:1.0:1789518689.713120:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789518689.713138:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:1.0:1789518689.713145:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617479552:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789518689.713190:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518689.713196:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.713205:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518689.713210:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.713219:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.713233:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.713248:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2644ca2/0x631fd8698c787818 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.713274:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518689.713276:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518689.713278:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789518689.713322:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec28aea00/2, rc 0, transno 30064771217 00000100:00100000:1.0:1789518689.713328:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627675264:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789518689.713745:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff78aa300/2, rc 0, transno 30064771282 00000100:00100000:2.0:1789518689.713751:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627675776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789518689.714326:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.714747:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617479680 00000100:00100000:1.0:1789518689.714754:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617479680 00010000:00010000:1.0:1789518689.714781:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 16 pid: 36533 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.714814:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1789518689.714824:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617479680:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518689.714837:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518689.714843:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 16 pid: 36533 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.714855:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 16 pid: 36533 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.714874:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa8dddb1/0x631fd8698c787532 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe145 expref: 16 pid: 36533 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.714900:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518689.714904:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518689.714909:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.714931:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.714956:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518689.714998:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617479680:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 176us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.715005:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00010000:00010000:3.0:1789518689.715557:0:36533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.715569:0:36533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.715578:0:36533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.716352:0:36533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.716376:0:36533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518689.716509:0:35834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518689.716516:0:35834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.716525:0:35834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14ca00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518689.716529:0:35834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.716538:0:35834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.716554:0:35834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.716561:0:35834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f25ba1/0x631fd8698c787826 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.716578:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518689.716580:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518689.716582:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518689.717280:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedcdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3282:x1876445627675648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7109us (7181us total) trans 30064771283 rc 0/0 00000100:00100000:3.0:1789518689.717291:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000004:00080000:3.0:1789518689.717485:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff78a8e00/2, rc 0, transno 30064771283 00000100:00100000:3.0:1789518689.717491:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627675648:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789518689.748152:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771215 is committed 00000001:00080000:2.0:1789518689.748275:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771217 is committed 00000100:00100000:1.0:1789518689.748423:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617479552:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 35272us (36613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.748433:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:1.0:1789518689.752103:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.752332:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617479936 00000100:00100000:0.0:1789518689.752341:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617479936 00000100:00100000:0.0:1789518689.752534:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 518 00000100:00100000:0.0:1789518689.752546:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:40538:x1876445617479936:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518689.752600:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518689.752646:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787803 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe21e expref: 55 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.752667:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:0.0:1789518689.752672:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518689.752706:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.752721:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.752731:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518689.752968:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005edc37ce reply state 000000000dcaa30a transno 30064771532 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.752977:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518689.753124:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:40538:x1876445617479936:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 580us (1314us total) trans 30064771532 rc 0/0 00000100:00100000:0.0:1789518689.753131:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 518 00010000:00010000:2.0:1789518689.754346:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.754358:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.754365:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.754371:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518689.754375:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.754381:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.754398:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:2.0:1789518689.754401:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518689.754404:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.754411:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c78782d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.756467:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.756585:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617480064 00000100:00100000:0.0:1789518689.756597:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617480064 00000100:00100000:0.0:1789518689.756750:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:0.0:1789518689.756770:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2345:x1876445617480064:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789518689.757251:0:36532:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb size from disk: 24 -> 24 00002000:00010000:0.0:1789518689.757266:0:36532:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb mtime from disk: 1789518690 -> 1789518689 00002000:00010000:0.0:1789518689.757271:0:36532:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb atime from disk: 0 -> 1789518689 00002000:00010000:0.0:1789518689.757273:0:36532:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb ctime from disk: 1789518690 -> 1789518689 00002000:00010000:0.0:1789518689.757276:0:36532:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789518689.757594:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2345:x1876445617480064:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 831us (1138us total) trans 30064771218 rc 0/0 00000100:00100000:0.0:1789518689.757606:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:0.0:1789518689.761034:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518689.761161:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617480320 00000100:00100000:3.0:1789518689.761172:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617480320 00000100:00100000:3.0:1789518689.761233:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 519 00000100:00100000:3.0:1789518689.761243:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:40538:x1876445617480320:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789518689.761320:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.761337:0:35846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe210 expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.761344:0:35846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.761372:0:35846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe210 expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.761382:0:35846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe210 expref: 55 pid: 35847 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.761396:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627676032:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518689.761592:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518689.765268:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518689.765291:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627676032:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518689.765322:0:35846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.765348:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617480448 00000100:00100000:1.0:1789518689.765356:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617480448 00010000:00010000:1.0:1789518689.765390:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe210 expref: 56 pid: 35847 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.765428:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:1.0:1789518689.765438:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617480448:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518689.765452:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518689.765473:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe210 expref: 56 pid: 35847 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.765485:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe210 expref: 56 pid: 35847 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.765505:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7877e7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe210 expref: 56 pid: 35847 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.765518:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:1.0:1789518689.765523:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.765531:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.765538:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.765569:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518689.765646:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:2343:x1876445617480448:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 209us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.765654:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00010000:00010000:0.0:1789518689.766008:0:35846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.766017:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.766046:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.766053:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.766059:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.766064:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14da00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518689.766068:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.766075:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.766084:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:0.0:1789518689.766087:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789518689.766090:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.766095:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14da00/0x631fd8698c787834 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.766180:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:40538:x1876445617480320:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 4939us (5155us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789518689.766188:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 519 00000100:00100000:2.0:1789518689.768084:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518689.768167:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617480576 00000100:00100000:3.0:1789518689.768175:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617480576 00000100:00100000:3.0:1789518689.768253:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:3.0:1789518689.768292:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617480576:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789518689.768333:0:37973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.768363:0:37973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 12 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.768375:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518689.768379:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518689.768383:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.768413:0:37973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 12 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.768426:0:37973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 12 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.768440:0:37973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:37973:1876445627676160:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518689.768508:0:37973:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518689.770174:0:37973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:37973:1876445627676160:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518689.770198:0:37973:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518689.770579:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.774768:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617480704 00000100:00100000:1.0:1789518689.774782:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617480704 00010000:00010000:1.0:1789518689.774832:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 13 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.775000:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:1.0:1789518689.775015:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1081c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617480704:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518689.775053:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518689.775077:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 13 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.775091:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 13 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.775113:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cf648f9/0x631fd8698c787811 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe22c expref: 13 pid: 36532 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.775129:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518689.775133:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789518689.775138:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.775148:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.775182:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518689.775239:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1081c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2343:x1876445617480704:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 226us (4660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.775246:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00010000:00010000:3.0:1789518689.775343:0:37973:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.775360:0:37973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.775384:0:37973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.775392:0:37973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.775401:0:37973:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.775407:0:37973:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518689.775411:0:37973:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.775419:0:37973:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.775432:0:37973:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.775441:0:37973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbd302ad/0x631fd8698c78783b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.775510:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617480576:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 7220us (7430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518689.775517:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:2.0:1789518689.777862:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518689.777970:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617480960 00000100:00100000:3.0:1789518689.777978:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617480960 00000100:00100000:3.0:1789518689.778024:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 520 00000100:00100000:3.0:1789518689.778034:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:40538:x1876445617480960:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789518689.778118:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.778133:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.778144:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.778361:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.778373:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe217 expref: 55 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.778381:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.778413:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe217 expref: 55 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.778450:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe217 expref: 55 pid: 35846 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.778465:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627676288:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518689.778543:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518689.780762:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627676288:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518689.780788:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518689.781732:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.781848:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617481088 00000100:00100000:1.0:1789518689.781856:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617481088 00010000:00010000:1.0:1789518689.781888:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe217 expref: 56 pid: 35846 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518689.781942:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:1.0:1789518689.781951:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617481088:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518689.781964:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518689.781971:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe217 expref: 56 pid: 35846 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.781981:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe217 expref: 56 pid: 35846 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.781999:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c7877f5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe217 expref: 56 pid: 35846 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.782015:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:1.0:1789518689.782020:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.782028:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.782036:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518689.782129:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518689.782176:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:2342:x1876445617481088:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 225us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.782184:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00010000:00010000:3.0:1789518689.782700:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.782710:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518689.782877:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771533 00000001:00080000:3.0:1789518689.783025:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771534 00000001:00080000:3.0:1789518689.783073:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771535 00000100:00100000:3.0:1789518689.783166:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627676416:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518689.784159:0:37723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518689.784224:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518689.784472:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627676416 00000100:00100000:1.0:1789518689.784491:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627676416 00000100:00100000:1.0:1789518689.784576:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789518689.784585:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627676416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518689.784698:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627676416:12345-0@lo:1000:mdt00_003.0 Request processed in 113us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.784706:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789518689.784777:0:37723:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771217 gen 2 00000004:00080000:3.0:1789518689.784784:0:37723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec25cce00, transno 30064771213 00000004:00080000:3.0:1789518689.784799:0:37723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec28ad180, transno 30064771216 00000004:00080000:3.0:1789518689.784803:0:37723:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec28aea00, transno 30064771217 00000100:00100000:3.0:1789518689.785648:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627676416:0@lo:1000:mdt00_003.0 00000004:00080000:0.0:1789518689.785830:0:35867:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:2.0:1789518689.786130:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771536 00000100:00100000:2.0:1789518689.786201:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627676544:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789518689.786248:0:37723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518689.786285:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789518689.786471:0:39259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627676544 00000100:00100000:1.0:1789518689.786477:0:39259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627676544 00000100:00100000:1.0:1789518689.786645:0:39259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789518689.786655:0:39259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:37723:x1876445627676544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789518689.786845:0:39259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:37723:x1876445627676544:12345-0@lo:1000:mdt00_003.0 Request processed in 191us (596us total) trans 30064771219 rc 0/0 00000100:00100000:1.0:1789518689.786853:0:39259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789518689.786930:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37723:1876445627676544:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789518689.787023:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771537 00010000:00010000:3.0:1789518689.787054:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.787064:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.787073:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.787078:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14ca00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518689.787095:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.787103:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.787117:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99fff6905c00) 00010000:00010000:3.0:1789518689.787120:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518689.787124:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.787130:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787849 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.787159:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.787166:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.787171:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.788372:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14cc00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518689.788377:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.788386:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.788399:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:3.0:1789518689.788402:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518689.788412:0:37723:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 59 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.788425:0:37723:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 59 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.788434:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 59 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.789182:0:37723:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 59 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518689.789202:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627676672:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518689.789388:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789518689.792400:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518689.792475:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617481216 00000100:00100000:1.0:1789518689.792484:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617481216 00000100:00100000:1.0:1789518689.792546:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:1.0:1789518689.792556:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:40536:x1876445617481216:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:1.0:1789518689.792711:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:40536:x1876445617481216:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 157us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518689.792719:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:0.0:1789518689.792951:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627676672:192.168.206.51@tcp:105: 00010000:00010000:0.0:1789518689.792980:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.792990:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14cc00/0x631fd8698c787777 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793021:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793034:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793059:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793070:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793076:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793086:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793092:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518689.793095:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793103:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793113:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518689.793116:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518689.793120:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793126:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787850 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793135:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793141:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793147:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793151:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14de00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518689.793154:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793163:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793169:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518689.793171:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518689.793174:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.793179:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14de00/0x631fd8698c787842 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.793390:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:40538:x1876445617480960:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 15356us (15534us total) trans 30064771538 rc 0/0 00000100:00100000:0.0:1789518689.793399:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 520 00000020:00080000:0.0:1789518689.793403:0:37723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1789518689.793755:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518689.793760:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518689.794344:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 6 00000040:00080000:1.0:1789518689.794407:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518689.795313:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518689.795415:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518689.795503:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617481600 00000100:00100000:2.0:1789518689.795511:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617481600 00000100:00100000:2.0:1789518689.795559:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:2.0:1789518689.795569:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:40536:x1876445617481600:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518689.795583:0:36735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518689.795603:0:36735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe233 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518689.795659:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 24, mtime: 0x6aa9e361, atime: 0x6aa9e361, ctime: 0x6aa9e361, blocks: 0xb 00010000:00010000:2.0:1789518689.795678:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=743s v=(0 0) 00010000:00010000:2.0:1789518689.795682:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518689.795691:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe233 expref: 12 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.795705:0:36735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe233 expref: 12 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518689.795716:0:36735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900800, rc 0) 00000100:00100000:2.0:1789518689.795757:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:40536:x1876445617481600:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 190us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518689.795763:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:1.0:1789518689.796111:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617481472 00000100:00100000:1.0:1789518689.796116:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617481472 00000100:00100000:1.0:1789518689.796190:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:1.0:1789518689.796210:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:40538:x1876445617481472:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789518689.796880:0:35849:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x34:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789518689.797557:0:35849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771539 00010000:00010000:0.0:1789518689.797647:0:35849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.797666:0:35849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.797681:0:35849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.797690:0:35849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.797696:0:35849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.797703:0:35849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518689.797721:0:35849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518689.797744:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518689.797753:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.797775:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518689.797780:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.797789:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.797803:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff99ffc2d97200) 00010000:00010000:3.0:1789518689.797805:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518689.797810:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518689.797817:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c78785e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518689.797819:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:40538:x1876445617481472:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1604us (2505us total) trans 30064771540 rc 0/0 00000100:00100000:0.0:1789518689.797836:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000020:00080000:0.0:1789518689.797841:0:35849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518689.797923:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518689.797926:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518689.797928:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518689.798089:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518689.798382:0:36538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617481728 00000100:00100000:0.0:1789518689.798569:0:36538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617481728 00002000:00100000:0.0:1789518689.798607:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcf:0x0] (0->4095) req@ffff99fec3476300 x1876445617481728/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:335/0 lens 488/0 e 0 to 0 dl 1789518700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518689.798648:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3476300 with x1876445617481728 ext(0->4095) 00002000:00010000:0.0:1789518689.798654:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec3476300 00000100:00100000:0.0:1789518689.798740:0:36538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 370 00000100:00100000:0.0:1789518689.798751:0:36538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617481728:12345-192.168.206.51@tcp:3:lfs.0 00000100:00100000:0.0:1789518689.798902:0:36538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617481728:12345-192.168.206.51@tcp:3:lfs.0 Request processed in 153us (814us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789518689.798909:0:36538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 370 00002000:00100000:0.0:1789518689.798916:0:36538:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcf:0x0] (0->4095) req@ffff99fec3476300 x1876445617481728/t0(0) o3->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:335/0 lens 488/4536 e 0 to 0 dl 1789518700 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789518689.798925:0:36538:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec3476300 with x1876445617481728 ext(0->4095) 00002000:00010000:0.0:1789518689.798928:0:36538:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fec3476300 00010000:00010000:1.0:1789518690.162759:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518691.186887:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518691.443056:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627676800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518691.443128:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518691.443228:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627676800 00000100:00100000:2.0:1789518691.443237:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627676800 00000100:00100000:2.0:1789518691.443310:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789518691.443322:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627676800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518691.443355:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518691.443489:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627676800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518691.443498:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789518691.443516:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518691.445723:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627676800:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789518691.474568:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771282 is committed 00000001:00080000:0.0:1789518691.474587:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771280 is committed 00000001:00080000:0.0:1789518691.474596:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771283 is committed 00000100:00100000:1.0:1789518691.954919:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627676928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518691.955011:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518691.955331:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627677312:0@lo:400:kworker.0 00000100:00100000:3.0:1789518691.955365:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518691.955387:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518691.955393:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627677184:0@lo:400:kworker.0 00000100:00100000:3.0:1789518691.955414:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518691.955439:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627677312 00000100:00100000:3.0:1789518691.955460:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627677312 00000100:00100000:3.0:1789518691.955505:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627677184 00000100:00100000:3.0:1789518691.955508:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627677184 00000100:00100000:3.0:1789518691.955824:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789518691.955984:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627676928 00000100:00100000:0.0:1789518691.955990:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627676928 00000100:00100000:0.0:1789518691.956025:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518691.956034:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627676928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518691.956088:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518691.956153:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627676928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518691.956160:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789518691.956215:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627677056:0@lo:400:kworker.0 00000100:00100000:0.0:1789518691.956261:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518691.956292:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518691.956298:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627677440:0@lo:400:kworker.0 00000100:00100000:0.0:1789518691.956322:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518691.956359:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627677440 00000100:00100000:0.0:1789518691.956363:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627677440 00000100:00100000:3.0:1789518691.956390:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627677312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518691.956429:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771283 gen 2 00000004:00080000:1.0:1789518691.956437:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771281 committed transno 30064771283 00000100:00100000:3.0:1789518691.956440:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627677312:12345-0@lo:400:kworker.0 Request processed in 606us (1073us total) trans 0 rc 0/0 00000004:00080000:1.0:1789518691.956456:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff78aa300, transno 30064771282 00000004:00080000:1.0:1789518691.956468:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff78a8e00, transno 30064771283 00000100:00100000:1.0:1789518691.956484:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627676928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518691.957348:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789518691.957361:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627677184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518691.957408:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627677184:12345-0@lo:400:kworker.0 Request processed in 51us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518691.957416:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789518691.957427:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789518691.957439:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627677440:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518691.957457:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518691.957463:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518691.957478:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627677056 00000100:00100000:2.0:1789518691.957484:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627677056 00000100:00100000:0.0:1789518691.957486:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627677440:12345-0@lo:400:kworker.0 Request processed in 50us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518691.957494:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789518691.957524:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789518691.957533:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627677056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518691.957535:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627677440:0@lo:400:kworker.0 00000100:00100000:2.0:1789518691.957584:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627677056:12345-0@lo:400:kworker.0 Request processed in 51us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518691.957591:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627677184:0@lo:400:kworker.0 00000100:00100000:2.0:1789518691.957592:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789518691.957608:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627677312:0@lo:400:kworker.0 00000100:00100000:0.0:1789518691.957647:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627677056:0@lo:400:kworker.0 00000100:00100000:3.0:1789518691.957728:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:3.0:1789518692.210859:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518692.332060:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518692.332964:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617481856 00000100:00100000:2.0:1789518692.332976:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617481856 00000100:00100000:2.0:1789518692.333119:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 521 00000100:00100000:2.0:1789518692.333132:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:40541:x1876445617481856:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518692.333161:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518692.333183:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c787865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe23a expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518692.333256:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78786c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518692.333269:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78786c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518692.333280:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78786c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518692.333310:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789518692.333314:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518692.333330:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78786c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518692.333351:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901000/0x631fd8698c787865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe23a expref: 63 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518692.333368:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78786c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe23a expref: 62 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518692.333375:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905500) 00010000:00010000:2.0:1789518692.333378:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518692.333381:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901c00, rc 0) 00000100:00100000:2.0:1789518692.333502:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:40541:x1876445617481856:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 372us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518692.333510:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 521 00000100:00080000:0.0:1789518692.334233:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518692.339388:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518692.341296:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617481984 00000100:00100000:0.0:1789518692.341313:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617481984 00000100:00100000:0.0:1789518692.341392:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 522 00000100:00100000:0.0:1789518692.341403:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:40541:x1876445617481984:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518692.341424:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518692.341445:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe241 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.341506:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.341520:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.341531:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.341545:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.341551:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.341557:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.341786:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.341799:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.341805:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518692.341973:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:0.0:1789518692.341978:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518692.341996:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342005:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342012:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342018:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342024:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342029:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518692.342032:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342039:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342048:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905500) 00010000:00010000:0.0:1789518692.342051:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518692.342056:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342061:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c78787a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342072:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342077:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342082:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342086:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518692.342088:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342093:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342098:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518692.342100:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518692.342258:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342267:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787881 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342300:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe241 expref: 64 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342318:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe241 expref: 63 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.342326:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518692.342328:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518692.342331:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22600, rc 0) 00000100:00100000:0.0:1789518692.342399:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:40541:x1876445617481984:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 998us (3019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518692.342406:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 522 00000040:00080000:0.0:1789518692.799135:0:40494:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518692.799145:0:40494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518692.799205:0:40494:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 6 00000040:00080000:0.0:1789518692.799211:0:40494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789518692.834883:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518692.834973:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617482240 00000100:00100000:3.0:1789518692.834981:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617482240 00000100:00100000:3.0:1789518692.835034:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 523 00000100:00100000:3.0:1789518692.836474:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:40552:x1876445617482240:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:3.0:1789518692.837003:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].11, 136 off9688 00000100:00100000:3.0:1789518692.837170:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:40552:x1876445617482240:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 708us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518692.837180:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 523 00000040:00080000:2.0:1789518692.850981:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518692.850990:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518692.851035:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 7 00000040:00080000:2.0:1789518692.851043:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518692.851174:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627677568:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518692.851275:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc13773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518692.853484:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627677568:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518692.854377:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518692.854511:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617482368 00000100:00100000:3.0:1789518692.854519:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617482368 00000100:00100000:3.0:1789518692.854675:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 524 00000100:00100000:3.0:1789518692.854686:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:40553:x1876445617482368:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789518692.854721:0:35847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789518692.854802:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:40553:x1876445617482368:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 118us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518692.854809:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 524 00000100:00100000:0.0:1789518692.856381:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518692.856464:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617482624 00000100:00100000:1.0:1789518692.856471:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617482624 00000100:00100000:1.0:1789518692.856523:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 525 00000100:00100000:1.0:1789518692.856533:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:40553:x1876445617482624:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518692.856547:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518692.856565:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c78788f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe248 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856661:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856675:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856686:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518692.856707:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:1.0:1789518692.856799:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856807:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856812:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856817:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518692.856821:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856829:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856840:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518692.856844:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789518692.856849:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856854:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787896 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856893:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c78788f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe248 expref: 65 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856903:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518692.856905:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789518692.856916:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380000/0x631fd8698c78788f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe248 expref: 65 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518692.856926:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380000, rc 0) 00000100:00100000:1.0:1789518692.856980:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:40553:x1876445617482624:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 447us (601us total) trans 30064771541 rc 301/301 00000100:00100000:1.0:1789518692.856987:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 525 00000100:00100000:1.0:1789518692.861240:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518692.861306:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617482880 00000100:00100000:0.0:1789518692.861315:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617482880 00000100:00100000:0.0:1789518692.861375:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 526 00000100:00100000:0.0:1789518692.861385:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:40553:x1876445617482880:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789518692.861464:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.861482:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.861499:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.861701:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.861710:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.861717:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.861723:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518692.861728:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.861735:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.861748:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518692.861751:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789518692.861756:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518692.861761:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c7878a4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518692.861920:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+65:40553:x1876445617482880:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 536us (688us total) trans 30064771542 rc 0/0 00000100:00100000:0.0:1789518692.861929:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 526 00000040:00080000:2.0:1789518692.862040:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518692.862046:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518692.862553:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 7 00000040:00080000:2.0:1789518692.862560:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518692.864793:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518692.865070:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617483136 00000100:00100000:0.0:1789518692.865079:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617483136 00000100:00100000:0.0:1789518692.865129:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:0.0:1789518692.865136:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+65:40553:x1876445617483136:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518692.865379:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:40553:x1876445617483136:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 233us (754us total) trans 30064771543 rc 0/0 00000100:00100000:0.0:1789518692.865387:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00010000:00010000:1.0:1789518693.234972:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518693.262076:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518693.262124:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518693.262182:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518693.262186:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617483264 00000100:00100000:0.0:1789518693.262199:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617483264 00000100:00100000:3.0:1789518693.262235:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518693.262252:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617483520 00000100:00100000:2.0:1789518693.262260:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617483520 00000100:00100000:0.0:1789518693.262286:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:3.0:1789518693.262298:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617483648 00000100:00100000:0.0:1789518693.262302:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617483264:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518693.262308:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617483648 00000100:00100000:2.0:1789518693.262328:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617483392 00000100:00100000:2.0:1789518693.262334:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617483392 00000100:00100000:2.0:1789518693.262375:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:2.0:1789518693.262389:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617483520:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518693.262398:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:0.0:1789518693.262399:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617483264:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 96us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518693.262411:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:3.0:1789518693.262440:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617483648:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518693.262449:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617483520:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 54us (313us total) trans 0 rc 0/0 00000100:00080000:0.0:1789518693.262454:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518693.262460:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00080000:0.0:1789518693.262463:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518693.262467:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518693.262483:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:2.0:1789518693.262494:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617483392:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518693.262513:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617483648:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518693.262524:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:2.0:1789518693.262545:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617483392:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518693.262554:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00010000:00010000:0.0:1789518694.259101:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789518695.059428:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771218 is committed 00000001:00080000:1.0:1789518695.059443:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771219 is committed 00000001:00080000:3.0:1789518695.063375:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771543 is committed 00000020:00080000:3.0:1789518695.063679:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803906 batchid updated 00000020:00080000:1.0:1789518695.063709:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803906 00000020:00080000:1.0:1789518695.063723:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803906 00000020:00080000:3.0:1789518695.063962:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffee68ccc0 refcount 2 committed 0 result 0 batchid 25769803907 00000020:00080000:3.0:1789518695.063968:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fffdc2ed00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffee68c840 00000020:00080000:3.0:1789518695.063972:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fffdc2ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fec9417400 00000020:00080000:1.0:1789518695.063998:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803907 committed batchid 25769803906 00000020:00080000:1.0:1789518695.064189:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803906 00010000:00010000:3.0:1789518695.282801:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518696.306786:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518696.562960:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518696.562981:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627677696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518696.563041:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518696.563135:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627677696 00000100:00100000:2.0:1789518696.563143:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627677696 00000100:00100000:2.0:1789518696.563207:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789518696.563215:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627677696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518696.563256:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518696.563301:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627677696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518696.563308:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789518696.563744:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518696.563984:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771219 gen 2 00000004:00080000:0.0:1789518696.563990:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771219 committed transno 30064771219 00000100:00100000:0.0:1789518696.564020:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627677696:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789518696.947666:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518696.947675:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518696.947718:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 7 00000040:00080000:2.0:1789518696.947726:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518697.074922:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518697.074947:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627677824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518697.075019:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518697.075067:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627677824 00000100:00100000:0.0:1789518697.075075:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627677824 00000100:00100000:3.0:1789518697.075089:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627677952:0@lo:400:kworker.0 00000100:00100000:3.0:1789518697.075126:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518697.075146:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789518697.075158:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627677824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518697.075189:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518697.075246:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627677824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518697.075252:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789518697.075309:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627678080:0@lo:400:kworker.0 00000100:00100000:1.0:1789518697.075343:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518697.075371:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627678080 00000100:00100000:1.0:1789518697.075375:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627678080 00000100:00100000:1.0:1789518697.075405:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789518697.075412:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627678080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518697.075448:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627678080:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518697.075454:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789518697.075491:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627678208:0@lo:400:kworker.0 00000100:00100000:1.0:1789518697.075515:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518697.075546:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627678208 00000100:00100000:1.0:1789518697.075550:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627678208 00000100:00100000:1.0:1789518697.075573:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518697.075578:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627678208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518697.075611:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627678208:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518697.075633:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789518697.075660:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518697.075751:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627678464:0@lo:400:kworker.0 00000100:00100000:3.0:1789518697.075783:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518697.075976:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627678080:0@lo:400:kworker.0 00000100:00100000:1.0:1789518697.075986:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627678592:0@lo:400:kworker.0 00000100:00100000:3.0:1789518697.076040:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627677824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518697.076049:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627677952 00000100:00100000:2.0:1789518697.076055:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627677952 00000100:00100000:3.0:1789518697.076060:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518697.076068:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffefff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627678336:0@lo:400:kworker.0 00000100:00100000:2.0:1789518697.076089:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789518697.076102:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627677952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518697.076104:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518697.076188:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627678464 00000100:00100000:0.0:1789518697.076198:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627678464 00000100:00100000:0.0:1789518697.076242:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627678336 00000100:00100000:0.0:1789518697.076246:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627678336 00000100:00100000:0.0:1789518697.076266:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789518697.076274:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627678464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518697.078716:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627677952:12345-0@lo:400:kworker.0 Request processed in 2611us (3580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518697.078730:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789518697.078815:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789518697.078827:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627678336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518697.078875:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627678336:12345-0@lo:400:kworker.0 Request processed in 52us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518697.078880:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789518697.079017:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627678208:0@lo:400:kworker.0 00000100:00080000:2.0:1789518697.079049:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518697.079115:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518697.079251:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627678592 00000100:00100000:2.0:1789518697.079258:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627678592 00000100:00100000:2.0:1789518697.079301:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789518697.079307:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627678592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518697.079340:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627678592:12345-0@lo:400:kworker.0 Request processed in 33us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518697.079345:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789518697.079401:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518697.079421:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627678592:0@lo:400:kworker.0 00000100:00100000:3.0:1789518697.081793:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffefff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627678336:0@lo:400:kworker.0 00000100:00100000:3.0:1789518697.081885:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627677952:0@lo:400:kworker.0 00000100:00100000:0.0:1789518697.082139:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627678464:12345-0@lo:400:kworker.0 Request processed in 5863us (6352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518697.082149:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789518697.082285:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627678464:0@lo:400:kworker.0 00010000:00010000:0.0:1789518697.330808:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518698.355489:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518698.381781:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518698.381825:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518698.381854:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518698.381915:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518698.381933:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518698.381986:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617483904 00000100:00100000:2.0:1789518698.381993:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617483904 00000100:00100000:2.0:1789518698.382047:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617484288 00000100:00100000:2.0:1789518698.382050:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617484288 00000100:00100000:2.0:1789518698.382074:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:2.0:1789518698.382084:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:2343:x1876445617483904:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518698.382152:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:2343:x1876445617483904:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 71us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518698.382158:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:2.0:1789518698.382171:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:2.0:1789518698.382175:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617484288:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518698.382194:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617484288:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 18us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518698.382199:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 86 00000100:00100000:0.0:1789518698.382422:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617483776 00000100:00100000:0.0:1789518698.382427:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617483776 00000100:00100000:0.0:1789518698.382466:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:0.0:1789518698.382473:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617483776:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518698.382506:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617483776:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518698.382512:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00080000:0.0:1789518698.382564:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518698.383229:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617484032 00000100:00100000:3.0:1789518698.383235:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617484032 00000100:00100000:3.0:1789518698.383328:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617484160 00000100:00100000:3.0:1789518698.383332:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617484160 00000100:00080000:1.0:1789518698.383407:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518698.383410:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518698.383984:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1789518698.383995:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617484032:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518698.384138:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617484032:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 145us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518698.384145:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:0.0:1789518698.384160:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:0.0:1789518698.384167:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617484160:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518698.384206:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617484160:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 40us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518698.384213:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00010000:00010000:1.0:1789518699.379130:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789518700.170566:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803907 batchid updated 00000020:00080000:1.0:1789518700.170707:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00000020:00080000:1.0:1789518700.170719:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00010000:00010000:0.0:1789518700.403933:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518701.426821:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518701.683127:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627678720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518701.683218:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518701.683494:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627678720 00000100:00100000:1.0:1789518701.683503:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627678720 00000100:00100000:1.0:1789518701.683565:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789518701.683574:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627678720:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518701.683711:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789518701.683968:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:1.0:1789518701.684039:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627678720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 466us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518701.684047:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789518701.684139:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627678720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518702.195017:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627679104:0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195085:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518702.195146:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518702.195153:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc52bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627679232:0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195180:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518702.195226:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627679104 00000100:00100000:1.0:1789518702.195234:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627679104 00000100:00100000:3.0:1789518702.195247:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627678976:0@lo:400:kworker.0 00000100:00100000:2.0:1789518702.195288:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627678848:0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195294:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518702.195305:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627679104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518702.195340:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518702.195372:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627679104:12345-0@lo:400:kworker.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518702.195373:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc52bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627679360:0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195385:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518702.195411:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627679232 00000100:00100000:1.0:1789518702.195416:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627679232 00000100:00100000:3.0:1789518702.195422:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518702.195423:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518702.195448:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627679360 00000100:00100000:3.0:1789518702.195450:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627679488:0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195452:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627679360 00000100:00100000:2.0:1789518702.195469:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627678848 00000100:00100000:2.0:1789518702.195474:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627678848 00000100:00100000:1.0:1789518702.195488:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789518702.195490:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518702.195500:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627679232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518702.195514:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789518702.195524:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627678848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195545:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627679232:12345-0@lo:400:kworker.0 Request processed in 48us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518702.195554:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789518702.195568:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627678848:12345-0@lo:400:kworker.0 Request processed in 46us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518702.195569:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627679488 00000100:00100000:1.0:1789518702.195574:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627679488 00000100:00100000:2.0:1789518702.195579:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789518702.195597:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789518702.195604:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627679360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518702.195637:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789518702.195647:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627679488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195664:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627679360:12345-0@lo:400:kworker.0 Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518702.195671:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789518702.195691:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627679488:12345-0@lo:400:kworker.0 Request processed in 46us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518702.195694:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627678976 00000100:00100000:1.0:1789518702.195700:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627678976 00000100:00100000:2.0:1789518702.195701:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789518702.195741:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627678848:0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195741:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789518702.195747:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627679488:0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195753:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627678976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518702.195775:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc52bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627679360:0@lo:400:kworker.0 00000100:00080000:2.0:1789518702.195785:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518702.195792:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518702.195803:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627678976:12345-0@lo:400:kworker.0 Request processed in 52us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518702.195811:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789518702.195823:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc52bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627679232:0@lo:400:kworker.0 00000100:00100000:2.0:1789518702.195838:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627679104:0@lo:400:kworker.0 00000100:00100000:1.0:1789518702.195851:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627678976:0@lo:400:kworker.0 00000100:00100000:3.0:1789518702.196037:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518702.196047:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627679616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518702.196085:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518702.197729:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627679616 00000100:00100000:0.0:1789518702.197739:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627679616 00000100:00100000:0.0:1789518702.197796:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789518702.197806:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627679616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518702.197838:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518702.197909:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627679616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518702.197916:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789518702.198462:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627679616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789518702.450847:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518703.476645:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518703.504568:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518703.504695:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518703.504731:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518703.504769:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518703.504786:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617484416 00000100:00100000:3.0:1789518703.504796:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617484416 00000100:00100000:0.0:1789518703.504802:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518703.504848:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:3.0:1789518703.504860:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617484416:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518703.504863:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617484800 00000100:00100000:2.0:1789518703.504869:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617484800 00000100:00100000:2.0:1789518703.504917:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617484672 00000100:00100000:2.0:1789518703.504921:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617484672 00000100:00100000:3.0:1789518703.504930:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617484416:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518703.504940:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:2.0:1789518703.504946:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:2.0:1789518703.504956:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617484800:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518703.504991:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617484800:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 37us (295us total) trans 0 rc 0/0 00000100:00080000:3.0:1789518703.504992:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518703.504999:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518703.505002:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:2.0:1789518703.505019:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:2.0:1789518703.505027:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617484672:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518703.505052:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617484672:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518703.505059:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:1.0:1789518703.505352:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617484544 00000100:00100000:1.0:1789518703.505357:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617484544 00000100:00100000:2.0:1789518703.505447:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617484928 00000100:00100000:2.0:1789518703.505452:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617484928 00000100:00080000:3.0:1789518703.505891:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518703.505919:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:1.0:1789518703.505931:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:2342:x1876445617484544:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518703.505946:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1789518703.505956:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617484928:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518703.506025:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:2342:x1876445617484544:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 96us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518703.506033:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1789518703.506302:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617484928:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 347us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518703.506984:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00010000:00010000:3.0:1789518704.501939:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518705.522809:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518706.163087:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518706.163096:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518706.163521:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 5 00000040:00080000:2.0:1789518706.163529:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789518706.546815:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518706.802939:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627679744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518706.803013:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518706.803355:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627679744 00000100:00100000:0.0:1789518706.803364:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627679744 00000100:00100000:0.0:1789518706.803424:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789518706.803435:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627679744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518706.803469:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518706.803525:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627679744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518706.803532:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789518706.803574:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627679744:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789518706.803853:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518707.315157:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518707.315240:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627680000:0@lo:400:kworker.0 00000100:00100000:1.0:1789518707.315303:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518707.315344:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffbb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627680128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518707.315377:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627679872:0@lo:400:kworker.0 00000100:00100000:0.0:1789518707.315384:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518707.315412:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518707.315449:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627680000 00000100:00100000:3.0:1789518707.315456:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627680000 00000100:00100000:0.0:1789518707.315476:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627680128 00000100:00100000:0.0:1789518707.315480:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627680128 00000100:00100000:1.0:1789518707.315500:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627679872 00000100:00100000:3.0:1789518707.315505:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789518707.315507:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627679872 00000100:00100000:3.0:1789518707.315515:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627680000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518707.315515:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789518707.315535:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627680128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518707.315544:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789518707.315553:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627679872:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789518707.315564:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518707.315571:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627680000:12345-0@lo:400:kworker.0 Request processed in 58us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518707.315578:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789518707.315597:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627679872:12345-0@lo:400:kworker.0 Request processed in 45us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518707.315638:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627680128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518707.315647:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789518707.315652:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1789518707.315653:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518707.315700:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffbb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627680128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518707.315702:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627680000:0@lo:400:kworker.0 00000100:00100000:1.0:1789518707.315717:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627679872:0@lo:400:kworker.0 00000100:00100000:3.0:1789518707.316159:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627680256:0@lo:400:kworker.0 00000100:00100000:3.0:1789518707.316204:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518707.316317:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627680384:0@lo:400:kworker.0 00000100:00100000:0.0:1789518707.316320:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627680256 00000100:00100000:0.0:1789518707.316326:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627680256 00000100:00100000:2.0:1789518707.316352:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518707.316396:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627680384 00000100:00100000:0.0:1789518707.316401:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627680384 00000100:00100000:1.0:1789518707.316415:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffeda68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627680512:0@lo:400:kworker.0 00000100:00100000:0.0:1789518707.316434:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789518707.316442:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627680256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518707.316483:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789518707.316496:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627680384:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789518707.316651:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518707.316843:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627680256:12345-0@lo:400:kworker.0 Request processed in 401us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518707.316852:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789518707.316873:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627680384:12345-0@lo:400:kworker.0 Request processed in 380us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518707.316882:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789518707.316916:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627680384:0@lo:400:kworker.0 00000100:00100000:3.0:1789518707.316992:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627680256:0@lo:400:kworker.0 00000100:00100000:1.0:1789518707.317081:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518707.317164:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627680512 00000100:00100000:2.0:1789518707.317169:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627680512 00000100:00100000:2.0:1789518707.317271:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789518707.317279:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627680512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518707.317334:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627680512:12345-0@lo:400:kworker.0 Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518707.317341:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789518707.317469:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffeda68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627680512:0@lo:400:kworker.0 00000100:00080000:3.0:1789518707.317500:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518707.571193:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518708.595081:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518708.622819:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518708.622862:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518708.622897:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518708.622925:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518708.622997:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617485312 00000100:00100000:0.0:1789518708.623007:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617485312 00000100:00100000:0.0:1789518708.623066:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617485440 00000100:00100000:0.0:1789518708.623068:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617485440 00000100:00100000:0.0:1789518708.623089:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:0.0:1789518708.623098:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617485312:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518708.623120:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617485056 00000100:00100000:3.0:1789518708.623126:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617485056 00000100:00100000:3.0:1789518708.623161:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:0.0:1789518708.623178:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617485312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518708.623187:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617485056:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518708.623197:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:0.0:1789518708.623216:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:3.0:1789518708.623222:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617485056:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518708.623228:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617485440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518708.623236:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:0.0:1789518708.623259:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617485440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518708.623266:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00080000:0.0:1789518708.623285:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518708.623288:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518708.623406:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518708.623414:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617485184 00000100:00100000:1.0:1789518708.623420:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617485184 00000100:00080000:2.0:1789518708.623453:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518708.623467:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617485568 00000100:00100000:1.0:1789518708.623472:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617485568 00000100:00100000:2.0:1789518708.623482:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:2.0:1789518708.623492:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:2342:x1876445617485184:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518708.623508:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:1.0:1789518708.623518:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617485568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:3.0:1789518708.623544:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518708.623552:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617485568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518708.623560:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:2.0:1789518708.623666:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:2342:x1876445617485184:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 175us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518708.623673:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00010000:00010000:0.0:1789518709.618894:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518709.889754:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518709.889828:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617485696 00000100:00100000:3.0:1789518709.889838:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617485696 00000100:00100000:3.0:1789518709.889895:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:3.0:1789518709.889905:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2343:x1876445617485696:12345-192.168.206.51@tcp:1:lfs.0 00010000:00010000:3.0:1789518709.889949:0:36532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518709.889970:0:36532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe233 expref: 11 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518709.889980:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=20s v=(0 0) 00010000:00010000:3.0:1789518709.889985:0:36532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518709.889990:0:36532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 4/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518709.890024:0:36532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe233 expref: 11 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518709.890067:0:36532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe233 expref: 11 pid: 36735 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518709.890082:0:36532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627680640:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518709.890197:0:36532:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518709.892181:0:36532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:36532:1876445627680640:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518709.892208:0:36532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518709.892561:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518709.893135:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617485824 00000100:00100000:1.0:1789518709.893144:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617485824 00010000:00010000:1.0:1789518709.893193:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe233 expref: 12 pid: 36735 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518709.893275:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 94 00000100:00100000:1.0:1789518709.893286:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+12:2342:x1876445617485824:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518709.893302:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518709.893326:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe233 expref: 12 pid: 36735 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518709.893339:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe233 expref: 12 pid: 36735 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518709.893360:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000421f29a4/0x631fd8698c787857 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe233 expref: 12 pid: 36735 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518709.893377:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518709.893380:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518709.893385:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518709.893395:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518709.893431:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518709.893534:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+11:2342:x1876445617485824:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 250us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518709.893545:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 94 00010000:00010000:0.0:1789518709.893598:0:36532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.893607:0:36532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.893646:0:36532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.893654:0:36532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.893662:0:36532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.893669:0:36532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14ca00 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518709.893673:0:36532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.893681:0:36532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.893693:0:36532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.893701:0:36532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075f25ba1/0x631fd8698c7878ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518709.893769:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617485696:12345-192.168.206.51@tcp:1:lfs.0 Request processed in 3855us (4017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518709.893777:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:0.0:1789518709.898528:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518709.898608:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617486080 00000100:00100000:2.0:1789518709.898784:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617486080 00000100:00100000:2.0:1789518709.899017:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:2.0:1789518709.899029:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:40536:x1876445617486080:12345-192.168.206.51@tcp:35:lfs.0 00000004:00010000:2.0:1789518709.899091:0:35848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x32:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787769 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ed expref: 54 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789518709.899353:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771544 00000001:00080000:2.0:1789518709.900427:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771545 00010000:00010000:2.0:1789518709.900492:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.900508:0:35848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 57 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.900517:0:35848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe241 expref: 57 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.900531:0:35848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 5/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.900567:0:35848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe241 expref: 57 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.900582:0:35848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe241 expref: 57 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518709.900596:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627680768:192.168.206.51@tcp:104: 00010000:00010000:2.0:1789518709.900713:0:35848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 57 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.900723:0:35848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 57 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518709.900732:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3475180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627680896:192.168.206.51@tcp:104: 00000100:00100000:2.0:1789518709.900758:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd8116480 going to sleep for 11 seconds 00000100:00100000:0.0:1789518709.903087:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627680768:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518709.903102:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3475180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35848:1876445627680896:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518709.903142:0:35848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518709.905734:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518709.905828:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518709.906106:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617486336 00000100:00100000:1.0:1789518709.906115:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617486336 00000100:00100000:2.0:1789518709.906156:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617486208 00000100:00100000:2.0:1789518709.906172:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617486208 00010000:00010000:1.0:1789518709.906172:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 58 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.906195:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe241 expref: 59 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518709.906218:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:1.0:1789518709.906228:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:2342:x1876445617486336:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518709.906242:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518709.906249:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 59 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518709.906260:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 59 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518709.906289:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c78777e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1f4 expref: 59 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518709.906299:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00010000:00010000:1.0:1789518709.906305:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:1.0:1789518709.906311:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518709.906312:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2342:x1876445617486208:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518709.906328:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.906336:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518709.906337:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518709.906345:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe241 expref: 58 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.906359:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe241 expref: 58 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.906373:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787888 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe241 expref: 58 pid: 37723 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.906387:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00000100:00100000:1.0:1789518709.906387:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2342:x1876445617486336:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 159us (659us total) trans 0 rc 0/0 00010000:00010000:2.0:1789518709.906395:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518709.906400:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00010000:00010000:2.0:1789518709.906410:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.906419:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518709.906447:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518709.906471:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617486208:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 162us (642us total) trans 0 rc 0/0 00010000:00010000:1.0:1789518709.906474:0:35848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518709.906478:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00010000:00010000:1.0:1789518709.906487:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518709.906598:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771546 00000001:00080000:1.0:1789518709.906856:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771547 00000100:00100000:1.0:1789518709.906952:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627681024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518709.906999:0:35848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518709.907032:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc64c7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789518709.907211:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627681024 00000100:00100000:2.0:1789518709.907221:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627681024 00000100:00080000:3.0:1789518709.907281:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518709.907284:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789518709.907292:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627681024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789518709.907422:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627681024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518709.907429:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789518709.907487:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627681024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789518709.908115:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771548 00000100:00100000:1.0:1789518709.908194:0:35848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627681152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789518709.908229:0:35848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518709.908261:0:35848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdb5dc780 going to sleep for 11 seconds 00000100:00100000:3.0:1789518709.908333:0:35851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627681152 00000100:00100000:3.0:1789518709.908340:0:35851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627681152 00000100:00100000:3.0:1789518709.908377:0:35851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789518709.908384:0:35851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35848:x1876445627681152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789518709.908587:0:35851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35848:x1876445627681152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 203us (356us total) trans 30064771220 rc 0/0 00000100:00100000:3.0:1789518709.908594:0:35851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789518709.908667:0:35848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35848:1876445627681152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789518709.908714:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771549 00010000:00010000:0.0:1789518709.908748:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.908758:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.908764:0:35848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.908770:0:35848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518709.908774:0:35848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.908782:0:35848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.908795:0:35848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518709.908798:0:35848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789518709.908803:0:35848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518709.908809:0:35848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c7878b2 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789518709.909065:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x35:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789518709.909176:0:35848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].20, 64 off9712 00000004:00080000:0.0:1789518709.909189:0:35848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763905574426ns, next at 764905572018ns, rc = 0 00000001:00080000:0.0:1789518709.909196:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771550 00010000:00010000:0.0:1789518709.909227:0:35848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc6733b00) 00010000:00010000:0.0:1789518709.909230:0:35848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789518709.909237:0:35848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787769 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe1ed expref: 60 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518709.909335:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:40536:x1876445617486080:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 10308us (10822us total) trans 30064771551 rc 0/0 00000100:00100000:0.0:1789518709.909344:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000020:00080000:0.0:1789518709.909349:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1789518709.913398:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518709.913491:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617486464 00000100:00100000:3.0:1789518709.913501:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617486464 00000100:00100000:3.0:1789518709.913606:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 527 00000100:00100000:3.0:1789518709.913659:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:40536:x1876445617486464:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518709.913682:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518709.913703:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c7878b9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe24f expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518709.913797:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c7878b9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe24f expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518709.913813:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d400/0x631fd8698c7878b9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe24f expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518709.913832:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff99ffc2fdc500) 00010000:00010000:3.0:1789518709.913835:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518709.913839:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14d400, rc 0) 00000100:00100000:3.0:1789518709.913887:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:40536:x1876445617486464:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 272us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518709.913894:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 527 00000100:00100000:2.0:1789518709.918216:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518709.918350:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617486720 00000100:00100000:1.0:1789518709.918362:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617486720 00000100:00100000:1.0:1789518709.918476:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:1.0:1789518709.918488:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:40536:x1876445617486720:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518709.918786:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:40536:x1876445617486720:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 299us (577us total) trans 30064771552 rc 0/0 00000100:00100000:1.0:1789518709.918807:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 132 00000001:00080000:2.0:1789518710.417575:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771220 is committed 00000001:00080000:0.0:1789518710.438272:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771551 is committed 00000004:00080000:0.0:1789518710.438296:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000001:00080000:0.0:1789518710.438312:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771552 is committed 00000020:00080000:0.0:1789518710.438322:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffc64c7c00 refcount 2 committed 0 result 0 batchid 25769803908 00000020:00080000:0.0:1789518710.438327:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffc64c7600 00000020:00080000:0.0:1789518710.438330:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99fff5b76d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99feca563c00 00000020:00080000:0.0:1789518710.438490:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803908 committed batchid 25769803907 00000100:00100000:1.0:1789518710.438552:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627681280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789518710.438649:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518710.438679:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627681280 00000100:00100000:3.0:1789518710.438688:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627681280 00000100:00100000:3.0:1789518710.438739:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789518710.438750:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627681280:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1789518710.438752:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00002000:00080000:3.0:1789518710.438777:0:37973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:207 count 1 00002000:00010000:3.0:1789518710.438817:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 24, mtime: 0x6aa9e361, atime: 0x6aa9e361, ctime: 0x6aa9e361, blocks: 0xb 00010000:00010000:3.0:1789518710.438825:0:37973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518710.438841:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=764s v=(0 0) 00010000:00010000:3.0:1789518710.438845:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518710.438851:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518710.438877:0:37973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518710.438887:0:37973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518710.438894:0:37973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518710.438917:0:37973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518710.438999:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789518710.439006:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518710.439016:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:0.0:1789518710.439020:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518710.439035:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518710.439052:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518710.439060:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf896b86/0x631fd8698c7878c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518710.439079:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518710.439081:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518710.439083:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518710.440267:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627681280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1512us (1611us total) trans 30064771221 rc 0/0 00000100:00100000:3.0:1789518710.440276:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789518710.440772:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771220 gen 2 00000004:00080000:0.0:1789518710.440779:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771220 committed transno 30064771220 00000100:00100000:0.0:1789518710.440800:0:3282:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fff79ae680 x1876445627681280/t30064771221(30064771221) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518726 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789518710.441098:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fff79ae680/2, rc 0, transno 30064771221 00000100:00100000:0.0:1789518710.441104:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627681280:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789518710.643218:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518711.667777:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518711.927554:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518711.927578:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627681408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518711.928283:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518711.928410:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627681408 00000100:00100000:3.0:1789518711.928418:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627681408 00000100:00100000:3.0:1789518711.928517:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789518711.928526:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627681408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518711.928561:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518711.928606:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627681408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518711.928635:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789518711.928752:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627681408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518711.929685:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518712.434861:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627681536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518712.434956:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518712.435023:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627681664:0@lo:400:kworker.0 00000100:00100000:2.0:1789518712.435058:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518712.435081:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627681536 00000100:00100000:2.0:1789518712.435097:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518712.435100:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627681536 00000100:00100000:2.0:1789518712.435102:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627681792:0@lo:400:kworker.0 00000100:00100000:2.0:1789518712.435128:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518712.435170:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627681664 00000100:00100000:3.0:1789518712.435174:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789518712.435174:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627681664 00000100:00100000:3.0:1789518712.435201:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627681536:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518712.435203:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789518712.435209:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627681664:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789518712.435242:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518712.435255:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627681664:12345-0@lo:400:kworker.0 Request processed in 46us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518712.435262:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789518712.435276:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627681536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518712.435281:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789518712.435294:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518712.435311:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627681792 00000100:00100000:3.0:1789518712.435315:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627681792 00000100:00100000:2.0:1789518712.435330:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd846f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627681536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518712.435340:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789518712.435342:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627681664:0@lo:400:kworker.0 00000100:00100000:3.0:1789518712.435346:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627681792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518712.435377:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627681792:12345-0@lo:400:kworker.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518712.435382:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627681792:0@lo:400:kworker.0 00000100:00100000:3.0:1789518712.435383:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789518712.436198:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627681920:0@lo:400:kworker.0 00000100:00100000:3.0:1789518712.436247:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518712.436281:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518712.436289:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627682048:0@lo:400:kworker.0 00000100:00100000:3.0:1789518712.436311:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518712.436360:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518712.436369:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627682176:0@lo:400:kworker.0 00000100:00100000:3.0:1789518712.436397:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518712.436435:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627681920 00000100:00100000:3.0:1789518712.436442:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627681920 00000100:00100000:3.0:1789518712.436479:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627682048 00000100:00100000:3.0:1789518712.436482:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627682048 00000100:00100000:3.0:1789518712.436509:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627682176 00000100:00100000:3.0:1789518712.436512:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627682176 00000100:00100000:3.0:1789518712.436530:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789518712.436537:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627681920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518712.436543:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789518712.436552:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627682048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518712.436594:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627681920:12345-0@lo:400:kworker.0 Request processed in 58us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518712.436594:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627682048:12345-0@lo:400:kworker.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518712.436601:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789518712.436604:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789518712.436632:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789518712.436638:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627682176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518712.436675:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627682176:12345-0@lo:400:kworker.0 Request processed in 37us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518712.436740:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627682176:0@lo:400:kworker.0 00000100:00100000:1.0:1789518712.436781:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627682048:0@lo:400:kworker.0 00000100:00100000:1.0:1789518712.436794:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627681920:0@lo:400:kworker.0 00000100:00080000:2.0:1789518712.436870:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518712.437389:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:3.0:1789518712.693609:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518712.978284:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518712.978678:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617486848 00000100:00100000:1.0:1789518712.978689:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617486848 00000100:00100000:1.0:1789518712.978835:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 528 00000100:00100000:1.0:1789518712.978846:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:40482:x1876445617486848:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789518712.978959:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:40482:x1876445617486848:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 114us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518712.978968:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 528 00000100:00080000:2.0:1789518712.979167:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518712.981795:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518712.982241:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617487104 00000100:00100000:0.0:1789518712.982252:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617487104 00000100:00100000:0.0:1789518712.982316:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 133 00000100:00100000:0.0:1789518712.982326:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+52:40482:x1876445617487104:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518712.982567:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:40482:x1876445617487104:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 243us (780us total) trans 30064771553 rc 0/0 00000100:00100000:0.0:1789518712.982576:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 133 00010000:00010000:3.0:1789518713.715016:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518713.741078:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518713.741121:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518713.741172:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617487488 00000100:00100000:3.0:1789518713.741179:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518713.741184:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617487488 00000100:00100000:0.0:1789518713.741253:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617487360 00000100:00100000:0.0:1789518713.741257:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617487360 00000100:00100000:0.0:1789518713.741284:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:0.0:1789518713.741294:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617487488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518713.741338:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:2.0:1789518713.741354:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617487360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518713.741365:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617487488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518713.741373:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1789518713.741392:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617487360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00080000:0.0:1789518713.741397:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518713.741401:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00080000:0.0:1789518713.741402:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518713.741520:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617487232 00000100:00100000:1.0:1789518713.741525:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617487232 00000100:00100000:1.0:1789518713.741555:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:1.0:1789518713.741562:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617487232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518713.741595:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617487232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518713.741601:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:2.0:1789518713.742160:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518713.742984:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617487616 00000100:00100000:0.0:1789518713.742993:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617487616 00000100:00100000:0.0:1789518713.743056:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:0.0:1789518713.743065:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617487616:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518713.743127:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617487616:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518713.743134:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00080000:2.0:1789518713.743306:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1789518713.870527:0:40721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 13a: Test auto RW-PCC create caching for UID/GID rule ========================================================== 20:31:53 (1789518713) 00000100:00100000:2.0:1789518714.031217:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.031312:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617487872 00000100:00100000:3.0:1789518714.031322:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617487872 00000100:00100000:3.0:1789518714.031400:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 529 00000100:00100000:3.0:1789518714.031411:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+53:41169:x1876445617487872:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00000100:00080000:2.0:1789518714.031415:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518714.031435:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518714.031456:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe256 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.031528:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.031543:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.031556:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.031587:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.031594:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.031599:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032015:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c7878dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032025:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c7878dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032032:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c7878dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518714.032041:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789518714.032353:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032361:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032367:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032372:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.032376:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032393:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032404:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fec3b12d00) 00010000:00010000:3.0:1789518714.032407:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.032412:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032418:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032431:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032437:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032442:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032447:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.032450:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032455:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032462:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffc2fdc400) 00010000:00010000:3.0:1789518714.032464:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.032467:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032483:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032931:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe256 expref: 56 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032945:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c7878dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe256 expref: 55 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.032952:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:3.0:1789518714.032954:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.032956:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c000, rc 0) 00000100:00100000:3.0:1789518714.033020:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:41169:x1876445617487872:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1611us (1810us total) trans 30064771554 rc 0/0 00000100:00100000:3.0:1789518714.033028:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 529 00000100:00100000:1.0:1789518714.036833:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.036876:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518714.036889:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617488000 00000100:00100000:0.0:1789518714.036899:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617488000 00000100:00100000:0.0:1789518714.036957:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:0.0:1789518714.036967:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:2343:x1876445617488000:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518714.036982:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518714.037006:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c7878dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe256 expref: 55 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.037023:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:0.0:1789518714.037028:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518714.037052:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617488128 00000100:00100000:2.0:1789518714.037058:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617488128 00000100:00100000:2.0:1789518714.037096:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 530 00000100:00100000:0.0:1789518714.037096:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:2343:x1876445617488000:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 128us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518714.037108:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:41169:x1876445617488128:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789518714.037118:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:2.0:1789518714.037186:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:41169:x1876445617488128:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518714.037193:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 530 00000100:00100000:2.0:1789518714.130599:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.131709:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617488256 00000100:00100000:3.0:1789518714.131719:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617488256 00000100:00100000:3.0:1789518714.131776:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 531 00000100:00100000:3.0:1789518714.131785:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:41190:x1876445617488256:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518714.132053:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518714.132116:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe25d expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.132237:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.132251:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.132273:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.132287:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.132294:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.132301:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133109:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133118:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133126:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133132:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.133136:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133151:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133164:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905500) 00010000:00010000:3.0:1789518714.133167:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.133172:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133194:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c7878f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133208:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133214:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133220:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133225:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.133227:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133233:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133240:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff99ffc2fdc400) 00010000:00010000:3.0:1789518714.133242:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.133245:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133250:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c7878f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133279:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe25d expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133298:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905500) 00010000:00010000:3.0:1789518714.133300:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.133304:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe25d expref: 55 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.133313:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c200, rc 0) 00000100:00100000:3.0:1789518714.133374:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:41190:x1876445617488256:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1589us (2782us total) trans 0 rc 301/301 00000100:00100000:3.0:1789518714.133381:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 531 00000100:00100000:1.0:1789518714.139877:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.140276:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617488512 00000100:00100000:3.0:1789518714.140285:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617488512 00000100:00100000:3.0:1789518714.140396:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 532 00000100:00100000:3.0:1789518714.140407:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:41190:x1876445617488512:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:3.0:1789518714.140461:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518714.140486:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c78786c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe23a expref: 54 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.140506:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fff6905500) 00010000:00010000:3.0:1789518714.140517:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518714.140773:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.140787:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.140798:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.140820:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.140827:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.140834:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518714.142883:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:3.0:1789518714.142897:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.142907:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.142914:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.142921:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.143327:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.143338:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.143353:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2fdc400) 00010000:00010000:3.0:1789518714.143356:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.143361:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.143380:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7878ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789518714.143401:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008707f8fc reply state 00000000d80b4772 transno 30064771555 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518714.143410:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518714.144121:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:41190:x1876445617488512:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 3710us (4247us total) trans 30064771555 rc 0/0 00000100:00100000:3.0:1789518714.144131:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 532 00010000:00010000:0.0:1789518714.150657:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.150675:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.150683:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.150690:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518714.150695:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.150703:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.150718:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff99ffc2fdc600) 00010000:00010000:0.0:1789518714.150722:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518714.150726:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.150736:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787906 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518714.158246:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518714.158570:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617488640 00000100:00100000:0.0:1789518714.158590:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617488640 00000100:00100000:0.0:1789518714.158677:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 533 00000100:00100000:0.0:1789518714.158688:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+54:41191:x1876445617488640:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:0.0:1789518714.158709:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518714.158730:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78790d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe264 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.158789:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787914 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.158802:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.158815:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518714.158857:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518714.158861:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518714.158900:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.158924:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c78790d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe264 expref: 56 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.158941:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe264 expref: 55 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.158949:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518714.158952:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518714.158956:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23400, rc 0) 00000100:00100000:0.0:1789518714.159016:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:41191:x1876445617488640:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 329us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518714.159023:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 533 00000100:00100000:1.0:1789518714.163282:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.163374:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617488768 00000100:00100000:3.0:1789518714.163387:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617488768 00000100:00100000:3.0:1789518714.163456:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 534 00000100:00100000:3.0:1789518714.163470:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+55:41191:x1876445617488768:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:3.0:1789518714.163497:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518714.163522:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c78791b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe26b expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.163697:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.163714:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.163727:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.163743:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.163771:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.163778:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.163889:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787930 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.163898:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787930 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.163904:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787930 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518714.163960:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:3.0:1789518714.163965:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518714.163992:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787930 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164005:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164012:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164019:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164026:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.164031:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164045:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164064:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518714.164067:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.164074:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164080:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164097:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164103:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164108:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164113:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.164116:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164122:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164129:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff99ffc2fdc400) 00010000:00010000:3.0:1789518714.164131:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.164134:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164162:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787929 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164199:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c78791b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe26b expref: 57 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164214:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787930 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe26b expref: 56 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.164221:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc2fdcf00) 00010000:00010000:3.0:1789518714.164223:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789518714.164225:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14ce00, rc 0) 00000100:00100000:3.0:1789518714.164305:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:41191:x1876445617488768:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 839us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518714.164313:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 534 00000100:00100000:2.0:1789518714.167407:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.167492:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617489024 00000100:00100000:3.0:1789518714.167501:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617489024 00000100:00100000:3.0:1789518714.167595:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 535 00000100:00100000:3.0:1789518714.167603:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:41191:x1876445617489024:12345-192.168.206.51@tcp:36:chmod.0 00010000:00010000:3.0:1789518714.167671:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789518714.167692:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787930 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe26b expref: 56 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.167706:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc2fdcf00) 00010000:00010000:3.0:1789518714.167714:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518714.167737:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.167763:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.167773:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789518714.168189:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9ed0d4c reply state 000000007c9be301 transno 30064771556 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518714.168199:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789518714.168207:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000100:00100000:2.0:1789518714.168377:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41191:x1876445617489024:12345-192.168.206.51@tcp:36:chmod.0 Request processed in 773us (976us total) trans 30064771556 rc 0/0 00000100:00100000:2.0:1789518714.168384:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 535 00010000:00010000:2.0:1789518714.170721:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.170736:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.170743:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.170749:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518714.170753:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.170762:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.170775:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc2fdc700) 00010000:00010000:2.0:1789518714.170779:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789518714.170783:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.170789:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d800/0x631fd8698c787937 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518714.178679:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.178813:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617489152 00000100:00100000:1.0:1789518714.178823:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617489152 00000100:00100000:1.0:1789518714.178880:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 536 00000100:00100000:1.0:1789518714.178890:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:41192:x1876445617489152:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1789518714.178912:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518714.178932:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c78793e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe272 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.178991:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179005:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179016:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179029:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179036:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179042:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179127:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c787953 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179135:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c787953 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179155:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c787953 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518714.179185:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:1.0:1789518714.179189:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518714.179206:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c787953 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179217:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179223:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179230:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179236:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518714.179240:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179248:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179259:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:1.0:1789518714.179262:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518714.179276:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179282:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179294:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179304:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179311:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179316:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518714.179319:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179325:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179333:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff99ffc6733400) 00010000:00010000:1.0:1789518714.179340:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518714.179343:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179348:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78794c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179377:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c78793e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe272 expref: 58 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179388:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c787953 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe272 expref: 57 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.179395:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518714.179397:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518714.179399:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380e00, rc 0) 00000100:00100000:1.0:1789518714.179451:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41192:x1876445617489152:12345-192.168.206.51@tcp:101:rm.0 Request processed in 563us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518714.179458:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 536 00000100:00100000:1.0:1789518714.183004:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.183085:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617489280 00000100:00100000:3.0:1789518714.183100:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617489280 00000100:00100000:3.0:1789518714.183188:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 537 00000100:00100000:3.0:1789518714.183199:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41192:x1876445617489280:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:3.0:1789518714.183227:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518714.183249:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c78795a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe279 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183329:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183345:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183357:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183373:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183379:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183385:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183475:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183482:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183490:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183497:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.183501:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183509:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183522:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518714.183525:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.183531:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183537:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787961 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183551:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183556:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183562:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183573:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.183576:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183582:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183590:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99ffc2fdcf00) 00010000:00010000:3.0:1789518714.183593:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.183595:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183601:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787968 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183686:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c78795a lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe279 expref: 58 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183696:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518714.183698:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.183702:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c78795a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe279 expref: 58 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.183710:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14ce00, rc 0) 00000100:00100000:3.0:1789518714.183899:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41192:x1876445617489280:12345-192.168.206.51@tcp:101:rm.0 Request processed in 700us (902us total) trans 0 rc 301/301 00000100:00100000:3.0:1789518714.183908:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 537 00000100:00100000:1.0:1789518714.190571:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518714.190714:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617489408 00000100:00100000:2.0:1789518714.190726:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617489408 00000100:00100000:2.0:1789518714.192033:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 538 00000100:00100000:2.0:1789518714.192051:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41192:x1876445617489408:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:2.0:1789518714.192079:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518714.192106:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78796f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe280 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192204:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192222:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192235:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192251:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192259:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192265:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192331:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192343:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192351:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192357:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518714.192362:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192370:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192384:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:2.0:1789518714.192387:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518714.192393:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192399:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901600/0x631fd8698c787976 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192414:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192421:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192427:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192433:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6900400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518714.192436:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192443:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192450:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99fff6905600) 00010000:00010000:2.0:1789518714.192453:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518714.192456:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192462:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c78797d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192500:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78796f lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe280 expref: 58 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192511:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:2.0:1789518714.192514:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518714.192517:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c78796f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe280 expref: 58 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.192528:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900200, rc 0) 00000100:00100000:2.0:1789518714.192748:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41192:x1876445617489408:12345-192.168.206.51@tcp:101:rm.0 Request processed in 690us (2183us total) trans 0 rc 301/301 00000100:00100000:2.0:1789518714.192762:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 538 00000100:00100000:2.0:1789518714.218328:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.218895:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617489664 00000100:00100000:1.0:1789518714.218915:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617489664 00000100:00100000:1.0:1789518714.219003:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 539 00000100:00100000:1.0:1789518714.219016:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41198:x1876445617489664:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518714.219043:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518714.219069:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787984 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe287 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.219296:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.219314:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.219327:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.219343:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.219350:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.219358:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220186:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787999 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220197:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787999 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220205:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787999 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518714.220215:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:1.0:1789518714.220243:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220252:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220260:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220267:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518714.220272:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220286:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220299:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518714.220303:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518714.220309:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220321:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c78798b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518714.220336:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099969a94 reply state 00000000706d5f24 transno 30064771557 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518714.220344:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789518714.220379:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787984 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe287 expref: 60 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220395:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787999 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe287 expref: 59 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.220402:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:1.0:1789518714.220404:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789518714.220406:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380c00, rc 0) 00000100:00100000:1.0:1789518714.220496:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:41198:x1876445617489664:12345-192.168.206.51@tcp:101:dd.500 Request processed in 1482us (2185us total) trans 30064771557 rc 0/0 00000100:00100000:1.0:1789518714.220505:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 539 00010000:00010000:0.0:1789518714.222101:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.222117:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.222125:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.222131:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518714.222146:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.222154:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.222170:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99ffc6733400) 00010000:00010000:0.0:1789518714.222172:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518714.222177:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.222183:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787992 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518714.224125:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.224198:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617489920 00000100:00100000:1.0:1789518714.224214:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617489920 00000100:00100000:1.0:1789518714.224312:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:0.0:1789518714.224327:0:35848:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1789518714.224337:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+59:41198:x1876445617489920:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:0.0:1789518714.224342:0:35848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1789518714.225111:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:41198:x1876445617489920:12345-192.168.206.51@tcp:35:dd.500 Request processed in 784us (987us total) trans 30064771558 rc 0/0 00000100:00100000:1.0:1789518714.225122:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:3.0:1789518714.273014:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518714.273128:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617490176 00000100:00100000:2.0:1789518714.273146:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617490176 00000100:00100000:2.0:1789518714.273204:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 540 00000100:00100000:2.0:1789518714.273213:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:41208:x1876445617490176:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1789518714.273236:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518714.273255:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7879a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe28e expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518714.273339:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:2.0:1789518714.273451:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7879a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe28e expref: 62 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.273463:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:2.0:1789518714.273466:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518714.273472:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900400/0x631fd8698c7879a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe28e expref: 62 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.273484:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900400, rc 0) 00000100:00100000:2.0:1789518714.273583:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:41208:x1876445617490176:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 371us (578us total) trans 30064771559 rc 301/301 00000100:00100000:2.0:1789518714.273592:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 540 00000100:00100000:2.0:1789518714.280361:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518714.280795:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617490432 00000100:00100000:0.0:1789518714.280805:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617490432 00000100:00100000:0.0:1789518714.280868:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:0.0:1789518714.280878:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:41208:x1876445617490432:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1789518714.281438:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:41208:x1876445617490432:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 560us (1085us total) trans 30064771560 rc 0/0 00000100:00100000:0.0:1789518714.281446:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:3.0:1789518714.322113:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.322239:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617490688 00000100:00100000:1.0:1789518714.322251:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617490688 00000100:00100000:1.0:1789518714.322307:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 541 00000100:00100000:1.0:1789518714.322317:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:41214:x1876445617490688:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518714.322340:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518714.322360:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879b5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe295 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.322454:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7879bc lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.322470:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7879bc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.322482:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7879bc lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518714.322492:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:1.0:1789518714.322608:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879b5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe295 expref: 65 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.322666:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7879bc lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe295 expref: 64 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.322675:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:1.0:1789518714.322678:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789518714.322681:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381a00, rc 0) 00000100:00100000:1.0:1789518714.322848:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:41214:x1876445617490688:12345-192.168.206.51@tcp:101:dd.500 Request processed in 531us (742us total) trans 30064771561 rc 0/0 00000100:00100000:1.0:1789518714.322858:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 541 00000040:00080000:2.0:1789518714.355038:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518714.355047:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518714.355541:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 5 00000040:00080000:2.0:1789518714.355550:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518714.363408:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.364562:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617490944 00000100:00100000:1.0:1789518714.364573:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617490944 00000100:00100000:1.0:1789518714.364647:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 542 00000100:00100000:1.0:1789518714.364658:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:41220:x1876445617490944:12345-192.168.206.51@tcp:36:truncate.500 00010000:00010000:1.0:1789518714.364889:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.364904:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.364914:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789518714.364959:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771562 00000004:00010000:1.0:1789518714.364986:0:35845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001864521 reply state 0000000044efc915 transno 30064771563 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518714.364993:0:35845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789518714.365112:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:41220:x1876445617490944:12345-192.168.206.51@tcp:36:truncate.500 Request processed in 456us (1711us total) trans 30064771563 rc 0/0 00000100:00100000:1.0:1789518714.365119:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 542 00000020:00080000:1.0:1789518714.365124:0:35845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789518714.367560:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.367576:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.367584:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.367589:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518714.367593:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.367599:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.367644:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:1.0:1789518714.367647:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518714.367652:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.367658:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879ca lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518714.397486:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.397942:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617491200 00000100:00100000:3.0:1789518714.397951:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617491200 00000100:00100000:3.0:1789518714.398012:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 543 00000100:00100000:3.0:1789518714.398022:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:41226:x1876445617491200:12345-192.168.206.51@tcp:36:truncate.500 00010000:00010000:3.0:1789518714.398273:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.398297:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.398308:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789518714.398352:0:35847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771564 00000004:00010000:3.0:1789518714.398374:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002518240d reply state 000000007e3bb636 transno 30064771565 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518714.398383:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518714.398472:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:41226:x1876445617491200:12345-192.168.206.51@tcp:36:truncate.500 Request processed in 450us (994us total) trans 30064771565 rc 0/0 00000100:00100000:3.0:1789518714.398480:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 543 00000020:00080000:3.0:1789518714.398484:0:35847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789518714.399930:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.399942:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.399950:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.399956:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518714.399960:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.399968:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.399981:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:0.0:1789518714.399984:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518714.399989:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.400000:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c7879d1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518714.432016:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.432306:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617491456 00000100:00100000:1.0:1789518714.432316:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617491456 00000100:00100000:1.0:1789518714.432416:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 544 00000100:00100000:1.0:1789518714.432426:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:41232:x1876445617491456:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:1.0:1789518714.432450:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518714.432468:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879d8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe29c expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.432564:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c7879df lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.432579:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c7879df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.432600:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c7879df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518714.432642:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00010000:00010000:1.0:1789518714.432773:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c7879d8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe29c expref: 71 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.432793:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c7879df lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe29c expref: 70 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.432803:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:1.0:1789518714.432806:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518714.432810:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381200, rc 0) 00000100:00100000:1.0:1789518714.432871:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41232:x1876445617491456:12345-192.168.206.51@tcp:101:dd.500 Request processed in 446us (864us total) trans 30064771566 rc 0/0 00000100:00100000:1.0:1789518714.432878:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 544 00000100:00100000:2.0:1789518714.434858:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518714.434937:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617491712 00000100:00100000:0.0:1789518714.434945:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617491712 00000100:00100000:0.0:1789518714.434990:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 545 00000100:00100000:0.0:1789518714.435000:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41232:x1876445617491712:12345-192.168.206.51@tcp:36:dd.500 00010000:00010000:0.0:1789518714.435041:0:35846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518714.435062:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c7879df lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe29c expref: 70 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.435079:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:0.0:1789518714.435083:0:35846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518714.435268:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.435279:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518714.435288:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518714.435353:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771567 00000004:00010000:0.0:1789518714.435376:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb3391fb reply state 00000000afa5017e transno 30064771568 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518714.435383:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518714.435463:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec28aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:41232:x1876445617491712:12345-192.168.206.51@tcp:36:dd.500 Request processed in 464us (609us total) trans 30064771568 rc 0/0 00000100:00100000:0.0:1789518714.435474:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 545 00000020:00080000:0.0:1789518714.435478:0:35846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789518714.441046:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.441106:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617491968 00000100:00100000:1.0:1789518714.441116:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617491968 00010000:00010000:2.0:1789518714.441148:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.441160:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.441168:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.441173:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518714.441177:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518714.441179:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 136 00010000:00010000:2.0:1789518714.441185:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518714.441189:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:41232:x1876445617491968:12345-192.168.206.51@tcp:35:dd.500 00010000:00010000:2.0:1789518714.441201:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:2.0:1789518714.441204:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518714.441208:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518714.441214:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c7879ed lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518714.441497:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:41232:x1876445617491968:12345-192.168.206.51@tcp:35:dd.500 Request processed in 308us (458us total) trans 30064771569 rc 0/0 00000100:00100000:1.0:1789518714.441505:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:2.0:1789518714.492715:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.492820:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617492224 00000100:00100000:3.0:1789518714.492830:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617492224 00000100:00100000:3.0:1789518714.492920:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 546 00000100:00100000:3.0:1789518714.492931:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:41242:x1876445617492224:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518714.492954:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518714.492982:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c7879f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2a3 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518714.493066:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:3.0:1789518714.493185:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c7879f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2a3 expref: 74 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.493199:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:3.0:1789518714.493202:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789518714.493207:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c7879f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2a3 expref: 74 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.493221:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14ce00, rc 0) 00000100:00100000:3.0:1789518714.493287:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:41242:x1876445617492224:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 359us (583us total) trans 30064771570 rc 301/301 00000100:00100000:3.0:1789518714.493295:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 546 00000100:00100000:2.0:1789518714.495332:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.495394:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617492352 00000100:00100000:1.0:1789518714.495403:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617492352 00000100:00100000:1.0:1789518714.495797:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 547 00000100:00100000:1.0:1789518714.495809:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:41242:x1876445617492352:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1789518714.495874:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.495891:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.495902:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.495917:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.495924:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.495930:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496026:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496036:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496043:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789518714.496091:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496102:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496109:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496119:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496125:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518714.496129:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496148:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496160:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518714.496163:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518714.496168:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496174:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a02 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496186:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496192:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496198:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496202:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518714.496205:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496215:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496222:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99ffc6733d00) 00010000:00010000:1.0:1789518714.496224:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518714.496227:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496237:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a09 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496251:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496257:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496262:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496267:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518714.496270:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496276:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496283:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:1.0:1789518714.496285:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518714.496288:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.496296:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a10 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518714.496367:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:41242:x1876445617492352:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 560us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518714.496375:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 547 00000100:00100000:0.0:1789518714.498290:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.498392:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617492608 00000100:00100000:1.0:1789518714.498410:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617492608 00000100:00100000:1.0:1789518714.498451:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:1.0:1789518714.498457:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:41242:x1876445617492608:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518714.498709:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:41242:x1876445617492608:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 250us (426us total) trans 30064771571 rc 0/0 00000100:00100000:1.0:1789518714.498718:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:2.0:1789518714.536536:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.536731:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617492736 00000100:00100000:1.0:1789518714.536741:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617492736 00000100:00100000:1.0:1789518714.536800:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 548 00000100:00100000:1.0:1789518714.536813:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:41248:x1876445617492736:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518714.536837:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518714.536855:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2aa expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.536913:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a1e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.536933:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a1e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.536945:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a1e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518714.536972:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:1.0:1789518714.536975:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518714.536987:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a1e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.537009:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2aa expref: 76 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.537022:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a1e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2aa expref: 75 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.537027:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518714.537029:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789518714.537032:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380400, rc 0) 00000100:00100000:1.0:1789518714.537078:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:41248:x1876445617492736:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 269us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518714.537085:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 548 00000100:00100000:2.0:1789518714.539696:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.539922:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617492864 00000100:00100000:3.0:1789518714.539932:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617492864 00000100:00100000:3.0:1789518714.539988:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 549 00000100:00100000:3.0:1789518714.539998:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:41248:x1876445617492864:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518714.540118:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518714.540788:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a25 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2b1 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541038:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541051:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541071:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541088:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541096:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541103:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541363:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787a3a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541374:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787a3a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541449:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787a3a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518714.541482:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00000004:00200000:3.0:1789518714.541486:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518714.541505:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787a3a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541516:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787a3a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541524:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541542:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541550:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541557:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.541561:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541570:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541581:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518714.541585:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.541589:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.541596:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a2c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542669:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542687:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542764:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542771:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518714.542776:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542784:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542796:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99ffc2fdcf00) 00010000:00010000:3.0:1789518714.542799:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518714.542803:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542809:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a33 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542922:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a25 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2b1 expref: 77 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542939:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787a3a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2b1 expref: 76 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.542946:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:3.0:1789518714.542948:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518714.542950:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c200, rc 0) 00000100:00100000:3.0:1789518714.543079:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41248:x1876445617492864:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 3081us (3389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518714.543087:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 549 00000100:00100000:0.0:1789518714.546693:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.546786:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617493120 00000100:00100000:1.0:1789518714.546795:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617493120 00000100:00100000:1.0:1789518714.546854:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 550 00000100:00100000:1.0:1789518714.546864:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41248:x1876445617493120:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:1.0:1789518714.546883:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518714.546902:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a41 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2b8 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.547240:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a48 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.547254:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a48 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.547325:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a48 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518714.547339:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:1.0:1789518714.547465:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787a41 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2b8 expref: 79 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.547482:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a48 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2b8 expref: 78 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.547491:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:1.0:1789518714.547494:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789518714.547498:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381800, rc 0) 00000100:00100000:1.0:1789518714.547559:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:41248:x1876445617493120:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 696us (874us total) trans 30064771572 rc 0/0 00000100:00100000:1.0:1789518714.547566:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 550 00000100:00100000:2.0:1789518714.550903:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.550998:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617493504 00000100:00100000:1.0:1789518714.551007:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617493504 00000100:00100000:1.0:1789518714.551071:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:1.0:1789518714.551082:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:41248:x1876445617493504:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1789518714.551327:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+79:41248:x1876445617493504:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 247us (431us total) trans 30064771573 rc 0/0 00000100:00100000:1.0:1789518714.551335:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:2.0:1789518714.554779:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.555965:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617493632 00000100:00100000:1.0:1789518714.555976:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617493632 00000100:00100000:1.0:1789518714.556128:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1789518714.556150:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+79:41248:x1876445617493632:12345-192.168.206.51@tcp:103:lfs.0 00010000:00010000:1.0:1789518714.556169:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789518714.556193:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c7879bc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe295 expref: 79 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.556212:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a48 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2b8 expref: 78 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.556223:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c200/0x631fd8698c787a3a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2b1 expref: 77 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.556236:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787999 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe287 expref: 76 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.556245:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:1.0:1789518714.556255:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518714.556317:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:41248:x1876445617493632:12345-192.168.206.51@tcp:103:lfs.0 Request processed in 179us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518714.556325:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:0.0:1789518714.561847:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518714.561984:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617493760 00000100:00100000:1.0:1789518714.561994:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617493760 00000100:00100000:1.0:1789518714.562153:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 551 00000100:00100000:1.0:1789518714.562164:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:41248:x1876445617493760:12345-192.168.206.51@tcp:58:lfs.0 00010000:00010000:1.0:1789518714.562265:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.562281:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518714.562294:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789518714.562538:0:37723:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].12, 136 off9824 00000100:00100000:1.0:1789518714.562914:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:41248:x1876445617493760:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 751us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518714.562923:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 551 00000100:00100000:2.0:1789518714.564245:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518714.566252:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617493888 00000100:00100000:3.0:1789518714.566265:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617493888 00000100:00100000:3.0:1789518714.566330:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 552 00000100:00100000:3.0:1789518714.566341:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+75:41248:x1876445617493888:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518714.566360:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518714.566385:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a5d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2bf expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.566436:0:35847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.566447:0:35847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a5d lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2bf expref: 76 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.566465:0:35847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.566478:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a5d lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2bf expref: 76 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.566490:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:3.0:1789518714.566494:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789518714.566497:0:35847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a5d lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2bf expref: 76 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518714.566504:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14ce00, rc 0) 00000100:00100000:3.0:1789518714.566569:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41248:x1876445617493888:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 231us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518714.566577:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 552 00010000:00010000:3.0:1789518714.739064:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518715.378836:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518715.378844:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518715.378881:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 13 count 6 00000040:00080000:2.0:1789518715.378888:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518715.378999:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3489180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627682304:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789518715.379367:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789518715.382096:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3489180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627682304:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518715.385563:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.385679:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617494016 00000100:00100000:1.0:1789518715.385689:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617494016 00000100:00100000:1.0:1789518715.385785:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 553 00000100:00100000:1.0:1789518715.385795:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41249:x1876445617494016:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518715.385823:0:39157:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518715.385925:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41249:x1876445617494016:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 131us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.385932:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 553 00000100:00100000:2.0:1789518715.391543:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.391650:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617494144 00000100:00100000:1.0:1789518715.391660:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617494144 00000100:00100000:1.0:1789518715.391715:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 554 00000100:00100000:1.0:1789518715.391726:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41249:x1876445617494144:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789518715.391790:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391808:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391822:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391838:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391845:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391852:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391874:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391882:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391889:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518715.391924:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00000004:00200000:1.0:1789518715.391928:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518715.391940:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391950:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391961:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391968:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391975:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518715.391979:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391987:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.391998:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:1.0:1789518715.392001:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518715.392006:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392013:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787a64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392025:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392031:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392036:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392041:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518715.392044:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392050:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392057:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x898fe5e1 (ffff99ffc6733100) 00010000:00010000:1.0:1789518715.392059:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518715.392062:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392068:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787a6b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x898fe5e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392082:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392088:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392093:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392098:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518715.392102:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392107:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392114:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:1.0:1789518715.392116:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518715.392120:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.392125:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787a72 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518715.392267:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41249:x1876445617494144:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 543us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.392275:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 554 00000100:00100000:3.0:1789518715.397367:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518715.397455:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617494400 00000100:00100000:2.0:1789518715.397464:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617494400 00000100:00100000:2.0:1789518715.397509:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 555 00000100:00100000:2.0:1789518715.397518:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41249:x1876445617494400:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518715.397537:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518715.397558:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787a79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2c6 expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397667:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397683:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397696:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518715.397711:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:2.0:1789518715.397797:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397805:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397816:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397822:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518715.397826:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397834:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397845:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:2.0:1789518715.397848:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518715.397853:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397859:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787a80 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397892:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787a79 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2c6 expref: 78 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397901:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffeaa78600) 00010000:00010000:2.0:1789518715.397903:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789518715.397906:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787a79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2c6 expref: 78 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.397914:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900200, rc 0) 00000100:00100000:2.0:1789518715.397972:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:41249:x1876445617494400:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 454us (613us total) trans 30064771574 rc 301/301 00000100:00100000:2.0:1789518715.397982:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 555 00000100:00100000:0.0:1789518715.400214:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.400308:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617494528 00000100:00100000:1.0:1789518715.400316:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617494528 00000100:00100000:1.0:1789518715.400406:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 556 00000100:00100000:1.0:1789518715.400415:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:41249:x1876445617494528:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789518715.400448:0:39157:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789518715.400540:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:41249:x1876445617494528:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 126us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.400548:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 556 00000100:00100000:1.0:1789518715.403715:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.403930:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617494784 00000100:00100000:3.0:1789518715.403939:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617494784 00000100:00100000:3.0:1789518715.404005:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 557 00000100:00100000:3.0:1789518715.404014:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:41249:x1876445617494784:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518715.404033:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518715.404036:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789518715.404070:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787a1e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2aa expref: 77 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.404086:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518715.404091:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518715.404103:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a8e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2cd expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789518715.404670:0:35847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcf:0x0], index 1: 0 00010000:00010000:3.0:1789518715.404892:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a95 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.404904:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a95 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.404914:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a95 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.404958:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787a8e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2cd expref: 79 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.404973:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a95 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2cd expref: 78 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.404985:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99ffc2fdcf00) 00010000:00010000:3.0:1789518715.404987:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518715.404990:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c600, rc 0) 00000100:00100000:3.0:1789518715.405382:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:41249:x1876445617494784:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1368us (1674us total) trans 30064771575 rc 0/0 00000100:00100000:3.0:1789518715.405390:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 557 00000100:00100000:2.0:1789518715.409362:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.409458:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617495040 00000100:00100000:1.0:1789518715.409468:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617495040 00000100:00100000:1.0:1789518715.409553:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 558 00000100:00100000:1.0:1789518715.409562:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:41249:x1876445617495040:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789518715.409648:0:35845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518715.409674:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c600/0x631fd8698c787a95 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2cd expref: 78 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409702:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99ffc2fdcf00) 00010000:00010000:1.0:1789518715.409711:0:35845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789518715.409732:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409745:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409754:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409766:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409773:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409779:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409836:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409843:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409850:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409855:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518715.409859:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409867:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409879:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:1.0:1789518715.409881:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518715.409885:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409891:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787aa3 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409900:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409906:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409913:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409918:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518715.409921:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409926:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409934:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x86264a4 (ffff99ffc6733100) 00010000:00010000:1.0:1789518715.409936:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518715.409939:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.409944:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787aaa lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x86264a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518715.410391:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:41249:x1876445617495040:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 829us (1036us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789518715.410399:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 558 00000100:00100000:0.0:1789518715.412407:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518715.412495:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617495168 00000100:00100000:2.0:1789518715.412504:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617495168 00000100:00100000:2.0:1789518715.412550:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 559 00000100:00100000:2.0:1789518715.412560:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:41249:x1876445617495168:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789518715.412576:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518715.412596:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787ab1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2d4 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.412653:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.412666:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.412677:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.412773:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901800/0x631fd8698c787ab1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2d4 expref: 79 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.412790:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2d4 expref: 78 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.412798:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:2.0:1789518715.412801:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518715.412805:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900a00, rc 0) 00000100:00100000:2.0:1789518715.412849:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:41249:x1876445617495168:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 291us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518715.412857:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 559 00000100:00100000:2.0:1789518715.416280:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.416353:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617495424 00000100:00100000:3.0:1789518715.416362:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617495424 00000100:00100000:3.0:1789518715.416415:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 560 00000100:00100000:3.0:1789518715.416424:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:41249:x1876445617495424:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789518715.416492:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.416508:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.416520:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789518715.417029:0:35847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].19, 88 off9720 00000004:00080000:3.0:1789518715.417039:0:35847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769413425007ns, next at 770413422197ns, rc = 0 00000004:00010000:3.0:1789518715.417115:0:35847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008549f281 reply state 0000000034347cdb transno 30064771576 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518715.417125:0:35847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789518715.417215:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+80:41249:x1876445617495424:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 791us (941us total) trans 30064771576 rc 0/0 00000100:00100000:3.0:1789518715.417225:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 560 00010000:00010000:0.0:1789518715.418522:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.418534:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.418543:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.418549:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518715.418554:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.418562:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.418575:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:0.0:1789518715.418579:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789518715.418583:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.418590:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d600/0x631fd8698c787abf lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518715.419034:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.419101:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617495552 00000100:00100000:1.0:1789518715.419109:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617495552 00000100:00100000:1.0:1789518715.419164:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 561 00000100:00100000:1.0:1789518715.419174:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+79:41249:x1876445617495552:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518715.419198:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518715.419211:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2db expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.419253:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2db expref: 80 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.419266:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2db expref: 80 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.419282:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:1.0:1789518715.419285:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789518715.419287:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5380c00, rc 0) 00000100:00100000:1.0:1789518715.419335:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+80:41249:x1876445617495552:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 162us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.419342:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 561 00000100:00100000:3.0:1789518715.420800:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518715.420897:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617495680 00000100:00100000:0.0:1789518715.420908:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617495680 00000100:00100000:0.0:1789518715.420976:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:0.0:1789518715.420988:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617495680:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789518715.420992:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518715.421355:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617495680:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 369us (563us total) trans 30064771284 rc 0/0 00000100:00100000:0.0:1789518715.421364:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:2.0:1789518715.423015:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.423220:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617495936 00000100:00100000:1.0:1789518715.423231:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617495936 00000100:00100000:1.0:1789518715.423348:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:1.0:1789518715.423361:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+80:41249:x1876445617495936:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518715.423691:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+81:41249:x1876445617495936:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 332us (685us total) trans 30064771577 rc 0/0 00000100:00100000:1.0:1789518715.423700:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:2.0:1789518715.425476:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.425556:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617496192 00000100:00100000:1.0:1789518715.425568:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617496192 00000100:00100000:1.0:1789518715.425664:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 562 00000100:00100000:1.0:1789518715.425675:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+81:41249:x1876445617496192:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518715.425806:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+81:41249:x1876445617496192:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 132us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.425826:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 562 00000100:00100000:2.0:1789518715.428489:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.428579:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617496320 00000100:00100000:3.0:1789518715.428591:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617496320 00000100:00100000:1.0:1789518715.428962:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 563 00000100:00100000:1.0:1789518715.428976:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+81:41249:x1876445617496320:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789518715.429003:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518715.429027:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787acd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2e2 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.429109:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787ad4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.429126:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787ad4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.429152:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787ad4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518715.429199:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518715.429223:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787ad4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.429254:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787acd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e2 expref: 83 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.429274:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787ad4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e2 expref: 82 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.429282:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:1.0:1789518715.429285:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789518715.429289:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381c00, rc 0) 00000100:00100000:1.0:1789518715.429357:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+82:41249:x1876445617496320:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 384us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.429366:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 563 00000100:00100000:2.0:1789518715.431824:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518715.432190:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617496448 00000100:00100000:0.0:1789518715.432203:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617496448 00000100:00100000:0.0:1789518715.432273:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:0.0:1789518715.432285:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2344:x1876445617496448:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518715.432308:0:36735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518715.432333:0:36735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2e9 expref: -99 pid: 36735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789518715.432367:0:36735:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9e37c, blocks: 0x1 00010000:00010000:0.0:1789518715.432391:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=769s v=(0 0) 00010000:00010000:0.0:1789518715.432397:0:36735:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518715.432406:0:36735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e9 expref: 15 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.432424:0:36735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e9 expref: 15 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.432436:0:36735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22400, rc 0) 00000100:00100000:0.0:1789518715.432538:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2344:x1876445617496448:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 254us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518715.432597:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:2.0:1789518715.434542:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518715.434729:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617496704 00000100:00100000:0.0:1789518715.434739:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617496704 00000100:00100000:0.0:1789518715.434790:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 564 00000100:00100000:0.0:1789518715.434798:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+82:41249:x1876445617496704:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789518715.434924:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+82:41249:x1876445617496704:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 126us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518715.434931:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 564 00000100:00100000:2.0:1789518715.437570:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.437789:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617496832 00000100:00100000:3.0:1789518715.437800:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617496832 00000100:00100000:3.0:1789518715.438005:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:3.0:1789518715.438017:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:41249:x1876445617496832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789518715.438039:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518715.438062:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2f0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.438100:0:37973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e9 expref: 16 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.438110:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518715.438115:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518715.438121:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 16 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.438176:0:37973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e9 expref: 16 pid: 36735 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.438191:0:37973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e9 expref: 16 pid: 36735 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518715.438214:0:37973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:37973:1876445627682432:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518715.438335:0:37973:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd80a03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518715.440228:0:37973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:37973:1876445627682432:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518715.440267:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 16 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.440302:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14d800, rc 0) 00000100:00100000:3.0:1789518715.440470:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:41249:x1876445617496832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 2453us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518715.440480:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:2.0:1789518715.440780:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518715.441082:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617496960 00000100:00100000:0.0:1789518715.441090:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617496960 00010000:00010000:0.0:1789518715.441188:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e9 expref: 16 pid: 36735 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518715.441231:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:0.0:1789518715.441242:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdac56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2343:x1876445617496960:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518715.441259:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518715.441289:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e9 expref: 16 pid: 36735 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.441304:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e9 expref: 16 pid: 36735 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.441330:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd2fe72b/0x631fd8698c787adb lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e9 expref: 16 pid: 36735 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.441353:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518715.441358:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789518715.441366:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 15 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.441377:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 15 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.441416:0:35831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 15 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518715.441497:0:35831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7a78380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627682560:192.168.206.51@tcp:105: 00000100:00100000:0.0:1789518715.441666:0:35831:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffc30636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518715.443218:0:35831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7a78380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35831:1876445627682560:192.168.206.51@tcp:105: 00010000:00010000:0.0:1789518715.443241:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518715.443302:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdac56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617496960:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 2061us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518715.443313:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 97 00000100:00100000:2.0:1789518715.444351:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.444586:0:39460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617497088 00000100:00100000:1.0:1789518715.444596:0:39460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617497088 00002000:00100000:1.0:1789518715.444734:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcf:0x0] (0->1023) req@ffff99fec348b800 x1876445617497088/t0(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:361/0 lens 1512/0 e 0 to 0 dl 1789518726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518715.444747:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec348b800 with x1876445617497088 ext(0->1023) 00002000:00010000:1.0:1789518715.444753:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec348b800 00000100:00100000:1.0:1789518715.444785:0:39460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 371 00000100:00100000:1.0:1789518715.444795:0:39460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617497088:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789518715.445325:0:39460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2342:x1876445617497088:12345-192.168.206.51@tcp:4:lhsmtool_posix.0 Request processed in 528us (977us total) trans 30064771285 rc 0/0 00000100:00100000:1.0:1789518715.445334:0:39460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 371 00002000:00100000:1.0:1789518715.445342:0:39460:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcf:0x0] (0->1023) req@ffff99fec348b800 x1876445617497088/t30064771285(0) o4->7a240d1d-1bdd-4db2-880d-9900b335b1a6@192.168.206.51@tcp:361/0 lens 1512/448 e 0 to 0 dl 1789518726 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789518715.445352:0:39460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99fec348b800 with x1876445617497088 ext(0->1023) 00002000:00010000:1.0:1789518715.445356:0:39460:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99fec348b800 00000100:00100000:2.0:1789518715.447308:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.447382:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617497216 00000100:00100000:1.0:1789518715.447392:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617497216 00000100:00100000:1.0:1789518715.447520:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 565 00000100:00100000:1.0:1789518715.447531:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+82:41249:x1876445617497216:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789518715.483065:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771568 is committed 00000020:00080000:0.0:1789518715.483089:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803908 batchid updated 00000001:00080000:0.0:1789518715.483111:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771577 is committed 00000004:00080000:0.0:1789518715.483155:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000020:00080000:3.0:1789518715.483226:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803908 00000020:00080000:3.0:1789518715.483235:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803908 00000100:00100000:3.0:1789518715.483396:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627682688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789518715.483450:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518715.483515:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627682688 00000100:00100000:3.0:1789518715.483522:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627682688 00000100:00100000:3.0:1789518715.483571:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789518715.483580:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627682688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789518715.483768:0:36532:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1789518715.483772:0:36532:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb mtime from disk: 0 -> 1789518716 00002000:00010000:3.0:1789518715.483775:0:36532:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789518715.483777:0:36532:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb ctime from disk: 1789518716 -> 1789518716 00002000:00010000:3.0:1789518715.483779:0:36532:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789518715.483830:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627682688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (380us total) trans 30064771286 rc 0/0 00000100:00100000:3.0:1789518715.483838:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1789518715.483860:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518715.483919:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41249:x1876445617497216:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 36387us (36618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.483928:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 565 00000004:00080000:0.0:1789518715.484217:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec8220700/2, rc 0, transno 30064771286 00000100:00100000:0.0:1789518715.484224:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627682688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789518715.488295:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518715.488403:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617497344 00000100:00100000:0.0:1789518715.488413:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617497344 00000100:00100000:0.0:1789518715.488461:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:0.0:1789518715.488470:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+17:2343:x1876445617497344:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789518715.521745:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771284 is committed 00000001:00080000:2.0:1789518715.521768:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771285 is committed 00000001:00080000:2.0:1789518715.521781:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771286 is committed 00000100:00100000:1.0:1789518715.521873:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617497344:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 33395us (33577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.521887:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:2.0:1789518715.528356:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518715.528736:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617497600 00000100:00100000:0.0:1789518715.528749:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617497600 00000100:00100000:0.0:1789518715.529086:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 566 00000100:00100000:0.0:1789518715.529098:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41249:x1876445617497600:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789518715.529176:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518715.529217:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381c00/0x631fd8698c787ad4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2e2 expref: 57 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.529238:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:0.0:1789518715.529244:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518715.529281:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.529296:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.529305:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518715.529510:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d544279e reply state 00000000af3223de transno 30064771578 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518715.529519:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518715.529664:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:41249:x1876445617497600:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 569us (1320us total) trans 30064771578 rc 0/0 00000100:00100000:0.0:1789518715.529676:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 566 00010000:00010000:1.0:1789518715.532323:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.532345:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.532354:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.532361:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518715.532366:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.532373:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.532393:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:1.0:1789518715.532395:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518715.532400:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.532405:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787ae9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518715.533336:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.533475:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617497728 00000100:00100000:3.0:1789518715.533487:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617497728 00000100:00100000:3.0:1789518715.533549:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:3.0:1789518715.533559:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2343:x1876445617497728:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789518715.533872:0:37973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:3.0:1789518715.533877:0:37973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb mtime from disk: 1789518716 -> 1789518715 00002000:00010000:3.0:1789518715.533880:0:37973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb atime from disk: 0 -> 1789518714 00002000:00010000:3.0:1789518715.533882:0:37973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb ctime from disk: 1789518716 -> 1789518715 00002000:00010000:3.0:1789518715.533885:0:37973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789518715.534381:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617497728:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 400us (630us total) trans 30064771287 rc 0/0 00000100:00100000:3.0:1789518715.534392:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 170 00000001:00080000:2.0:1789518715.535284:0:6674:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771221 is committed 00000100:00100000:2.0:1789518715.535749:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.535824:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617497984 00000100:00100000:3.0:1789518715.535833:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617497984 00000100:00100000:3.0:1789518715.535887:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 567 00000100:00100000:3.0:1789518715.535897:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:41249:x1876445617497984:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789518715.536244:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.536264:0:37723:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2d4 expref: 57 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.536274:0:37723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.536317:0:37723:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2d4 expref: 57 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.536333:0:37723:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2d4 expref: 57 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518715.536348:0:37723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627682816:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518715.536493:0:37723:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789518715.539500:0:37723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37723:1876445627682816:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518715.539537:0:37723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518715.540387:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.540445:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617498112 00000100:00100000:1.0:1789518715.540454:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617498112 00010000:00010000:1.0:1789518715.540500:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2d4 expref: 58 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518715.540541:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 98 00000100:00100000:1.0:1789518715.540552:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8220380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2343:x1876445617498112:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518715.540570:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518715.540579:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2d4 expref: 58 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.540593:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2d4 expref: 58 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.540660:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900a00/0x631fd8698c787ab8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2d4 expref: 58 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.540676:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:1.0:1789518715.540682:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.540693:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.540701:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.540734:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518715.540792:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8220380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2343:x1876445617498112:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 242us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.540800:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 98 00010000:00010000:3.0:1789518715.540855:0:37723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.540864:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.540899:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.540907:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.540914:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.540920:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518715.540926:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.540934:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.540943:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:3.0:1789518715.540946:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789518715.540950:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.540957:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787af0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518715.541001:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:41249:x1876445617497984:12345-192.168.206.51@tcp:55:lhsmtool_posix.0 Request processed in 5105us (5255us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789518715.541010:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 567 00000100:00100000:2.0:1789518715.543114:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.543362:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617498240 00000100:00100000:3.0:1789518715.543375:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617498240 00000100:00100000:3.0:1789518715.543437:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:3.0:1789518715.543448:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617498240:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789518715.543507:0:36531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.543531:0:36531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 15 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.543542:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518715.543548:0:36531:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789518715.543553:0:36531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.543597:0:36531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 15 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.543768:0:36531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 15 pid: 37973 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518715.543793:0:36531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627682944:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518715.543890:0:36531:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffd811d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789518715.546993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.547127:0:36531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:36531:1876445627682944:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518715.547177:0:36531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518715.547275:0:40259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617498368 00000100:00100000:0.0:1789518715.547285:0:40259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617498368 00010000:00010000:0.0:1789518715.547325:0:40259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 16 pid: 37973 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518715.547412:0:40259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:0.0:1789518715.547422:0:40259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8223480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+16:2342:x1876445617498368:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518715.547440:0:40259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518715.547468:0:40259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 16 pid: 37973 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.547482:0:40259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 16 pid: 37973 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.547508:0:40259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088044a0b/0x631fd8698c787ae2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f0 expref: 16 pid: 37973 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.547528:0:40259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518715.547533:0:40259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789518715.547539:0:40259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.547550:0:40259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518715.547580:0:40259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789518715.547610:0:36531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.547635:0:36531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.547664:0:36531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518715.547674:0:40259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8223480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617498368:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 254us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518715.547682:0:40259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00010000:00010000:3.0:1789518715.547685:0:36531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.547698:0:36531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.547706:0:36531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518715.547711:0:36531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.547720:0:36531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.548020:0:36531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.548032:0:36531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674a6423/0x631fd8698c787af7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518715.548091:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617498240:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 4645us (4987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518715.548101:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:2.0:1789518715.551253:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.551331:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617498624 00000100:00100000:1.0:1789518715.551343:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617498624 00000100:00100000:1.0:1789518715.551402:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 568 00000100:00100000:1.0:1789518715.551410:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:41249:x1876445617498624:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789518715.551510:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.551533:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.551547:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.551937:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.551952:0:35845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2db expref: 57 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.551966:0:35845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.552007:0:35845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2db expref: 57 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.552022:0:35845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2db expref: 57 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518715.552038:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627683072:192.168.206.51@tcp:104: 00000100:00100000:1.0:1789518715.552152:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fffffbe540 going to sleep for 11 seconds 00000100:00100000:1.0:1789518715.556240:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627683072:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518715.556242:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:1.0:1789518715.556276:0:35845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518715.556540:0:35830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617498752 00000100:00100000:0.0:1789518715.556548:0:35830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617498752 00010000:00010000:1.0:1789518715.556664:0:35830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2db expref: 58 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518715.556841:0:35830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1789518715.556861:0:35830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+58:2342:x1876445617498752:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518715.556878:0:35830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518715.556886:0:35830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2db expref: 58 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.556900:0:35830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2db expref: 58 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.556926:0:35830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787ac6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2db expref: 58 pid: 39157 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.556942:0:35830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:1.0:1789518715.556947:0:35830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.556955:0:35830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.556960:0:35830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.556982:0:35830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789518715.557008:0:35845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.557016:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518715.557049:0:35830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+57:2342:x1876445617498752:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 197us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.557057:0:35830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000001:00080000:2.0:1789518715.557632:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771579 00000001:00080000:2.0:1789518715.558041:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771580 00000001:00080000:2.0:1789518715.558128:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771581 00000100:00100000:2.0:1789518715.558225:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8221880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35845:1876445627683200:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789518715.558278:0:35845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518715.558310:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789518715.558324:0:35850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627683200 00000100:00100000:1.0:1789518715.558331:0:35850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627683200 00000100:00100000:1.0:1789518715.558377:0:35850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789518715.558385:0:35850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35845:x1876445627683200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789518715.558531:0:35850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35845:x1876445627683200:12345-0@lo:1000:mdt00_000.0 Request processed in 145us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518715.558539:0:35850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789518715.558563:0:35845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771286 gen 2 00000004:00080000:2.0:1789518715.558569:0:35845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec8220700, transno 30064771286 00000100:00100000:2.0:1789518715.558586:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8221880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35845:1876445627683200:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789518715.559288:0:35845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771582 00000100:00100000:2.0:1789518715.559352:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8221880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35845:1876445627683328:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789518715.559390:0:35845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518715.559421:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789518715.559491:0:39259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627683328 00000100:00100000:1.0:1789518715.559496:0:39259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627683328 00000100:00100000:1.0:1789518715.559528:0:39259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789518715.559533:0:39259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35845:x1876445627683328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789518715.559749:0:39259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35845:x1876445627683328:12345-0@lo:1000:mdt00_000.0 Request processed in 213us (357us total) trans 30064771288 rc 0/0 00000100:00100000:1.0:1789518715.559757:0:39259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789518715.559898:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8221880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35845:1876445627683328:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789518715.559932:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.559943:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.559951:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.559958:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380600 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518715.559963:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.559972:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.559989:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99fff6905600) 00010000:00010000:2.0:1789518715.559993:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518715.559999:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560005:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380600/0x631fd8698c787b05 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560037:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560044:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560064:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560070:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381200 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518715.560073:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560079:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560088:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:2.0:1789518715.560090:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789518715.560097:0:35845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a5d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2bf expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560114:0:35845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a5d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2bf expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560124:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a5d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2bf expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.560159:0:35845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a5d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2bf expref: 60 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518715.560168:0:35845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8223b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627683456:192.168.206.51@tcp:105: 00000100:00100000:2.0:1789518715.560230:0:35845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec8f6c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789518715.563249:0:35845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8223b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35845:1876445627683456:192.168.206.51@tcp:105: 00010000:00010000:2.0:1789518715.563287:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563304:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381200/0x631fd8698c787a56 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563343:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563358:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563372:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563383:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563390:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563397:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563403:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518715.563408:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563416:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563428:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:2.0:1789518715.563431:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518715.563435:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563442:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901a00/0x631fd8698c787b0c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563452:0:35845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563459:0:35845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563464:0:35845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563470:0:35845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518715.563473:0:35845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563479:0:35845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563486:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:2.0:1789518715.563489:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789518715.563491:0:35845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518715.563497:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380a00/0x631fd8698c787afe lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518715.563862:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518715.564058:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617498880 00000100:00100000:1.0:1789518715.564068:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617498880 00000100:00100000:2.0:1789518715.564082:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:41249:x1876445617498624:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 12669us (12841us total) trans 30064771583 rc 0/0 00000100:00100000:2.0:1789518715.564096:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 568 00000020:00080000:2.0:1789518715.564104:0:35845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789518715.564143:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:1.0:1789518715.564155:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:41248:x1876445617498880:12345-192.168.206.51@tcp:49:lfs.0 00000100:00100000:1.0:1789518715.564267:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+60:41248:x1876445617498880:12345-192.168.206.51@tcp:49:lfs.0 Request processed in 113us (650us total) trans 0 rc 0/0 00000040:00080000:0.0:1789518715.564269:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518715.564277:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1789518715.564279:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 140 00000040:00080000:0.0:1789518715.565033:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 6 00000040:00080000:0.0:1789518715.565043:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518715.567552:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.567602:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518715.567702:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617499136 00000100:00100000:0.0:1789518715.567714:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617499136 00000100:00100000:1.0:1789518715.567732:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617499392 00000100:00100000:1.0:1789518715.567737:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617499392 00000100:00100000:1.0:1789518715.567780:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:1.0:1789518715.567788:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:41249:x1876445617499392:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789518715.567947:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 569 00000100:00100000:0.0:1789518715.567958:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+61:41248:x1876445617499136:12345-192.168.206.51@tcp:58:lfs.0 00000040:00080000:0.0:1789518715.568383:0:35846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].13, 136 off9960 00000100:00100000:0.0:1789518715.568489:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:41248:x1876445617499136:12345-192.168.206.51@tcp:58:lfs.0 Request processed in 532us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518715.568497:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 569 00000004:00080000:1.0:1789518715.568721:0:35848:0:(mdd_object.c:4014:mdd_close()) Object [0x2000032e1:0x38:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789518715.568836:0:35848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771584 00010000:00010000:1.0:1789518715.568895:0:35848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.568915:0:35848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.568930:0:35848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.568941:0:35848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.568954:0:35848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.568961:0:35848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518715.568986:0:35848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789518715.569039:0:35833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518715.569048:0:35833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518715.569055:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:41249:x1876445617499392:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 1266us (1513us total) trans 30064771585 rc 0/0 00010000:00010000:3.0:1789518715.569063:0:35833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380c00 already unused, calling callback (ffffffffc15168b0) 00000100:00100000:1.0:1789518715.569068:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 141 00010000:00010000:3.0:1789518715.569071:0:35833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789518715.569074:0:35848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518715.569085:0:35833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.569102:0:35833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x38:0x0].0x0 (ffff99ffc6733100) 00010000:00010000:3.0:1789518715.569105:0:35833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518715.569112:0:35833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.569119:0:35833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380c00/0x631fd8698c787b13 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.569151:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518715.569154:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518715.569156:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518715.572510:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.572571:0:40733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617499648 00000100:00100000:3.0:1789518715.572584:0:40733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617499648 00000100:00100000:3.0:1789518715.572730:0:40733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:3.0:1789518715.572742:0:40733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+62:41248:x1876445617499648:12345-192.168.206.51@tcp:35:lfs.500 00000100:00100000:3.0:1789518715.573208:0:40733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:41248:x1876445617499648:12345-192.168.206.51@tcp:35:lfs.500 Request processed in 467us (911us total) trans 30064771586 rc 0/0 00000100:00100000:3.0:1789518715.573217:0:40733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:2.0:1789518715.593148:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518715.593262:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617499776 00000100:00100000:3.0:1789518715.593274:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617499776 00000100:00100000:3.0:1789518715.593336:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 570 00000100:00100000:3.0:1789518715.593346:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+63:41251:x1876445617499776:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1789518715.593373:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518715.593395:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787b1a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2f7 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.593473:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.593490:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.593504:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.593519:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.593526:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.593533:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594027:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787b2f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594038:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787b2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594046:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787b2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518715.594087:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00000004:00200000:3.0:1789518715.594092:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518715.594114:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787b2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594127:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787b2f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594147:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594154:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594162:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594170:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518715.594174:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594183:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594196:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:3.0:1789518715.594200:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518715.594206:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594213:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c400/0x631fd8698c787b21 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594227:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594239:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594245:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594250:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518715.594253:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594258:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594265:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99ffc2fdc400) 00010000:00010000:3.0:1789518715.594268:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518715.594271:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594277:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b28 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594312:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787b1a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f7 expref: 65 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594326:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787b2f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f7 expref: 64 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518715.594334:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:3.0:1789518715.594337:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518715.594340:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14ca00, rc 0) 00000100:00100000:3.0:1789518715.594460:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:41251:x1876445617499776:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 1114us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518715.594469:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 570 00010000:00010000:3.0:1789518715.763243:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518716.065684:0:40775:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518716.065693:0:40775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518716.065749:0:40775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 7 00000040:00080000:3.0:1789518716.065754:0:40775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1789518716.594848:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518716.594856:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518716.595195:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789518716.595202:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518716.595306:0:35881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f89c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627683584:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789518716.595558:0:35881:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518716.600646:0:35881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f89c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35881:1876445627683584:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789518716.601093:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518716.601192:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617499904 00000100:00100000:2.0:1789518716.601200:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617499904 00000100:00080000:3.0:1789518716.601261:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518716.601270:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 571 00000100:00100000:2.0:1789518716.601282:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:41263:x1876445617499904:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789518716.601308:0:35845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000032e1:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789518716.601763:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:41263:x1876445617499904:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 482us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518716.601771:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 571 00000100:00100000:2.0:1789518716.604134:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518716.604223:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617500160 00000100:00100000:0.0:1789518716.604232:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617500160 00000100:00100000:0.0:1789518716.604285:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 572 00000100:00100000:0.0:1789518716.604294:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+64:41263:x1876445617500160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789518716.604312:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518716.604330:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe2fe expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518716.604479:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787b3d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518716.604494:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787b3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518716.604506:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787b3d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518716.604517:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00010000:00010000:0.0:1789518716.604655:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2fe expref: 67 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518716.604771:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787b3d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2fe expref: 66 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518716.604780:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:0.0:1789518716.604783:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518716.604787:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22e00, rc 0) 00000100:00100000:0.0:1789518716.604870:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:41263:x1876445617500160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 576us (752us total) trans 30064771587 rc 0/0 00000100:00100000:0.0:1789518716.604881:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 572 00000100:00100000:2.0:1789518716.612566:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518716.612625:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617500416 00000100:00100000:3.0:1789518716.612641:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617500416 00000100:00100000:3.0:1789518716.612721:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 573 00000100:00100000:2.0:1789518716.612804:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518716.612816:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:41263:x1876445617500416:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789518716.612896:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617500544 00000100:00100000:1.0:1789518716.612904:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617500544 00010000:00010000:3.0:1789518716.612993:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518716.613001:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00010000:00010000:3.0:1789518716.613021:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518716.613030:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8221f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:2343:x1876445617500544:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789518716.613046:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518716.613049:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518716.613075:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787b3d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2fe expref: 67 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518716.613093:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:1.0:1789518716.613098:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518716.613159:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8221f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:2343:x1876445617500544:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 136us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518716.613166:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00010000:00010000:3.0:1789518716.613318:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518716.613374:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518716.613382:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518716.613393:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14d000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518716.613398:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518716.613408:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518716.613421:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:3.0:1789518716.613424:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789518716.613430:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518716.613436:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787b4b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518716.613600:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:41263:x1876445617500416:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 793us (1041us total) trans 30064771588 rc 0/0 00000100:00100000:3.0:1789518716.613606:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 573 00000040:00080000:2.0:1789518716.614370:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518716.614377:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518716.614911:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 5 00000040:00080000:2.0:1789518716.614921:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518716.615208:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518716.615278:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617500800 00000100:00100000:1.0:1789518716.615286:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617500800 00000100:00100000:1.0:1789518716.615328:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:1.0:1789518716.615342:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+66:41263:x1876445617500800:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789518716.615534:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:41263:x1876445617500800:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 197us (328us total) trans 30064771589 rc 0/0 00000100:00100000:1.0:1789518716.615543:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00010000:00010000:3.0:1789518716.787040:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518717.042925:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518717.048888:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627683712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518717.048963:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518717.049063:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627683712 00000100:00100000:3.0:1789518717.049071:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627683712 00000100:00100000:3.0:1789518717.049153:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789518717.049163:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627683712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518717.049200:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518717.049266:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627683712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518717.049274:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789518717.049320:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771221 gen 2 00000004:00080000:0.0:1789518717.049332:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fff79ae680, transno 30064771221 00000100:00100000:0.0:1789518717.049366:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627683712:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518717.049412:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518717.555117:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518717.555222:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627683840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518717.555286:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518717.556243:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627683968:0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556284:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518717.556326:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627684480:0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556351:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518717.556373:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518717.556379:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627684096:0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556401:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518717.556433:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627683968 00000100:00100000:0.0:1789518717.556439:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627683968 00000100:00100000:0.0:1789518717.556477:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789518717.556485:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627683968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556530:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627683968:12345-0@lo:400:kworker.0 Request processed in 45us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518717.556537:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789518717.556563:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627684480 00000100:00100000:0.0:1789518717.556566:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627684480 00000100:00100000:0.0:1789518717.556599:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518717.556605:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627684480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556654:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627684480:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518717.556660:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789518717.556678:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627684096 00000100:00100000:0.0:1789518717.556681:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627684096 00000100:00100000:0.0:1789518717.556706:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789518717.556713:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627684096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556743:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627684096:12345-0@lo:400:kworker.0 Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518717.556748:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789518717.556768:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627684352:0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556792:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518717.556810:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518717.556815:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627684224:0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556835:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518717.556859:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627684352 00000100:00100000:0.0:1789518717.556862:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627684352 00000100:00100000:0.0:1789518717.556886:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627684224 00000100:00100000:0.0:1789518717.556889:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627684224 00000100:00100000:0.0:1789518717.556907:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789518717.556912:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627684352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556945:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627684352:12345-0@lo:400:kworker.0 Request processed in 33us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518717.556951:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789518717.556963:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789518717.556968:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627684224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.556997:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627684224:12345-0@lo:400:kworker.0 Request processed in 29us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518717.557003:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789518717.557040:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627684224:0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.557051:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627684352:0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.557078:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627684096:0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.557086:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627683968:0@lo:400:kworker.0 00000100:00100000:0.0:1789518717.557093:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627684480:0@lo:400:kworker.0 00000100:00080000:2.0:1789518717.558292:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518717.558298:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518717.561220:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627683840 00000100:00100000:3.0:1789518717.561233:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627683840 00000100:00100000:3.0:1789518717.561356:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789518717.561368:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627683840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518717.561403:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518717.561477:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627683840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (6190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518717.561485:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789518717.561661:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627683840:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789518717.561892:0:40826:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518717.561896:0:40826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518717.561927:0:40826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789518717.561931:0:40826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789518717.638370:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.638446:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617501056 00000100:00100000:0.0:1789518717.638461:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617501056 00000100:00100000:0.0:1789518717.638532:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 574 00000100:00100000:0.0:1789518717.638545:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+67:41280:x1876445617501056:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518717.638575:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518717.638600:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe305 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518717.638737:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:0.0:1789518717.638882:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe305 expref: 69 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.638904:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518717.638907:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518717.638913:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe305 expref: 69 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.638926:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22600, rc 0) 00000100:00100000:0.0:1789518717.638996:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:41280:x1876445617501056:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 455us (634us total) trans 30064771590 rc 301/301 00000100:00100000:0.0:1789518717.639004:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 574 00000100:00100000:2.0:1789518717.643227:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518717.643274:0:40733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617501312 00000100:00100000:3.0:1789518717.643287:0:40733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617501312 00000100:00100000:3.0:1789518717.643424:0:40733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:3.0:1789518717.643435:0:40733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+68:41280:x1876445617501312:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518717.643807:0:40733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:41280:x1876445617501312:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 372us (591us total) trans 30064771591 rc 0/0 00000100:00100000:3.0:1789518717.643816:0:40733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:3.0:1789518717.788201:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.788378:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617501440 00000100:00100000:0.0:1789518717.788387:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617501440 00000100:00100000:0.0:1789518717.788445:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 575 00000100:00100000:0.0:1789518717.788454:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:41307:x1876445617501440:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518717.788476:0:35845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518717.788494:0:35845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe30c expref: -99 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.788555:0:35845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787b67 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.788569:0:35845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787b67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.788582:0:35845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787b67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518717.788667:0:35845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:0.0:1789518717.788671:0:35845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518717.788692:0:35845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787b67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.788722:0:35845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe30c expref: 71 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.788740:0:35845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787b67 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe30c expref: 70 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.788748:0:35845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:0.0:1789518717.788751:0:35845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518717.788754:0:35845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23800, rc 0) 00000100:00100000:0.0:1789518717.788891:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41307:x1876445617501440:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 437us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518717.788899:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 575 00000100:00100000:1.0:1789518717.792180:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.792281:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617501696 00000100:00100000:0.0:1789518717.792293:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617501696 00000100:00100000:0.0:1789518717.792360:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 576 00000100:00100000:0.0:1789518717.792370:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41307:x1876445617501696:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:0.0:1789518717.792434:0:35847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518717.792465:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787914 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe264 expref: 70 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.792487:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518717.792499:0:35847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789518717.792938:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:41307:x1876445617501696:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 568us (769us total) trans 0 rc -17/-17 00000100:00100000:0.0:1789518717.792951:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 576 00000100:00100000:2.0:1789518717.805868:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.805934:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617501824 00000100:00100000:0.0:1789518717.805958:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617501824 00000100:00100000:0.0:1789518717.806088:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 577 00000100:00100000:0.0:1789518717.806101:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:41308:x1876445617501824:12345-192.168.206.51@tcp:101:chmod.0 00010000:00010000:0.0:1789518717.806136:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518717.806166:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787b6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe313 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.806255:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.806273:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.806287:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518717.806333:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789518717.806339:0:39157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518717.806363:0:39157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.806391:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787b6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe313 expref: 71 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.806413:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22600/0x631fd8698c787b75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe313 expref: 70 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.806428:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:0.0:1789518717.806431:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789518717.806435:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22600, rc 0) 00000100:00100000:0.0:1789518717.806514:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41308:x1876445617501824:12345-192.168.206.51@tcp:101:chmod.0 Request processed in 416us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518717.806522:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 577 00000100:00100000:3.0:1789518717.808496:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.808566:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617502080 00000100:00100000:0.0:1789518717.808575:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617502080 00000100:00100000:0.0:1789518717.808646:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 578 00000100:00100000:0.0:1789518717.808656:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41308:x1876445617502080:12345-192.168.206.51@tcp:36:chmod.0 00010000:00010000:0.0:1789518717.808716:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518717.808742:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787b67 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe30c expref: 70 pid: 35845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.808766:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380e00/0x631fd8698c787953 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe272 expref: 69 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.808778:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733600) 00010000:00010000:0.0:1789518717.808789:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518717.808818:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.808832:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.808842:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518717.809111:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000542954e6 reply state 000000008872121e transno 30064771592 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518717.809134:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789518717.809142:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000100:00100000:0.0:1789518717.809235:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41308:x1876445617502080:12345-192.168.206.51@tcp:36:chmod.0 Request processed in 571us (735us total) trans 30064771592 rc 0/0 00000100:00100000:0.0:1789518717.809243:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 578 00010000:00010000:0.0:1789518717.810750:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.810766:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.810774:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.810782:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23000 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518717.810788:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.810798:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.810819:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc2d97f00) 00010000:00010000:0.0:1789518717.810823:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789518717.810828:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.810833:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518717.810835:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23000/0x631fd8698c787b7c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518717.816137:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518717.816278:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617502208 00000100:00100000:1.0:1789518717.816290:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617502208 00000100:00100000:1.0:1789518717.816365:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 579 00000100:00100000:1.0:1789518717.816377:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:41309:x1876445617502208:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:1.0:1789518717.816409:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789518717.816434:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787b83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe31a expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.816526:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.816543:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.816557:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.816574:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.816581:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.816588:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.816914:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787b98 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.816924:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787b98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.816932:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787b98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789518717.816963:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:1.0:1789518717.816968:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789518717.816989:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787b98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817003:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817010:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817016:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817023:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5381e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518717.817027:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817036:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817050:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:1.0:1789518717.817053:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518717.817059:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817066:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381e00/0x631fd8698c787b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817079:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817085:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817091:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817096:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffc5380400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518717.817099:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817104:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817110:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff99ffc6733900) 00010000:00010000:1.0:1789518717.817112:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518717.817115:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817133:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5380400/0x631fd8698c787b91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817173:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381a00/0x631fd8698c787b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe31a expref: 71 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817188:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffc5381800/0x631fd8698c787b98 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe31a expref: 70 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.817195:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:1.0:1789518717.817197:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789518717.817200:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffc5381800, rc 0) 00000100:00100000:1.0:1789518717.817273:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41309:x1876445617502208:12345-192.168.206.51@tcp:101:rm.0 Request processed in 898us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518717.817280:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 579 00000100:00100000:3.0:1789518717.821092:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518717.821229:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617502336 00000100:00100000:2.0:1789518717.821242:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617502336 00000100:00080000:0.0:1789518717.821307:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518717.821368:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:2.0:1789518717.821380:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617502336:12345-192.168.206.51@tcp:101:rm.0 00010000:00010000:2.0:1789518717.821403:0:37973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518717.821428:0:37973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe321 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789518717.821459:0:37973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcf:0x0] initial LVB size: 1024, mtime: 0x6aa9e37b, atime: 0x6aa9e37a, ctime: 0x6aa9e37b, blocks: 0xb 00010000:00010000:2.0:1789518717.821483:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=771s v=(0 0) 00010000:00010000:2.0:1789518717.821488:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789518717.821499:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe321 expref: 15 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518717.821520:0:37973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe321 expref: 15 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518717.821535:0:37973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6901800, rc 0) 00000100:00100000:2.0:1789518717.822066:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2342:x1876445617502336:12345-192.168.206.51@tcp:101:rm.0 Request processed in 686us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518717.822075:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:2.0:1789518717.824679:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.824835:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617502592 00000100:00100000:0.0:1789518717.824848:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617502592 00000100:00100000:0.0:1789518717.824913:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 580 00000100:00100000:0.0:1789518717.824924:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41309:x1876445617502592:12345-192.168.206.51@tcp:36:rm.0 00010000:00010000:0.0:1789518717.825107:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789518717.825150:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ca00/0x631fd8698c787b2f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2f7 expref: 70 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.825177:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14ce00/0x631fd8698c787a5d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe2bf expref: 69 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.825190:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc6733d00) 00010000:00010000:0.0:1789518717.825203:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518717.825229:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.825245:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.825256:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.825344:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.825353:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.825364:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.826158:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.826169:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.826177:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789518717.827048:0:39157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].20, 64 off9784 00000004:00080000:0.0:1789518717.827062:0:39157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771823446524ns, next at 772823443008ns, rc = 0 00010000:00010000:0.0:1789518717.827144:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827157:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827171:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827180:0:39157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827188:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827195:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827282:0:39157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789518717.827308:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827315:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827322:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827328:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518717.827333:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827341:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827352:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:0.0:1789518717.827355:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789518717.827359:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827365:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bb4 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827385:0:39157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827392:0:39157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827402:0:39157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827407:0:39157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518717.827410:0:39157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827425:0:39157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827434:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:0.0:1789518717.827436:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518717.827439:0:39157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.827445:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787ba6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518717.827456:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bcab696 reply state 00000000ebbd538a transno 30064771593 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518717.827466:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518717.827590:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+70:41309:x1876445617502592:12345-192.168.206.51@tcp:36:rm.0 Request processed in 2662us (2918us total) trans 30064771593 rc 0/0 00000100:00100000:0.0:1789518717.827599:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 580 00010000:00010000:3.0:1789518717.828322:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789518717.828333:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.828342:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22000 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:3.0:1789518717.828345:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.828352:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.828469:0:36743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff99ffc2d97e00) 00010000:00010000:3.0:1789518717.828471:0:36743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789518717.828475:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.828481:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22000/0x631fd8698c787bbb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.828500:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518717.828502:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518717.828503:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518717.829951:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.829966:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.829973:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.829979:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518717.829984:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.829992:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.830007:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99ffc2d97f00) 00010000:00010000:1.0:1789518717.830010:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518717.830014:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518717.830020:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23400/0x631fd8698c787bad lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518717.860509:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.860674:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617502848 00000100:00100000:0.0:1789518717.860686:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617502848 00000100:00100000:0.0:1789518717.860751:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 581 00000100:00100000:0.0:1789518717.860763:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+69:41316:x1876445617502848:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:0.0:1789518717.860797:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518717.860823:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787bc2 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe328 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.861546:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.861566:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.861581:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.861598:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.861606:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.861638:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862347:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862360:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862368:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518717.862378:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3a:0x0]: returning size 0 00010000:00010000:0.0:1789518717.862411:0:37723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862420:0:37723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862429:0:37723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862436:0:37723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518717.862442:0:37723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862450:0:37723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862464:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:0.0:1789518717.862468:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518717.862474:0:37723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862481:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bc9 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789518717.862496:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075ec0e76 reply state 000000000f39544d transno 30064771594 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518717.862507:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789518717.862542:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787bc2 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe328 expref: 72 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862558:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe328 expref: 71 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.862567:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518717.862569:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789518717.862572:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23c00, rc 0) 00000100:00100000:0.0:1789518717.862715:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:41316:x1876445617502848:12345-192.168.206.51@tcp:101:dd.500 Request processed in 1953us (2218us total) trans 30064771594 rc 0/0 00000100:00100000:0.0:1789518717.862725:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 581 00010000:00010000:3.0:1789518717.865611:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518717.865667:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:3.0:1789518717.865674:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.865685:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.865692:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518717.865698:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.865706:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.865723:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99ffc2d97200) 00010000:00010000:3.0:1789518717.865727:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518717.865733:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518717.865740:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23a00/0x631fd8698c787bd0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518717.866021:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617503104 00000100:00100000:1.0:1789518717.866033:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617503104 00000100:00100000:1.0:1789518717.866095:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:1.0:1789518717.866186:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+71:41316:x1876445617503104:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:1.0:1789518717.866595:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:41316:x1876445617503104:12345-192.168.206.51@tcp:35:dd.500 Request processed in 414us (933us total) trans 30064771595 rc 0/0 00000100:00100000:1.0:1789518717.866604:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:1.0:1789518717.911153:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.911259:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617503360 00000100:00100000:0.0:1789518717.911268:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617503360 00000100:00100000:0.0:1789518717.911315:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 582 00000100:00100000:0.0:1789518717.911323:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+72:41326:x1876445617503360:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518717.911345:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518717.911365:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787be5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe32f expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518717.911463:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:0.0:1789518717.911575:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787be5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe32f expref: 74 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.911588:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fec3b12b00) 00010000:00010000:0.0:1789518717.911590:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789518717.911595:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787be5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe32f expref: 74 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.911608:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23800, rc 0) 00000100:00100000:0.0:1789518717.911899:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:41326:x1876445617503360:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 575us (753us total) trans 30064771596 rc 301/301 00000100:00100000:0.0:1789518717.911907:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 582 00000100:00100000:2.0:1789518717.915809:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518717.915931:0:40733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617503616 00000100:00100000:3.0:1789518717.915940:0:40733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617503616 00000100:00100000:3.0:1789518717.915984:0:40733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:3.0:1789518717.915992:0:40733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+73:41326:x1876445617503616:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1789518717.916250:0:40733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:41326:x1876445617503616:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 257us (448us total) trans 30064771597 rc 0/0 00000100:00100000:3.0:1789518717.916257:0:40733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:3.0:1789518717.972251:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.973224:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617503872 00000100:00100000:0.0:1789518717.973235:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617503872 00000100:00100000:0.0:1789518717.973292:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 583 00000100:00100000:0.0:1789518717.973301:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+74:41332:x1876445617503872:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:0.0:1789518717.973322:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518717.973341:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787bf3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe336 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.973424:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bfa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.973437:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bfa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.973449:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bfa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518717.973459:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3a:0x0]: returning size 0 00010000:00010000:0.0:1789518717.973567:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787bf3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe336 expref: 77 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.973585:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bfa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe336 expref: 76 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518717.973593:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518717.973596:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518717.973600:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22e00, rc 0) 00000100:00100000:0.0:1789518717.973877:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41332:x1876445617503872:12345-192.168.206.51@tcp:101:dd.500 Request processed in 576us (1634us total) trans 30064771598 rc 0/0 00000100:00100000:0.0:1789518717.973886:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 583 00000100:00100000:1.0:1789518717.977044:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518717.977131:0:35848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617504128 00000100:00100000:0.0:1789518717.977140:0:35848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617504128 00000100:00100000:0.0:1789518717.977191:0:35848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:0.0:1789518717.977201:0:35848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd80bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+76:41332:x1876445617504128:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:0.0:1789518717.977397:0:35848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd80bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:41332:x1876445617504128:12345-192.168.206.51@tcp:35:dd.500 Request processed in 197us (360us total) trans 30064771599 rc 0/0 00000100:00100000:0.0:1789518717.977404:0:35848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 147 00000100:00100000:3.0:1789518718.019784:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518718.019934:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617504384 00000100:00100000:0.0:1789518718.019943:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617504384 00000100:00100000:0.0:1789518718.020019:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 584 00000100:00100000:0.0:1789518718.020030:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+77:41338:x1876445617504384:12345-192.168.206.51@tcp:36:truncate.500 00010000:00010000:0.0:1789518718.020082:0:37723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518718.020107:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787bfa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe336 expref: 77 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.020136:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518718.020141:0:37723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518718.020322:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.020335:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.020345:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518718.020398:0:37723:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771600 00000004:00010000:0.0:1789518718.020423:0:37723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b0c7f7a reply state 000000003ad2c464 transno 30064771601 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518718.020432:0:37723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518718.020512:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+79:41338:x1876445617504384:12345-192.168.206.51@tcp:36:truncate.500 Request processed in 484us (737us total) trans 30064771601 rc 0/0 00000100:00100000:0.0:1789518718.020519:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 584 00000020:00080000:0.0:1789518718.020524:0:37723:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1789518718.020754:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789518718.022439:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.022454:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.022462:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.022468:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518718.022473:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.022480:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.022494:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518718.022497:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518718.022501:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.022506:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23800/0x631fd8698c787c08 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518718.059497:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518718.059593:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617504512 00000100:00100000:0.0:1789518718.059608:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617504512 00000100:00100000:0.0:1789518718.059802:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 585 00000100:00100000:0.0:1789518718.059813:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+78:41344:x1876445617504512:12345-192.168.206.51@tcp:101:truncate.500 00010000:00010000:0.0:1789518718.059836:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518718.059856:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787c0f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe33d expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.059919:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.059933:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.059943:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.059957:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.059968:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.059974:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060068:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c24 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060077:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060084:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518718.060138:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3a:0x0]: returning size 256 00000004:00200000:0.0:1789518718.060143:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518718.060163:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060174:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060182:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060189:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060205:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060216:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22800 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518718.060220:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060228:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060239:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:0.0:1789518718.060242:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518718.060247:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060253:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c16 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060265:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060271:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060277:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060282:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518718.060285:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060296:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060309:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518718.060311:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518718.060314:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060324:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787c1d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060354:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22e00/0x631fd8698c787c0f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe33d expref: 80 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060367:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c24 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe33d expref: 79 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.060375:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518718.060377:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518718.060380:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22a00, rc 0) 00000100:00100000:0.0:1789518718.060456:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+79:41344:x1876445617504512:12345-192.168.206.51@tcp:101:truncate.500 Request processed in 644us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518718.060463:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 585 00000100:00100000:3.0:1789518718.061923:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518718.061994:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617504768 00000100:00100000:0.0:1789518718.062001:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617504768 00000100:00100000:0.0:1789518718.062053:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 586 00000100:00100000:0.0:1789518718.062063:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+79:41344:x1876445617504768:12345-192.168.206.51@tcp:36:truncate.500 00010000:00010000:0.0:1789518718.062114:0:39157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518718.062144:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c24 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe33d expref: 79 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.062164:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518718.062168:0:39157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518718.062337:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.062347:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.062355:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518718.062402:0:39157:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771602 00000004:00010000:0.0:1789518718.062429:0:39157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044aa0e89 reply state 00000000e53c6fb1 transno 30064771603 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518718.062437:0:39157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518718.062514:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+81:41344:x1876445617504768:12345-192.168.206.51@tcp:36:truncate.500 Request processed in 452us (593us total) trans 30064771603 rc 0/0 00000100:00100000:0.0:1789518718.062521:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 586 00000020:00080000:0.0:1789518718.062526:0:39157:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789518718.063911:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.063922:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.063929:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.063935:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23e00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:3.0:1789518718.063939:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.063947:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.063959:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:3.0:1789518718.063962:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789518718.063967:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.063973:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23e00/0x631fd8698c787c2b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518718.100477:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518718.100645:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617505024 00000100:00100000:2.0:1789518718.100655:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617505024 00000100:00100000:2.0:1789518718.100713:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 587 00000100:00100000:2.0:1789518718.100723:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+80:41350:x1876445617505024:12345-192.168.206.51@tcp:101:dd.500 00010000:00010000:2.0:1789518718.100746:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518718.100765:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787c32 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe344 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.100906:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.100919:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.100930:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.100944:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.100951:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.100957:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101029:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787c47 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101038:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787c47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101046:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787c47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518718.101055:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3a:0x0]: returning size 2048 00010000:00010000:2.0:1789518718.101317:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101325:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101332:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101338:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901400 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518718.101342:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101353:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101365:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:2.0:1789518718.101368:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518718.101372:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101378:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901400/0x631fd8698c787c39 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101392:0:35847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101398:0:35847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101403:0:35847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101408:0:35847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fff6901c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:2.0:1789518718.101411:0:35847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101430:0:35847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101437:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99fff6905a00) 00010000:00010000:2.0:1789518718.101439:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789518718.101442:0:35847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101448:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6901c00/0x631fd8698c787c40 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101677:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787c32 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe344 expref: 83 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101753:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787c47 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe344 expref: 82 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.101761:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518718.101764:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789518718.101766:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900200, rc 0) 00000100:00100000:2.0:1789518718.101830:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+82:41350:x1876445617505024:12345-192.168.206.51@tcp:101:dd.500 Request processed in 1109us (1363us total) trans 30064771604 rc 0/0 00000100:00100000:2.0:1789518718.101838:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 587 00000100:00100000:1.0:1789518718.108250:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518718.108372:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518718.108607:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617505408 00000100:00100000:0.0:1789518718.108648:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617505408 00000100:00100000:0.0:1789518718.108719:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 588 00000100:00100000:0.0:1789518718.108728:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+82:41350:x1876445617505408:12345-192.168.206.51@tcp:36:dd.500 00000100:00100000:2.0:1789518718.108950:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617505152 00000100:00100000:2.0:1789518718.108956:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617505152 00000100:00100000:2.0:1789518718.108991:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:2.0:1789518718.109000:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+84:2344:x1876445617505152:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518718.109004:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.109011:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518718.109097:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.109114:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789518718.109180:0:35846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771605 00000004:00010000:0.0:1789518718.109206:0:35846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004acc9d23 reply state 000000006fd4a574 transno 30064771606 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518718.109215:0:35846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789518718.109313:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+86:41350:x1876445617505408:12345-192.168.206.51@tcp:36:dd.500 Request processed in 586us (941us total) trans 30064771606 rc 0/0 00000100:00100000:0.0:1789518718.109321:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 588 00000020:00080000:0.0:1789518718.109327:0:35846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789518718.109339:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787c47 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe344 expref: 85 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.109360:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:2.0:1789518718.109365:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789518718.109392:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+84:2344:x1876445617505152:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 393us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518718.109399:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00010000:00010000:1.0:1789518718.111204:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.111218:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.111226:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.111231:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:1.0:1789518718.111236:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.111242:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.111256:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518718.111259:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789518718.111263:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.111274:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787c55 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518718.111840:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518718.112150:0:40733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617505664 00000100:00100000:3.0:1789518718.112159:0:40733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617505664 00000100:00100000:3.0:1789518718.112243:0:40733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:3.0:1789518718.112253:0:40733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+83:41350:x1876445617505664:12345-192.168.206.51@tcp:35:dd.500 00000100:00100000:3.0:1789518718.112550:0:40733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+84:41350:x1876445617505664:12345-192.168.206.51@tcp:35:dd.500 Request processed in 298us (714us total) trans 30064771607 rc 0/0 00000100:00100000:3.0:1789518718.112558:0:40733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:3.0:1789518718.159744:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518718.159820:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617505920 00000100:00100000:0.0:1789518718.159833:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617505920 00000100:00100000:0.0:1789518718.159965:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 589 00000100:00100000:0.0:1789518718.159993:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+84:41360:x1876445617505920:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518718.160017:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518718.160038:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe34b expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.160153:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787c63 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.160167:0:39157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787c63 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.160187:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787c63 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518718.160203:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00010000:00010000:0.0:1789518718.160310:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe34b expref: 87 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.160328:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22400/0x631fd8698c787c63 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe34b expref: 86 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.160336:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:0.0:1789518718.160339:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518718.160342:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22400, rc 0) 00000100:00100000:0.0:1789518718.160410:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+86:41360:x1876445617505920:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 435us (676us total) trans 30064771608 rc 0/0 00000100:00100000:0.0:1789518718.160429:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 589 00000100:00100000:1.0:1789518718.203909:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518718.204020:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617506048 00000100:00100000:2.0:1789518718.204034:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617506048 00000100:00100000:2.0:1789518718.204110:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 590 00000100:00100000:2.0:1789518718.204131:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+86:41366:x1876445617506048:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:2.0:1789518718.204155:0:35847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789518718.204174:0:35847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787c71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe352 expref: -99 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.204236:0:35847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787c78 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.204250:0:35847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787c78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.204261:0:35847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787c78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789518718.204295:0:35847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 16384 00000004:00200000:2.0:1789518718.204299:0:35847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789518718.204316:0:35847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787c78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.204339:0:35847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900200/0x631fd8698c787c71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe352 expref: 88 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.204357:0:35847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fff6900800/0x631fd8698c787c78 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe352 expref: 87 pid: 35847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789518718.204370:0:35847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:2.0:1789518718.204373:0:35847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789518718.204376:0:35847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fff6900800, rc 0) 00000100:00100000:2.0:1789518718.204450:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+87:41366:x1876445617506048:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 331us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518718.204457:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 590 00000100:00100000:1.0:1789518718.207993:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518718.208100:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617506176 00000100:00100000:3.0:1789518718.208113:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617506176 00000100:00100000:3.0:1789518718.208747:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 591 00000100:00100000:3.0:1789518718.208762:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+87:41366:x1876445617506176:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:3.0:1789518718.208790:0:37723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789518718.208815:0:37723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787c7f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe359 expref: -99 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.208896:0:37723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.208917:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.208931:0:37723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789518718.208980:0:37723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3a:0x0]: returning size 0 00000004:00200000:3.0:1789518718.208985:0:37723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789518718.209014:0:37723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.209030:0:37723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.209057:0:37723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14d000/0x631fd8698c787c7f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe359 expref: 89 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.209079:0:37723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe359 expref: 88 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518718.209088:0:37723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:3.0:1789518718.209092:0:37723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789518718.209096:0:37723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fffc14c000, rc 0) 00000100:00100000:3.0:1789518718.209182:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+88:41366:x1876445617506176:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 425us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518718.209190:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 591 00000100:00100000:3.0:1789518718.211723:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518718.211807:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617506432 00000100:00100000:0.0:1789518718.211825:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617506432 00000100:00100000:0.0:1789518718.211900:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 592 00000100:00100000:0.0:1789518718.211911:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+88:41366:x1876445617506432:12345-192.168.206.51@tcp:101:lfs.500 00010000:00010000:0.0:1789518718.211930:0:39157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518718.211949:0:39157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c8d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe360 expref: -99 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.212051:0:39157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.212067:0:39157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe328 expref: 89 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.212080:0:39157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe359 expref: 89 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.212088:0:39157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 5/0,1 mode: --/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.212134:0:39157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe359 expref: 89 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.212147:0:39157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe359 expref: 89 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518718.212170:0:39157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:39157:1876445627684608:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518718.212284:0:39157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe328 expref: 89 pid: 37723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.212295:0:39157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe328 expref: 89 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518718.212304:0:39157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:39157:1876445627684736:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518718.212334:0:39157:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffdfd6f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789518718.214156:0:39157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddf480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:39157:1876445627684608:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518718.214291:0:39157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:39157:1876445627684736:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518718.214329:0:39157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518718.215155:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518718.215191:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518718.216178:0:40259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617506560 00000100:00100000:1.0:1789518718.216179:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617506688 00000100:00100000:1.0:1789518718.216190:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617506688 00000100:00100000:0.0:1789518718.216190:0:40259:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617506560 00010000:00010000:1.0:1789518718.216248:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe328 expref: 91 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.216248:0:40259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe359 expref: 91 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518718.216310:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:1.0:1789518718.216322:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc7be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+91:2342:x1876445617506688:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518718.216341:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518718.216348:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe328 expref: 91 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.216360:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe328 expref: 91 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.216385:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787bd7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe328 expref: 91 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518718.216415:0:40259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:0.0:1789518718.216429:0:40259:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+90:2343:x1876445617506560:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789518718.216439:0:40259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789518718.216445:0:40259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe359 expref: 90 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.216513:0:35831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518718.216520:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.216536:0:35831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.216544:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789518718.216548:0:40259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe359 expref: 90 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.216561:0:40259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fffc14c000/0x631fd8698c787c86 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe359 expref: 90 pid: 37723 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.216571:0:40259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518718.216574:0:40259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.216580:0:40259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.216586:0:40259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.216608:0:40259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518718.216655:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc7be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:2342:x1876445617506688:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 334us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518718.216667:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:0.0:1789518718.216667:0:40259:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:2343:x1876445617506560:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 242us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518718.216678:0:40259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00010000:00010000:0.0:1789518718.216762:0:39157:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.216771:0:39157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 39157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518718.216793:0:39157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3a:0x0]: returning size 0 00010000:00010000:0.0:1789518718.216970:0:39157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787c8d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe360 expref: 89 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.216983:0:39157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe360 expref: 88 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.216988:0:39157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518718.216990:0:39157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789518718.216991:0:39157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed23200, rc 0) 00000100:00100000:0.0:1789518718.217026:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+88:41366:x1876445617506432:12345-192.168.206.51@tcp:101:lfs.500 Request processed in 5119us (5315us total) trans 30064771609 rc 0/0 00000100:00100000:0.0:1789518718.217031:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 592 00000100:00100000:3.0:1789518718.236536:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518718.236643:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617506816 00000100:00100000:0.0:1789518718.236655:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617506816 00000100:00100000:0.0:1789518718.236720:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 593 00000100:00100000:0.0:1789518718.236739:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+88:41368:x1876445617506816:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1789518718.236771:0:35846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789518718.236801:0:35846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787ca2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3825108e0cfe367 expref: -99 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.236920:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.236937:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.236950:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.236968:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.236975:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.236981:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.237088:0:35846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.237101:0:35846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe360 expref: 89 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.237110:0:35846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.237163:0:35846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe360 expref: 89 pid: 39157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.237185:0:35846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe360 expref: 89 pid: 39157 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789518718.237198:0:35846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627684864:192.168.206.51@tcp:104: 00000100:00100000:0.0:1789518718.237300:0:35846:0:(client.c:2716:ptlrpc_set_wait()) set ffff99ffee58e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789518718.239414:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518718.239514:0:35849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617507072 00000100:00100000:2.0:1789518718.239526:0:35849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617507072 00000100:00100000:2.0:1789518718.239593:0:35849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:2.0:1789518718.239608:0:35849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+90:31049:x1876445617507072:12345-192.168.206.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789518718.239683:0:35846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35846:1876445627684864:192.168.206.51@tcp:104: 00010000:00010000:0.0:1789518718.239715:0:35846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518718.240094:0:35849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+91:31049:x1876445617507072:12345-192.168.206.51@tcp:35:ldlm_bl.0 Request processed in 487us (690us total) trans 30064771610 rc 0/0 00000100:00100000:2.0:1789518718.240103:0:35849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:2.0:1789518718.241655:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518718.241829:0:35832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617507200 00000100:00100000:1.0:1789518718.241840:0:35832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617507200 00010000:00010000:1.0:1789518718.241946:0:35832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe360 expref: 91 pid: 39157 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518718.241991:0:35832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1789518718.242002:0:35832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+91:2343:x1876445617507200:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518718.242018:0:35832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518718.242025:0:35832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe360 expref: 91 pid: 39157 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.242038:0:35832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe360 expref: 91 pid: 39157 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.242061:0:35832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23200/0x631fd8698c787c94 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe360 expref: 91 pid: 39157 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.242080:0:35832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:1.0:1789518718.242086:0:35832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.242097:0:35832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.242105:0:35832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518718.242253:0:35832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518718.242320:0:35832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+90:2343:x1876445617507200:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 319us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518718.242330:0:35832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00010000:00010000:0.0:1789518718.242599:0:35846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.242609:0:35846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789518718.242933:0:35846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3a:0x0]: returning size 0 00000004:00200000:0.0:1789518718.242938:0:35846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789518718.242963:0:35846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.242979:0:35846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.242989:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.242997:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243009:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243015:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed23c00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518718.243020:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243028:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243039:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff99ffc6733300) 00010000:00010000:0.0:1789518718.243042:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518718.243045:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243052:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed23c00/0x631fd8698c787ca9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243067:0:35846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243074:0:35846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243080:0:35846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243085:0:35846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffeed22a00 already unused, calling callback (ffffffffc1f3e4f0) 00010000:00010000:0.0:1789518718.243087:0:35846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243097:0:35846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243105:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff99ffc2d97d00) 00010000:00010000:0.0:1789518718.243107:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789518718.243111:0:35846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243251:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22a00/0x631fd8698c787cb0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243345:0:35846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22800/0x631fd8698c787ca2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe367 expref: 90 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243360:0:35846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffeed22c00/0x631fd8698c787cb7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe367 expref: 89 pid: 35846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789518718.243367:0:35846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3a:0x0].0x0 (ffff99ffc2d97b00) 00010000:00010000:0.0:1789518718.243369:0:35846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789518718.243372:0:35846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffeed22c00, rc 0) 00000100:00100000:0.0:1789518718.243458:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:41368:x1876445617506816:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 6729us (6934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518718.243466:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 593 00000040:00080000:0.0:1789518718.720930:0:40877:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518718.720940:0:40877:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518718.720991:0:40877:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789518718.720996:0:40877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518718.836056:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518718.862448:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518718.862498:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518718.862539:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518718.862561:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518718.862586:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518718.862660:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617507712 00000100:00100000:2.0:1789518718.862669:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617507712 00000100:00100000:1.0:1789518718.862673:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617507328 00000100:00100000:1.0:1789518718.862686:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617507328 00000100:00100000:2.0:1789518718.862716:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617507584 00000100:00100000:2.0:1789518718.862721:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617507584 00000100:00100000:1.0:1789518718.862766:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00100000:2.0:1789518718.862773:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1789518718.862786:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617507328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518718.862789:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617507712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518718.862918:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617507456 00000100:00100000:3.0:1789518718.862923:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617507456 00000100:00100000:3.0:1789518718.862948:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617507840 00000100:00100000:3.0:1789518718.862950:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617507840 00000100:00100000:3.0:1789518718.862970:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:3.0:1789518718.862977:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:2343:x1876445617507456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518718.863039:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+15:2343:x1876445617507712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 256us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518718.863048:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:2.0:1789518718.863065:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1789518718.863071:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617507584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518718.863164:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:0.0:1789518718.863174:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617507840:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518718.863439:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617507328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 657us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518718.863450:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 157 00000100:00080000:1.0:1789518718.863530:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518718.863536:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518718.865527:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+89:2343:x1876445617507456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2539us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518718.865540:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:2.0:1789518718.866374:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617507584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3293us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518718.866385:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:0.0:1789518718.867484:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617507840:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 4298us (4882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518718.867496:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00010000:00010000:3.0:1789518719.859222:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518720.224927:0:40928:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518720.224936:0:40928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518720.225002:0:40928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789518720.225010:0:40928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000001:00080000:0.0:1789518720.662143:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771609 is committed 00000004:00080000:0.0:1789518720.662180:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 19 committed 00000001:00080000:0.0:1789518720.662223:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771610 is committed 00000020:00080000:0.0:1789518720.662238:0:5833:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fec8f6c0c0 refcount 2 committed 0 result 0 batchid 25769803909 00000020:00080000:0.0:1789518720.662243:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeed6c000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffd80a03c0 00000020:00080000:0.0:1789518720.662246:0:5833:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99ffeed6c500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fff494b800 00000001:00080000:3.0:1789518720.662317:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771288 is committed 00000001:00080000:3.0:1789518720.662328:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771287 is committed 00000020:00080000:0.0:1789518720.662453:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803909 committed batchid 25769803908 00000100:00100000:1.0:1789518720.662475:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518720.662496:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627684992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789518720.662569:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789518720.662666:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803908 00000100:00100000:3.0:1789518720.662851:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627684992 00000100:00100000:3.0:1789518720.662860:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627684992 00000100:00100000:3.0:1789518720.662961:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789518720.662970:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627684992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789518720.662994:0:37973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:207 count 1 00010000:00010000:3.0:1789518720.663017:0:37973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518720.663037:0:37973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe321 expref: 13 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518720.663046:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789518720.663051:0:37973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789518720.663055:0:37973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 4/0,1 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518720.663081:0:37973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe321 expref: 13 pid: 37973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518720.663096:0:37973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe321 expref: 13 pid: 37973 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789518720.663119:0:37973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:37973:1876445627685120:192.168.206.51@tcp:104: 00000100:00100000:3.0:1789518720.663180:0:37973:0:(client.c:2716:ptlrpc_set_wait()) set ffff99fec846d840 going to sleep for 11 seconds 00000100:00080000:1.0:1789518720.663652:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518720.665167:0:37973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:37973:1876445627685120:192.168.206.51@tcp:104: 00010000:00010000:3.0:1789518720.665192:0:37973:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789518720.666507:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518720.666745:0:35831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617507968 00000100:00100000:1.0:1789518720.666756:0:35831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617507968 00010000:00010000:1.0:1789518720.666977:0:35831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe321 expref: 14 pid: 37973 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789518720.667016:0:35831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:1.0:1789518720.667026:0:35831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+14:2342:x1876445617507968:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789518720.667039:0:35831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789518720.667045:0:35831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe321 expref: 14 pid: 37973 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.667058:0:35831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe321 expref: 14 pid: 37973 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.667080:0:35831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb8d4def/0x631fd8698c787b9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.51@tcp remote: 0xb3825108e0cfe321 expref: 14 pid: 37973 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.667096:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518720.667100:0:35831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789518720.667116:0:35831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.667126:0:35831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.667238:0:35831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789518720.667292:0:35831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617507968:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 267us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518720.667299:0:35831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00080000:2.0:1789518720.667354:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789518720.667483:0:37973:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518720.667493:0:37973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518720.667502:0:37973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518720.667509:0:37973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789518720.667559:0:37973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789518720.668204:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627684992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5234us (5634us total) trans 30064771289 rc 0/0 00000100:00100000:3.0:1789518720.668211:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789518720.668296:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771288 gen 2 00000004:00080000:0.0:1789518720.668301:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771288 committed transno 30064771288 00000100:00100000:0.0:1789518720.668319:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99fec8ddca80 x1876445627684992/t30064771289(30064771289) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789518736 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789518720.668330:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fec8ddca80/2, rc 0, transno 30064771289 00000100:00100000:0.0:1789518720.668334:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627684992:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789518720.668575:0:36743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789518720.668582:0:36743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.668590:0:36743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fffc14c400 already unused, calling callback (ffffffffc15168b0) 00010000:00010000:1.0:1789518720.668594:0:36743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.668603:0:36743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.668635:0:36743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.668642:0:36743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb3a80ec/0x631fd8698c787cbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 37973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789518720.668659:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518720.668660:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518720.668662:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518720.882938:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518721.722146:0:40984:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518721.722156:0:40984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518721.722214:0:40984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1789518721.722289:0:40984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518721.906881:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518722.163037:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518722.163058:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627685248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518722.163128:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518722.163240:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627685248 00000100:00100000:3.0:1789518722.163248:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627685248 00000100:00100000:3.0:1789518722.163303:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789518722.163313:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627685248:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518722.163324:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789518722.163344:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518722.163384:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627685248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518722.163391:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789518722.163536:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627685248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518722.674833:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518722.674855:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627685376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518722.674922:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518722.674991:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627685376 00000100:00100000:1.0:1789518722.675000:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627685376 00000100:00100000:1.0:1789518722.675051:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518722.675062:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627685376:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789518722.675071:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789518722.675111:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518722.675196:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627685504:0@lo:400:kworker.0 00000100:00100000:0.0:1789518722.675243:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518722.675278:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518722.675286:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627685632:0@lo:400:kworker.0 00000100:00100000:0.0:1789518722.675315:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518722.675348:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627685504 00000100:00100000:0.0:1789518722.675352:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627685504 00000100:00100000:2.0:1789518722.675383:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627685632 00000100:00100000:2.0:1789518722.675389:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627685632 00000100:00100000:0.0:1789518722.675391:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789518722.675400:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627685504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518722.675427:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789518722.675436:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627685632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518722.675443:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627685504:12345-0@lo:400:kworker.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518722.675451:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789518722.675482:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627685632:12345-0@lo:400:kworker.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518722.675489:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789518722.675502:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627685632:0@lo:400:kworker.0 00000100:00100000:0.0:1789518722.675513:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627685504:0@lo:400:kworker.0 00000100:00100000:0.0:1789518722.675537:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627685760:0@lo:400:kworker.0 00000100:00100000:0.0:1789518722.675560:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518722.675605:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627685376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 545us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518722.675633:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789518722.675655:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627685760 00000100:00100000:1.0:1789518722.675659:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627685760 00000100:00100000:1.0:1789518722.675692:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789518722.675698:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627685760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518722.675790:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627685376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518722.675893:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627685760:12345-0@lo:400:kworker.0 Request processed in 194us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518722.675900:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789518722.675942:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627685760:0@lo:400:kworker.0 00000100:00100000:0.0:1789518722.675953:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518722.675958:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627685888:0@lo:400:kworker.0 00000100:00100000:0.0:1789518722.675987:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518722.676144:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627685888 00000100:00100000:2.0:1789518722.676150:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627685888 00000100:00080000:0.0:1789518722.676169:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518722.676188:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789518722.676198:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627685888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518722.676458:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627685888:12345-0@lo:400:kworker.0 Request processed in 262us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518722.676466:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789518722.676497:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627685888:0@lo:400:kworker.0 00010000:00010000:1.0:1789518722.930806:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518723.174436:0:41036:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518723.174445:0:41036:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518723.174491:0:41036:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789518723.174497:0:41036:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518723.954898:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518723.981951:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518723.982037:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518723.982064:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518723.982103:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518723.982128:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617508352 00000100:00100000:1.0:1789518723.982134:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518723.982139:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617508352 00000100:00100000:1.0:1789518723.982161:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617508480 00000100:00100000:1.0:1789518723.982166:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617508480 00000100:00100000:2.0:1789518723.982206:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1789518723.982214:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518723.982221:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617508352:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518723.982228:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617508480:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518723.982311:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617508224 00000100:00100000:3.0:1789518723.982315:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617508224 00000100:00100000:3.0:1789518723.982339:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617508608 00000100:00100000:3.0:1789518723.982341:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617508608 00000100:00100000:3.0:1789518723.982358:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:3.0:1789518723.982365:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617508224:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518723.982423:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617508480:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 199us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518723.982431:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:2.0:1789518723.982452:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617508352:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 235us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518723.982461:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00080000:1.0:1789518723.982471:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518723.982478:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518723.982480:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518723.982500:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:1.0:1789518723.982510:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617508608:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518723.982763:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617508096 00000100:00100000:0.0:1789518723.982768:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617508096 00000100:00100000:0.0:1789518723.982801:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:0.0:1789518723.982808:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617508096:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518723.983444:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617508096:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 634us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518723.983452:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:1.0:1789518723.983541:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd846f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617508608:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1033us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518723.983549:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:3.0:1789518723.986786:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617508224:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 4410us (4709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518723.986800:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000040:00080000:1.0:1789518724.641498:0:41087:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518724.641507:0:41087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518724.641561:0:41087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789518724.641569:0:41087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518724.979275:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789518725.773746:0:5833:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803909 batchid updated 00000020:00080000:3.0:1789518725.773980:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803909 00000020:00080000:3.0:1789518725.773992:0:35885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803909 00000001:00080000:3.0:1789518725.776894:0:7607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771289 is committed 00010000:00010000:3.0:1789518726.003407:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518726.171368:0:41141:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518726.171377:0:41141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518726.171436:0:41141:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1789518726.171443:0:41141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:2.0:1789518726.836874:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518726.836884:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518726.836921:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1789518726.836928:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518727.027470:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518727.282912:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789518727.282936:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627686016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518727.283003:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518727.284191:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627686016 00000100:00100000:0.0:1789518727.284201:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627686016 00000100:00100000:0.0:1789518727.284269:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789518727.284280:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627686016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518727.284315:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518727.284373:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627686016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518727.284380:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789518727.284429:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627686016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518727.284502:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789518727.669294:0:41192:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518727.669301:0:41192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518727.669340:0:41192:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789518727.669344:0:41192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518727.794792:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627686400:0@lo:400:kworker.0 00000100:00100000:2.0:1789518727.794853:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627686528:0@lo:400:kworker.0 00000100:00100000:3.0:1789518727.794861:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518727.794888:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627686144:0@lo:400:kworker.0 00000100:00100000:2.0:1789518727.794898:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518727.794933:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518727.794945:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627686272:0@lo:400:kworker.0 00000100:00100000:2.0:1789518727.794949:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627686400 00000100:00100000:0.0:1789518727.794952:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518727.794958:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627686400 00000100:00100000:2.0:1789518727.795000:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627686528 00000100:00100000:3.0:1789518727.795003:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518727.795005:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627686528 00000100:00100000:3.0:1789518727.795042:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627686272 00000100:00100000:3.0:1789518727.795047:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627686272 00000100:00100000:2.0:1789518727.795049:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518727.795060:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627686400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518727.795105:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789518727.795114:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627686656:0@lo:400:kworker.0 00000100:00100000:3.0:1789518727.795119:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627686272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518727.795130:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627686400:12345-0@lo:400:kworker.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518727.795137:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789518727.795158:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789518727.795167:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627686272:12345-0@lo:400:kworker.0 Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518727.795168:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627686528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518727.795182:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789518727.795191:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec3488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627686784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518727.795214:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627686528:12345-0@lo:400:kworker.0 Request processed in 50us (320us total) trans 0 rc 0/0 00000100:00080000:3.0:1789518727.795221:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518727.795226:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518727.795228:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518727.795229:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789518727.795233:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518727.795251:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627686656 00000100:00100000:3.0:1789518727.795256:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627686656 00000100:00100000:2.0:1789518727.795286:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627686528:0@lo:400:kworker.0 00000100:00100000:1.0:1789518727.795295:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627686784 00000100:00100000:1.0:1789518727.795299:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627686784 00000100:00100000:3.0:1789518727.795301:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789518727.795313:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627686656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518727.795317:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771289 gen 2 00000004:00080000:2.0:1789518727.795323:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fec8ddca80, transno 30064771289 00000100:00100000:2.0:1789518727.795336:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627686272:0@lo:400:kworker.0 00000100:00100000:1.0:1789518727.795336:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518727.795341:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627686144 00000100:00100000:1.0:1789518727.795347:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627686784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518727.795350:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627686400:0@lo:400:kworker.0 00000100:00100000:0.0:1789518727.795350:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627686144 00000100:00100000:3.0:1789518727.795367:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627686656:12345-0@lo:400:kworker.0 Request processed in 57us (144us total) trans 0 rc 0/0 00002000:00000024:1.0:1789518727.795372:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518727.795377:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789518727.795399:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1789518727.795401:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518727.795412:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627686144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518727.795420:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627686784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518727.795429:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627686656:0@lo:400:kworker.0 00000100:00100000:1.0:1789518727.795430:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789518727.795473:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627686144:12345-0@lo:400:kworker.0 Request processed in 65us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518727.795479:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec3488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627686784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518727.795486:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789518727.795491:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627686144:0@lo:400:kworker.0 00010000:00010000:3.0:1789518728.051468:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518729.075015:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518729.102414:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518729.102459:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518729.102507:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518729.102550:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518729.102658:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518729.102688:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617508864 00000100:00100000:1.0:1789518729.102698:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617508864 00000100:00100000:1.0:1789518729.102752:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617509248 00000100:00100000:1.0:1789518729.102756:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617509248 00000100:00100000:1.0:1789518729.102785:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1789518729.102785:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617508736 00000100:00100000:0.0:1789518729.102792:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617508736 00000100:00100000:1.0:1789518729.102799:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617508864:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518729.102826:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:0.0:1789518729.102835:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617508736:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518729.102924:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617509120 00000100:00100000:3.0:1789518729.102929:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617509120 00000100:00100000:3.0:1789518729.102955:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617508992 00000100:00100000:3.0:1789518729.102958:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617508992 00000100:00100000:3.0:1789518729.102980:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:3.0:1789518729.102987:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617509120:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518729.103037:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617508864:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 241us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518729.103045:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:1.0:1789518729.103073:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:1.0:1789518729.103081:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617509248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518729.103453:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:2.0:1789518729.103463:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617508992:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518729.105206:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617508736:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2366us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518729.105219:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00080000:0.0:1789518729.105420:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518729.105426:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518729.105430:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518729.105971:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3488380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617509120:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2981us (3507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518729.105980:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1789518729.106213:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617509248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3131us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518729.106221:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 115 00000100:00100000:2.0:1789518729.106362:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617508992:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2899us (3809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518729.106371:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000040:00080000:2.0:1789518729.202252:0:41243:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518729.202279:0:41243:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518729.202354:0:41243:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1789518729.202360:0:41243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518730.099194:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518730.684240:0:41295:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518730.684249:0:41295:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518730.684298:0:41295:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789518730.684304:0:41295:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518731.123426:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518732.147741:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518732.187475:0:41348:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518732.187483:0:41348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518732.187560:0:41348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1789518732.187566:0:41348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518732.403970:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627686912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518732.404037:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518732.404179:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627686912 00000100:00100000:0.0:1789518732.404187:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627686912 00000100:00100000:0.0:1789518732.404241:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789518732.404250:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627686912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518732.404300:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518732.404355:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627686912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518732.404363:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789518732.404382:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518732.404554:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627686912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518732.914834:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627687040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518732.914865:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627687168:0@lo:400:kworker.0 00000100:00100000:0.0:1789518732.914898:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518732.914899:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518732.914959:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627687040 00000100:00100000:1.0:1789518732.914966:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627687040 00000100:00100000:3.0:1789518732.914995:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627687168 00000100:00100000:3.0:1789518732.914998:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627687168 00000100:00100000:1.0:1789518732.915015:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789518732.915024:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627687040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518732.915032:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789518732.915037:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627687168:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1789518732.915066:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518732.915233:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627687552:0@lo:400:kworker.0 00000100:00100000:2.0:1789518732.915278:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518732.915299:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518732.915309:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627687680:0@lo:400:kworker.0 00000100:00100000:2.0:1789518732.915332:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518732.915361:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627687552 00000100:00100000:2.0:1789518732.915365:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627687552 00000100:00100000:2.0:1789518732.915393:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627687680 00000100:00100000:2.0:1789518732.915397:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627687680 00000100:00100000:2.0:1789518732.915419:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789518732.915425:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627687552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518732.915463:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627687552:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518732.915469:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789518732.915487:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789518732.915493:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627687680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518732.915522:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627687680:12345-0@lo:400:kworker.0 Request processed in 29us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518732.915527:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789518732.915547:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627687424:0@lo:400:kworker.0 00000100:00100000:2.0:1789518732.915572:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518732.915593:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518732.915598:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627687296:0@lo:400:kworker.0 00000100:00100000:2.0:1789518732.915641:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518732.915646:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627687424 00000100:00100000:0.0:1789518732.915650:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627687424 00000100:00100000:0.0:1789518732.915673:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789518732.915679:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627687424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518732.915715:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627687424:12345-0@lo:400:kworker.0 Request processed in 36us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518732.915721:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789518732.915741:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627687296 00000100:00100000:2.0:1789518732.915746:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627687296 00000100:00080000:0.0:1789518732.915753:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518732.915757:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518732.915772:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789518732.915778:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627687296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518732.915845:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627687168:12345-0@lo:400:kworker.0 Request processed in 806us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518732.915851:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789518732.915876:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627687296:12345-0@lo:400:kworker.0 Request processed in 31us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518732.915883:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789518732.915922:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627687680:0@lo:400:kworker.0 00000100:00100000:2.0:1789518732.915932:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627687552:0@lo:400:kworker.0 00000100:00100000:2.0:1789518732.915958:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627687296:0@lo:400:kworker.0 00000100:00100000:2.0:1789518732.915966:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627687424:0@lo:400:kworker.0 00000100:00100000:1.0:1789518732.916063:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627687040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1040us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518732.916071:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789518732.916144:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627687040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518732.916334:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627687168:0@lo:400:kworker.0 00010000:00010000:3.0:1789518733.170829:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518733.669910:0:41399:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518733.669919:0:41399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518733.669972:0:41399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1789518733.669978:0:41399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518734.195004:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518734.222721:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518734.222769:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518734.222835:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518734.222878:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518734.222903:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617509632 00000100:00100000:1.0:1789518734.222909:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518734.222913:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617509632 00000100:00100000:1.0:1789518734.222953:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617509760 00000100:00100000:1.0:1789518734.222959:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617509760 00000100:00100000:3.0:1789518734.222969:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00100000:3.0:1789518734.222981:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617509632:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518734.222995:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:1.0:1789518734.223005:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617509760:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518734.223069:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617509760:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 65us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518734.223078:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 81 00000100:00100000:0.0:1789518734.223102:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617509376 00000100:00080000:1.0:1789518734.223112:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518734.223115:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617509376 00000100:00080000:1.0:1789518734.223117:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518734.223161:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:0.0:1789518734.223171:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617509376:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518734.223199:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617509376:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518734.223206:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:2.0:1789518734.223314:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617509504 00000100:00100000:2.0:1789518734.223319:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617509504 00000100:00100000:2.0:1789518734.223365:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617509888 00000100:00100000:2.0:1789518734.223368:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617509888 00000100:00100000:2.0:1789518734.223394:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:2.0:1789518734.223401:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617509504:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518734.223438:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617509504:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 37us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518734.223444:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:2.0:1789518734.223458:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:2.0:1789518734.223465:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617509888:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518734.223490:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617509888:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518734.223495:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:3.0:1789518734.223777:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617509632:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 61us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518734.223786:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 80 00000100:00080000:1.0:1789518734.224275:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789518735.171147:0:41450:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518735.171156:0:41450:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518735.171209:0:41450:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1789518735.171215:0:41450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518735.219176:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518736.050990:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518736.050999:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518736.051306:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1789518736.051315:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518736.243138:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518736.667114:0:41502:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518736.667124:0:41502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518736.667180:0:41502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1789518736.667186:0:41502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518737.266833:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518737.524276:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627687808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518737.524397:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518737.524649:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627687808 00000100:00100000:1.0:1789518737.524657:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627687808 00000100:00100000:1.0:1789518737.524845:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789518737.524855:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627687808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518737.524890:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00080000:0.0:1789518737.525151:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518737.525221:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627687808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 367us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518737.525230:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789518737.525300:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627687808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518738.034828:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627688064:0@lo:400:kworker.0 00000100:00100000:3.0:1789518738.034842:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627688320:0@lo:400:kworker.0 00000100:00100000:3.0:1789518738.034898:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518738.034957:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789518738.034963:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627687936:0@lo:400:kworker.0 00000100:00100000:3.0:1789518738.035921:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518738.035935:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518738.035958:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627688448:0@lo:400:kworker.0 00000100:00100000:2.0:1789518738.035972:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627688576:0@lo:400:kworker.0 00000100:00100000:3.0:1789518738.035992:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518738.036029:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627688320 00000100:00100000:2.0:1789518738.036037:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627688320 00000100:00100000:3.0:1789518738.036064:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627687936 00000100:00100000:3.0:1789518738.036071:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627687936 00000100:00100000:2.0:1789518738.036081:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627688448 00000100:00100000:2.0:1789518738.036085:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627688448 00000100:00100000:2.0:1789518738.036117:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789518738.036125:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627688320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518738.036155:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627688192:0@lo:400:kworker.0 00000100:00100000:2.0:1789518738.036179:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627688320:12345-0@lo:400:kworker.0 Request processed in 53us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518738.036186:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789518738.036199:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518738.036205:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789518738.036212:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627688448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518738.036228:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627688704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518738.036245:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627688448:12345-0@lo:400:kworker.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518738.036251:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789518738.036262:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518738.036270:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627688064 00000100:00100000:2.0:1789518738.036274:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627688064 00000100:00100000:2.0:1789518738.036302:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627688192 00000100:00100000:2.0:1789518738.036305:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627688192 00000100:00100000:1.0:1789518738.036309:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789518738.036320:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627688064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518738.036328:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789518738.036337:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627688192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518738.036362:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627688064:12345-0@lo:400:kworker.0 Request processed in 44us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518738.036370:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789518738.036382:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627688192:12345-0@lo:400:kworker.0 Request processed in 46us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518738.036393:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789518738.036396:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627688704 00000100:00100000:1.0:1789518738.036401:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627688704 00000100:00080000:2.0:1789518738.036420:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518738.036425:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518738.036436:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789518738.036445:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627688704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518738.036461:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627688448:0@lo:400:kworker.0 00002000:00000024:1.0:1789518738.036472:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518738.036477:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627688320:0@lo:400:kworker.0 00000100:00100000:1.0:1789518738.036509:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627688704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518738.036515:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789518738.036547:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627688192:0@lo:400:kworker.0 00000100:00100000:1.0:1789518738.036559:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627688704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518738.037040:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518738.037083:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627688064:0@lo:400:kworker.0 00000100:00100000:0.0:1789518738.037150:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627688576 00000100:00100000:0.0:1789518738.037155:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627688576 00000100:00100000:0.0:1789518738.037196:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789518738.037202:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627688576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518738.037243:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627688576:12345-0@lo:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518738.037249:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1789518738.037446:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518738.037467:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627688576:0@lo:400:kworker.0 00000100:00100000:0.0:1789518738.038190:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789518738.038203:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627687936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518738.038263:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627687936:12345-0@lo:400:kworker.0 Request processed in 64us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518738.038269:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789518738.038346:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627687936:0@lo:400:kworker.0 00000040:00080000:1.0:1789518738.145696:0:41554:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518738.145703:0:41554:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518738.145749:0:41554:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789518738.145755:0:41554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518738.290835:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518739.317608:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518739.341580:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518739.341669:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518739.341701:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518739.341742:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617510016 00000100:00100000:1.0:1789518739.341752:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518739.341753:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617510016 00000100:00100000:1.0:1789518739.341781:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518739.341809:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:1.0:1789518739.341812:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617510400 00000100:00100000:1.0:1789518739.341817:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617510400 00000100:00100000:0.0:1789518739.341822:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617510016:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518739.341851:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617510272 00000100:00100000:1.0:1789518739.341854:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617510272 00000100:00100000:1.0:1789518739.341873:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1789518739.341882:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617510400:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518739.341894:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617510016:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518739.341914:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617510400:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518739.341920:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 84 00000100:00100000:1.0:1789518739.341933:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:1.0:1789518739.341938:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617510272:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518739.341955:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617510272:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 17us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518739.341961:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 85 00000100:00100000:0.0:1789518739.341967:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:2.0:1789518739.342144:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617510144 00000100:00100000:2.0:1789518739.342148:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617510144 00000100:00100000:2.0:1789518739.342186:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617510528 00000100:00100000:2.0:1789518739.342188:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617510528 00000100:00100000:2.0:1789518739.342218:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:2.0:1789518739.342225:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617510144:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518739.342257:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617510144:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518739.342263:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:2.0:1789518739.342273:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:2.0:1789518739.342278:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617510528:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518739.342296:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617510528:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 18us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518739.342305:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00080000:2.0:1789518739.342320:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518739.342324:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518739.342326:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789518739.664310:0:41605:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518739.664318:0:41605:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518739.664365:0:41605:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789518739.664372:0:41605:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518740.338880:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518741.157579:0:41656:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518741.157587:0:41656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518741.157661:0:41656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1789518741.157667:0:41656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518741.362912:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518742.387344:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518742.642948:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627688832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518742.643019:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518742.643133:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627688832 00000100:00100000:1.0:1789518742.643141:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627688832 00000100:00100000:1.0:1789518742.643200:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789518742.643218:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627688832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518742.643266:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00080000:0.0:1789518742.643914:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518742.644177:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627688832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 968us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518742.644187:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789518742.644191:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627688832:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789518742.722395:0:41707:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518742.722404:0:41707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518742.722463:0:41707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789518742.722469:0:41707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518743.154827:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627688960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518743.154924:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518743.155056:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627688960 00000100:00100000:3.0:1789518743.155065:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627688960 00000100:00100000:3.0:1789518743.155119:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789518743.155128:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627688960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518743.155159:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00080000:1.0:1789518743.155255:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518743.156091:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627688960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 960us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518743.156102:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789518743.156102:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627688960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518743.158229:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627689216:0@lo:400:kworker.0 00000100:00100000:0.0:1789518743.158265:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627689472:0@lo:400:kworker.0 00000100:00100000:1.0:1789518743.158282:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518743.158350:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518743.158400:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518743.158401:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789518743.158412:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627689344:0@lo:400:kworker.0 00000100:00100000:1.0:1789518743.158414:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627689088:0@lo:400:kworker.0 00000100:00100000:0.0:1789518743.158448:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518743.158478:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518743.158501:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627689472 00000100:00100000:0.0:1789518743.158508:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627689472 00000100:00100000:1.0:1789518743.158513:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627689600:0@lo:400:kworker.0 00000100:00100000:1.0:1789518743.158541:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518743.158573:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627689216 00000100:00100000:1.0:1789518743.158577:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627689216 00000100:00100000:1.0:1789518743.158747:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789518743.158758:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627689216:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789518743.158768:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518743.158781:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627689344 00000100:00100000:0.0:1789518743.158787:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627689344 00000100:00100000:3.0:1789518743.158794:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627689088 00000100:00100000:3.0:1789518743.158801:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627689088 00000100:00100000:1.0:1789518743.158814:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627689216:12345-0@lo:400:kworker.0 Request processed in 57us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518743.158814:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627689600 00000100:00100000:0.0:1789518743.158820:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627689600 00000100:00100000:1.0:1789518743.158825:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789518743.158855:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789518743.158865:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627689472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518743.158869:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789518743.158871:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789518743.158883:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627689088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518743.158909:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627689472:12345-0@lo:400:kworker.0 Request processed in 46us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518743.158930:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627689088:12345-0@lo:400:kworker.0 Request processed in 49us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518743.158937:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789518743.159151:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627689344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518743.159185:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627689344:12345-0@lo:400:kworker.0 Request processed in 37us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518743.159936:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789518743.159945:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789518743.159960:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627689600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518743.159980:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627689344:0@lo:400:kworker.0 00000100:00100000:0.0:1789518743.159990:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627689472:0@lo:400:kworker.0 00000100:00100000:3.0:1789518743.160022:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627689600:12345-0@lo:400:kworker.0 Request processed in 66us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518743.160031:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789518743.160053:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627689088:0@lo:400:kworker.0 00000100:00100000:0.0:1789518743.160064:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627689600:0@lo:400:kworker.0 00000100:00100000:0.0:1789518743.160074:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627689216:0@lo:400:kworker.0 00000100:00100000:1.0:1789518743.160525:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1789518743.160646:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518743.411805:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518744.202766:0:41759:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518744.202842:0:41759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518744.202898:0:41759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1789518744.202904:0:41759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518744.436741:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518744.463253:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518744.463303:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518744.463367:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518744.463376:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617510784 00000100:00100000:2.0:1789518744.463386:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617510784 00000100:00100000:1.0:1789518744.463407:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518744.463411:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617510656 00000100:00100000:0.0:1789518744.463418:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617510656 00000100:00100000:2.0:1789518744.463458:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:0.0:1789518744.463464:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:2.0:1789518744.463472:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617510784:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518744.463476:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617510656:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518744.463489:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518744.463562:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617510656:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 89us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518744.463570:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:3.0:1789518744.463587:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617511040 00000100:00100000:3.0:1789518744.463593:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617511040 00000100:00080000:1.0:1789518744.464066:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518744.464071:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518744.464091:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617511168 00000100:00100000:1.0:1789518744.464096:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617511168 00000100:00100000:1.0:1789518744.464129:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:1.0:1789518744.464136:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617511168:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518744.464220:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617510912 00000100:00100000:3.0:1789518744.464224:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617510912 00000100:00100000:3.0:1789518744.464250:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 87 00000100:00100000:3.0:1789518744.464258:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617511040:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518744.465022:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617510784:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1552us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518744.465031:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:2.0:1789518744.465078:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:2.0:1789518744.465088:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617510912:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518744.465133:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617510912:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518744.465139:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 88 00000100:00100000:1.0:1789518744.465236:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617511168:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1099us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518744.465245:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00080000:1.0:1789518744.465292:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518744.465296:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518744.467899:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617511040:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3630us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518744.467923:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 87 00010000:00010000:3.0:1789518745.459107:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518745.753111:0:41810:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518745.753121:0:41810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518745.753173:0:41810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789518745.753181:0:41810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1789518746.290855:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518746.290864:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518746.290898:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789518746.290904:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518746.483554:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518747.254345:0:41861:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518747.254354:0:41861:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518747.254407:0:41861:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1789518747.254479:0:41861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518747.506794:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518747.763036:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627689728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518747.763167:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518747.763267:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627689728 00000100:00100000:2.0:1789518747.763275:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627689728 00000100:00100000:2.0:1789518747.763358:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789518747.763368:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627689728:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518747.763432:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789518747.763433:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518747.766711:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627689728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3336us (3536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518747.766724:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789518747.766917:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627689728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518748.275795:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627689984:0@lo:400:kworker.0 00000100:00100000:2.0:1789518748.275827:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627690112:0@lo:400:kworker.0 00000100:00100000:0.0:1789518748.275862:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518748.275879:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627690240:0@lo:400:kworker.0 00000100:00100000:3.0:1789518748.275906:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627689856:0@lo:400:kworker.0 00000100:00100000:0.0:1789518748.275917:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627690496:0@lo:400:kworker.0 00000100:00100000:2.0:1789518748.275939:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518748.275957:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518748.275965:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627689984 00000100:00100000:0.0:1789518748.275983:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627689984 00000100:00100000:3.0:1789518748.276011:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627690368:0@lo:400:kworker.0 00000100:00100000:2.0:1789518748.276019:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627690240 00000100:00100000:2.0:1789518748.276025:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627690240 00000100:00100000:0.0:1789518748.276031:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789518748.276044:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518748.276045:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627689984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518748.276093:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627689984:12345-0@lo:400:kworker.0 Request processed in 53us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518748.276099:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518748.276104:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789518748.276121:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627690112 00000100:00100000:0.0:1789518748.276124:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627690112 00000100:00100000:1.0:1789518748.276128:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627690624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518748.276158:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789518748.276163:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518748.276168:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627690112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518748.276213:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627690112:12345-0@lo:400:kworker.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518748.276219:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789518748.276232:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627689856 00000100:00080000:0.0:1789518748.276237:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518748.276238:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627689856 00000100:00100000:1.0:1789518748.276273:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789518748.276280:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627690112:0@lo:400:kworker.0 00000100:00100000:1.0:1789518748.276283:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627689856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518748.276320:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627689856:12345-0@lo:400:kworker.0 Request processed in 40us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518748.276327:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789518748.276373:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627690624 00000100:00100000:1.0:1789518748.276377:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627690624 00000100:00100000:1.0:1789518748.276401:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518748.276408:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627690624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518748.276432:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518748.276464:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627690624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518748.276469:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789518748.276505:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627690624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518748.276602:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627689856:0@lo:400:kworker.0 00000100:00100000:3.0:1789518748.276646:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518748.277871:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627690368 00000100:00100000:2.0:1789518748.277879:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627690368 00000100:00100000:2.0:1789518748.277925:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789518748.277934:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627690240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518748.277998:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627690240:12345-0@lo:400:kworker.0 Request processed in 65us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518748.278004:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789518748.278019:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789518748.278025:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627690368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518748.278058:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627690368:12345-0@lo:400:kworker.0 Request processed in 34us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518748.278063:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789518748.278100:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627690240:0@lo:400:kworker.0 00000100:00100000:2.0:1789518748.278141:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627690368:0@lo:400:kworker.0 00000100:00080000:2.0:1789518748.278164:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518748.280043:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627690496 00000100:00100000:0.0:1789518748.280055:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627690496 00000100:00100000:3.0:1789518748.280097:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627689984:0@lo:400:kworker.0 00000100:00080000:3.0:1789518748.280142:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518748.280243:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789518748.280252:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627690496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518748.280361:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627690496:12345-0@lo:400:kworker.0 Request processed in 110us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518748.280369:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789518748.281854:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627690496:0@lo:400:kworker.0 00010000:00010000:3.0:1789518748.530921:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518748.808584:0:41912:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518748.808594:0:41912:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518748.808700:0:41912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789518748.808708:0:41912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518749.556326:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518749.581292:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518749.581377:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518749.581438:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518749.581584:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617511424 00000100:00100000:2.0:1789518749.581594:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617511424 00000100:00100000:0.0:1789518749.581659:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617511296 00000100:00100000:0.0:1789518749.581664:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617511296 00000100:00100000:2.0:1789518749.581686:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:2.0:1789518749.581696:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617511424:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518749.581701:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:0.0:1789518749.581707:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617511296:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:1.0:1789518749.581771:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518749.581849:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617511424:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 153us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518749.581856:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:3.0:1789518749.581926:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617511680 00000100:00100000:3.0:1789518749.581930:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617511680 00000100:00100000:3.0:1789518749.581999:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:3.0:1789518749.582007:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617511680:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:2.0:1789518749.582195:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518749.582580:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617511296:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 870us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518749.582588:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:3.0:1789518749.583002:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617511680:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 993us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518749.583011:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1789518749.583379:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518749.583414:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518749.583431:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617511552 00000100:00100000:0.0:1789518749.583438:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617511552 00000100:00100000:3.0:1789518749.583514:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617511808 00000100:00100000:3.0:1789518749.583519:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617511808 00000100:00100000:0.0:1789518749.583565:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518749.583571:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:0.0:1789518749.583580:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617511552:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:2.0:1789518749.583640:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518749.583642:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617511552:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00080000:2.0:1789518749.583645:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518749.583653:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:3.0:1789518749.583775:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617511808:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518749.583809:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617511808:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 230us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518749.583815:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00000040:00080000:1.0:1789518750.290916:0:41963:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518750.290924:0:41963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518750.290990:0:41963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789518750.290997:0:41963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518750.579351:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518751.603706:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518751.828837:0:42015:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518751.828846:0:42015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518751.828900:0:42015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:1.0:1789518751.828908:0:42015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518752.627123:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518752.882984:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518752.883006:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627690752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518752.883126:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518752.883253:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627690752 00000100:00100000:3.0:1789518752.883262:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627690752 00000100:00080000:2.0:1789518752.883302:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518752.883323:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789518752.883333:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627690752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518752.883365:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518752.883415:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627690752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518752.883422:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789518752.883715:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627690752:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789518753.376739:0:42066:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518753.376751:0:42066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518753.376813:0:42066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:0.0:1789518753.376819:0:42066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789518753.396772:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627691008:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.396864:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518753.396970:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627691520:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.397001:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518753.397031:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789518753.397037:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627690880:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.397068:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518753.397092:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627691392:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.397116:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518753.397144:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627691136:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.397169:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518753.397459:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627691648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518753.397503:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518753.397529:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518753.397535:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627691264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.397561:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518753.397586:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627691008 00000100:00100000:1.0:1789518753.397593:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627691520 00000100:00100000:1.0:1789518753.397606:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627691520 00000100:00100000:0.0:1789518753.397677:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627691008 00000100:00100000:1.0:1789518753.397695:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627691392 00000100:00100000:1.0:1789518753.397698:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627691392 00000100:00100000:0.0:1789518753.397711:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627691136 00000100:00100000:0.0:1789518753.397715:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627691136 00000100:00100000:1.0:1789518753.397719:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627691264 00000100:00100000:1.0:1789518753.397721:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627691264 00000100:00100000:1.0:1789518753.397739:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789518753.397739:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789518753.397749:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627691520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518753.397749:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627691008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.397804:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627691520:12345-0@lo:400:kworker.0 Request processed in 57us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518753.397807:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627691008:12345-0@lo:400:kworker.0 Request processed in 61us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518753.397812:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789518753.397813:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789518753.397830:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789518753.397830:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789518753.397837:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627691392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518753.397837:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627691136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.397864:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627691392:12345-0@lo:400:kworker.0 Request processed in 28us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518753.397867:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627691136:12345-0@lo:400:kworker.0 Request processed in 32us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518753.397871:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789518753.397873:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789518753.397881:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789518753.397887:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627691264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.397917:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627691264:12345-0@lo:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518753.397924:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789518753.397961:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627690880 00000100:00100000:1.0:1789518753.397965:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627690880 00000100:00080000:2.0:1789518753.397991:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518753.397997:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518753.398003:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789518753.398011:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627690880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518753.398033:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627691648 00000100:00100000:2.0:1789518753.398036:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627691648 00000100:00100000:1.0:1789518753.398042:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627690880:12345-0@lo:400:kworker.0 Request processed in 34us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518753.398048:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789518753.398067:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789518753.398075:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627691648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518753.398104:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627691264:0@lo:400:kworker.0 00002000:00000024:2.0:1789518753.398107:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518753.398116:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627691136:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.398144:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627690880:0@lo:400:kworker.0 00000100:00100000:2.0:1789518753.398148:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627691648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518753.398154:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789518753.398155:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627691392:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.398164:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627691008:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.398174:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627691520:0@lo:400:kworker.0 00000100:00100000:1.0:1789518753.398370:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627691648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789518753.651124:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518754.676450:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518754.701422:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518754.701569:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617511936 00000100:00100000:0.0:1789518754.701581:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617511936 00000100:00100000:0.0:1789518754.701690:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:0.0:1789518754.701703:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617511936:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518754.701782:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617511936:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518754.701790:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:2.0:1789518754.701888:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518754.701955:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617512064 00000100:00100000:1.0:1789518754.701960:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617512064 00000100:00100000:1.0:1789518754.702007:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:1.0:1789518754.702016:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617512064:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:2.0:1789518754.702041:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518754.702059:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617512064:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518754.702067:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:2.0:1789518754.702086:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518754.702126:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518754.702155:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518754.702178:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617512448 00000100:00100000:2.0:1789518754.702182:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617512448 00000100:00100000:3.0:1789518754.702319:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617512320 00000100:00100000:3.0:1789518754.702323:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617512320 00000100:00100000:2.0:1789518754.702344:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:2.0:1789518754.702355:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617512448:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518754.702392:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617512192 00000100:00100000:3.0:1789518754.702397:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617512192 00000100:00100000:2.0:1789518754.702399:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617512448:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 46us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518754.702408:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:0.0:1789518754.702423:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 95 00000100:00100000:3.0:1789518754.702430:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:0.0:1789518754.702433:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedcdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617512320:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518754.702437:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617512192:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:2.0:1789518754.702444:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518754.702449:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518754.702453:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518754.702802:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617512192:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 363us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518754.702810:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 96 00000100:00100000:0.0:1789518754.703307:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedcdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617512320:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 873us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518754.703317:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 95 00000040:00080000:2.0:1789518754.947588:0:42117:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518754.947597:0:42117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518754.947677:0:42117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:2.0:1789518754.947683:0:42117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518755.698831:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518756.507079:0:42169:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518756.507090:0:42169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518756.507151:0:42169:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 5 00000040:00080000:3.0:1789518756.507159:0:42169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:2.0:1789518756.532467:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518756.532480:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518756.533022:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1789518756.533031:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518756.722853:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518757.746912:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518758.006002:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518758.006022:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627691776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518758.006082:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518758.006140:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627691776 00000100:00100000:2.0:1789518758.006148:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627691776 00000100:00100000:2.0:1789518758.006196:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789518758.006204:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627691776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518758.006235:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518758.006277:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627691776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518758.006284:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789518758.006303:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518758.006336:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627691776:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789518758.048120:0:42220:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518758.048128:0:42220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518758.048171:0:42220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1789518758.048176:0:42220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789518758.515173:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627692032:0@lo:400:kworker.0 00000100:00100000:0.0:1789518758.515213:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627691904:0@lo:400:kworker.0 00000100:00100000:1.0:1789518758.515272:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518758.515291:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518758.515358:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627692544:0@lo:400:kworker.0 00000100:00100000:0.0:1789518758.515363:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627692416:0@lo:400:kworker.0 00000100:00100000:1.0:1789518758.515409:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518758.515418:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627692288:0@lo:400:kworker.0 00000100:00100000:3.0:1789518758.515530:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627692160:0@lo:400:kworker.0 00000100:00100000:2.0:1789518758.515854:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627692544 00000100:00100000:2.0:1789518758.515862:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627692544 00000100:00100000:2.0:1789518758.515942:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789518758.515954:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627692544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518758.516109:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518758.516143:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518758.516151:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627692672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518758.516178:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518758.516218:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627691904 00000100:00100000:0.0:1789518758.516225:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627691904 00000100:00100000:1.0:1789518758.516244:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518758.516278:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789518758.516288:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627691904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518758.516303:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627692288 00000100:00100000:1.0:1789518758.516311:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627692288 00000100:00100000:1.0:1789518758.516350:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627692416 00000100:00100000:0.0:1789518758.516353:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627691904:12345-0@lo:400:kworker.0 Request processed in 65us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518758.516355:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627692416 00000100:00100000:0.0:1789518758.516367:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789518758.516390:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789518758.516401:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627692288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518758.516450:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627691904:0@lo:400:kworker.0 00000100:00100000:1.0:1789518758.516468:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627692288:12345-0@lo:400:kworker.0 Request processed in 68us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518758.516483:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789518758.516503:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789518758.516510:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627692416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518758.516723:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627692288:0@lo:400:kworker.0 00000100:00100000:0.0:1789518758.516764:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627692672 00000100:00100000:0.0:1789518758.516769:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627692672 00000100:00100000:0.0:1789518758.516807:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789518758.516818:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627692672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518758.516849:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518758.516858:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518758.516909:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627692672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518758.516962:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789518758.517003:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518758.517010:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518758.517025:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627692032 00000100:00100000:0.0:1789518758.517030:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627692032 00000100:00100000:0.0:1789518758.517062:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627692160 00000100:00100000:0.0:1789518758.517065:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627692160 00000100:00100000:0.0:1789518758.517093:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789518758.517101:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627692032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518758.517114:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789518758.517128:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627692160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518758.517151:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627692032:12345-0@lo:400:kworker.0 Request processed in 48us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518758.517159:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789518758.517193:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627692160:12345-0@lo:400:kworker.0 Request processed in 68us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518758.517202:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789518758.517212:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627692672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518758.517255:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627692160:0@lo:400:kworker.0 00000100:00100000:0.0:1789518758.517292:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627692032:0@lo:400:kworker.0 00000100:00100000:2.0:1789518758.518761:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627692544:12345-0@lo:400:kworker.0 Request processed in 2803us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518758.518775:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789518758.518876:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627692544:0@lo:400:kworker.0 00000100:00100000:1.0:1789518758.519032:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627692416:12345-0@lo:400:kworker.0 Request processed in 2521us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518758.519045:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789518758.519282:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627692416:0@lo:400:kworker.0 00010000:00010000:3.0:1789518758.770832:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518759.585569:0:42272:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518759.585579:0:42272:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518759.585761:0:42272:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:0.0:1789518759.585768:0:42272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518759.795444:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518759.822381:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518759.822428:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518759.822514:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617512576 00000100:00100000:2.0:1789518759.822523:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617512576 00000100:00100000:1.0:1789518759.822529:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518759.822568:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:2.0:1789518759.822576:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617512576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518759.822708:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617512576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 131us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518759.822721:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 173 00000100:00100000:3.0:1789518759.823000:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617513088 00000100:00100000:3.0:1789518759.823005:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617513088 00000100:00100000:3.0:1789518759.823055:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:3.0:1789518759.823064:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617513088:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518759.823105:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617513088:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 43us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518759.823112:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:3.0:1789518759.823149:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518759.823219:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00080000:1.0:1789518759.823257:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518759.823409:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617512704 00000100:00100000:2.0:1789518759.823414:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617512704 00000100:00100000:2.0:1789518759.823454:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:2.0:1789518759.823471:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617512704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518759.823504:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617512704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 43us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518759.823510:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00080000:1.0:1789518759.823609:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518759.824187:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617512960 00000100:00100000:0.0:1789518759.824187:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617512832 00000100:00100000:2.0:1789518759.824193:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617512960 00000100:00100000:0.0:1789518759.824193:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617512832 00000100:00100000:2.0:1789518759.824282:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:2.0:1789518759.824290:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617512960:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518759.824329:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617512960:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518759.824336:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 99 00000100:00100000:0.0:1789518759.824512:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:0.0:1789518759.824519:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617512832:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518759.824551:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617512832:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518759.824558:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00080000:1.0:1789518759.824847:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518759.824851:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789518760.818974:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518761.112019:0:42323:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518761.112025:0:42323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518761.112072:0:42323:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:1.0:1789518761.112080:0:42323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518761.842793:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518762.607363:0:42376:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518762.607373:0:42376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518762.607445:0:42376:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1789518762.607453:0:42376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518762.866935:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518763.122866:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627692800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518763.122978:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518763.123033:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627692800 00000100:00100000:2.0:1789518763.123044:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627692800 00000100:00080000:1.0:1789518763.123095:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518763.123126:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789518763.123138:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627692800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518763.123188:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518763.123423:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627692800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 288us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518763.123434:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789518763.123499:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627692800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518763.634913:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627692928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518763.634981:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518763.635115:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627692928 00000100:00100000:2.0:1789518763.635122:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627692928 00000100:00100000:2.0:1789518763.635185:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789518763.635196:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8dde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627692928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518763.635230:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518763.635259:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627693056:0@lo:400:kworker.0 00000100:00100000:2.0:1789518763.635273:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8dde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627692928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518763.635280:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789518763.635316:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518763.635331:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627693184:0@lo:400:kworker.0 00000100:00080000:0.0:1789518763.635355:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518763.635356:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518763.635367:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627693440:0@lo:400:kworker.0 00000100:00100000:3.0:1789518763.635373:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518763.635377:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627693056 00000100:00100000:0.0:1789518763.635383:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627693056 00000100:00100000:3.0:1789518763.635401:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518763.635407:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518763.635409:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627693312:0@lo:400:kworker.0 00000100:00100000:0.0:1789518763.635418:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789518763.635427:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627693056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518763.635444:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518763.635483:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627693056:12345-0@lo:400:kworker.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518763.635490:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789518763.636503:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627693184 00000100:00100000:1.0:1789518763.636510:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627693184 00000100:00100000:2.0:1789518763.636516:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627692928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518763.636548:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627693440 00000100:00100000:2.0:1789518763.636551:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627693312 00000100:00100000:1.0:1789518763.636553:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627693440 00000100:00100000:2.0:1789518763.636557:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627693312 00000100:00100000:2.0:1789518763.636592:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789518763.636599:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627693184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518763.636659:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627693184:12345-0@lo:400:kworker.0 Request processed in 60us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518763.636665:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789518763.636679:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789518763.636685:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627693312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518763.636712:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627693312:12345-0@lo:400:kworker.0 Request processed in 28us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518763.636718:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789518763.636730:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789518763.636736:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627693440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518763.636767:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627693440:12345-0@lo:400:kworker.0 Request processed in 32us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518763.636772:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789518763.636807:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627693312:0@lo:400:kworker.0 00000100:00100000:2.0:1789518763.636816:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627693184:0@lo:400:kworker.0 00000100:00080000:2.0:1789518763.636835:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518763.637335:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627693440:0@lo:400:kworker.0 00000100:00100000:0.0:1789518763.637346:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627693056:0@lo:400:kworker.0 00010000:00010000:0.0:1789518763.890847:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518764.078348:0:42427:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518764.078359:0:42427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518764.078413:0:42427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:3.0:1789518764.078419:0:42427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518764.914834:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518764.941731:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518764.941776:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518764.941806:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518764.941809:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617513216 00000100:00100000:1.0:1789518764.941822:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617513216 00000100:00100000:2.0:1789518764.941830:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518764.941856:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617513344 00000100:00100000:0.0:1789518764.941864:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617513600 00000100:00100000:3.0:1789518764.941867:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617513344 00000100:00100000:2.0:1789518764.941871:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518764.941872:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617513600 00000100:00100000:1.0:1789518764.941905:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:1.0:1789518764.941920:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617513216:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518764.941925:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617513472 00000100:00100000:2.0:1789518764.941931:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617513472 00000100:00100000:3.0:1789518764.941948:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617513728 00000100:00100000:3.0:1789518764.941954:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617513728 00000100:00100000:0.0:1789518764.941957:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:0.0:1789518764.941969:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617513600:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518764.941987:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:3.0:1789518764.941992:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:2.0:1789518764.942005:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617513472:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518764.942006:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617513344:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518764.942014:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617513216:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 95us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518764.942014:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617513600:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518764.942024:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:1.0:1789518764.942026:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:2.0:1789518764.942056:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617513472:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518764.942058:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 150 00000100:00100000:3.0:1789518764.942065:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617513344:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 60us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518764.942072:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:0.0:1789518764.942073:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617513728:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518764.942095:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00080000:1.0:1789518764.942110:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518764.942116:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518764.942118:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518764.942118:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617513728:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518764.942126:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 150 00000040:00080000:2.0:1789518765.627467:0:42478:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518765.627475:0:42478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518765.627514:0:42478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1789518765.627521:0:42478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518765.939293:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518766.771077:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518766.771085:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518766.771127:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:0.0:1789518766.771133:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789518766.963899:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518767.140947:0:42530:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518767.140957:0:42530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518767.141010:0:42530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:0.0:1789518767.141017:0:42530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518767.986923:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518768.242964:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518768.242988:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627693568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518768.243063:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518768.243203:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627693568 00000100:00100000:2.0:1789518768.243212:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627693568 00000100:00100000:2.0:1789518768.243281:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789518768.243291:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffd073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627693568:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518768.243384:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789518768.243439:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518768.244210:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffd073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627693568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 918us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518768.244219:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789518768.244453:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627693568:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789518768.636894:0:42581:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518768.636904:0:42581:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518768.636953:0:42581:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:1.0:1789518768.636961:0:42581:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518768.754933:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627693824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518768.755009:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518768.755038:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627693952:0@lo:400:kworker.0 00000100:00100000:3.0:1789518768.755065:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627693696:0@lo:400:kworker.0 00000100:00100000:3.0:1789518768.755130:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518768.755130:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518768.755196:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627694336:0@lo:400:kworker.0 00000100:00100000:3.0:1789518768.755225:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518768.755263:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627693824 00000100:00100000:3.0:1789518768.755270:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627693824 00000100:00100000:3.0:1789518768.755323:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518768.755332:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627693824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518768.755364:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518768.755404:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627693824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518768.755411:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789518768.755431:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627693696 00000100:00100000:3.0:1789518768.755435:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627693696 00000100:00100000:3.0:1789518768.755463:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789518768.755470:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627693696:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518768.755475:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518768.755478:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627694080:0@lo:400:kworker.0 00000100:00100000:2.0:1789518768.755492:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627694336 00000100:00100000:2.0:1789518768.755497:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627694336 00000100:00100000:3.0:1789518768.755505:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627693696:12345-0@lo:400:kworker.0 Request processed in 35us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518768.755513:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789518768.755525:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518768.755550:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627694080 00000100:00100000:2.0:1789518768.755555:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627694080 00000100:00100000:3.0:1789518768.755570:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627693824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518768.755573:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518768.755583:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627694208:0@lo:400:kworker.0 00000100:00100000:3.0:1789518768.755585:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627693696:0@lo:400:kworker.0 00000100:00100000:0.0:1789518768.755642:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518768.755643:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789518768.755668:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627694336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518768.755715:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffeda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627694336:12345-0@lo:400:kworker.0 Request processed in 62us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518768.755723:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789518768.755729:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627694208 00000100:00100000:2.0:1789518768.755734:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627694208 00000100:00100000:0.0:1789518768.755742:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627693952 00000100:00100000:3.0:1789518768.755745:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789518768.755754:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627694080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518768.755759:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789518768.755770:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627694208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518768.755791:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627694080:12345-0@lo:400:kworker.0 Request processed in 38us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518768.755798:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789518768.755815:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627694208:12345-0@lo:400:kworker.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518768.755823:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789518768.755838:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627694208:0@lo:400:kworker.0 00000100:00080000:2.0:1789518768.755851:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518768.755854:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627694080:0@lo:400:kworker.0 00000100:00100000:3.0:1789518768.755916:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627694336:0@lo:400:kworker.0 00000100:00100000:0.0:1789518768.756036:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627693952 00000100:00100000:0.0:1789518768.756075:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789518768.756082:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627693952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518768.756363:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627693952:12345-0@lo:400:kworker.0 Request processed in 280us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518768.756374:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627693952:0@lo:400:kworker.0 00000100:00100000:0.0:1789518768.756383:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00010000:2.0:1789518769.012948:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518770.034874:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518770.061848:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518770.061938:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617513856 00000100:00100000:1.0:1789518770.061949:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617513856 00000100:00100000:2.0:1789518770.062064:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518770.062139:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518770.062158:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617514112 00000100:00100000:2.0:1789518770.062162:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617514112 00000100:00100000:2.0:1789518770.062222:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00100000:2.0:1789518770.062233:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617514112:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518770.062239:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617513984 00000100:00100000:0.0:1789518770.062245:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617513984 00000100:00100000:0.0:1789518770.062292:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:2.0:1789518770.062306:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617514112:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518770.062307:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617513984:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518770.062321:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 104 00000100:00080000:2.0:1789518770.062344:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518770.062350:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617513984:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 48us (284us total) trans 0 rc 0/0 00000100:00080000:2.0:1789518770.062351:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518770.062360:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:0.0:1789518770.062736:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 177 00000100:00100000:0.0:1789518770.062744:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617513856:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518770.062780:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617513856:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518770.062787:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 177 00000100:00100000:1.0:1789518770.063661:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518770.063757:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518770.063790:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617514240 00000100:00100000:1.0:1789518770.063795:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617514240 00000100:00100000:1.0:1789518770.063841:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:1.0:1789518770.063849:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617514240:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518770.063905:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617514240:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 56us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518770.063914:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 105 00000100:00100000:3.0:1789518770.063942:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617514368 00000100:00100000:3.0:1789518770.063946:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617514368 00000100:00100000:3.0:1789518770.063990:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:3.0:1789518770.063998:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617514368:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518770.064031:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617514368:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00080000:2.0:1789518770.064087:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518770.064092:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518770.064113:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 155 00000040:00080000:3.0:1789518770.123238:0:42632:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518770.123246:0:42632:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518770.123294:0:42632:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:3.0:1789518770.123300:0:42632:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518771.058903:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518771.618756:0:42683:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518771.618764:0:42683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518771.618812:0:42683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:0.0:1789518771.618818:0:42683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518772.083048:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518773.108125:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518773.187168:0:42736:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518773.187177:0:42736:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518773.187225:0:42736:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:0.0:1789518773.187230:0:42736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518773.362981:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518773.363003:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627694464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518773.363074:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518773.363354:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627694464 00000100:00100000:0.0:1789518773.363362:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627694464 00000100:00100000:0.0:1789518773.363470:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789518773.363480:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627694464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518773.363511:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518773.363580:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627694464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518773.363586:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789518773.363670:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627694464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518773.365937:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518773.874855:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627694592:0@lo:400:kworker.0 00000100:00100000:3.0:1789518773.874926:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518773.874982:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518773.874988:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627694720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518773.875019:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518773.875053:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627694720 00000100:00100000:3.0:1789518773.875060:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627694720 00000100:00100000:3.0:1789518773.875109:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789518773.875117:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627694720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518773.875148:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518773.875187:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627694720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518773.875194:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789518773.875212:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518773.875240:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627694720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518773.875275:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627694592 00000100:00100000:3.0:1789518773.875278:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627694592 00000100:00100000:3.0:1789518773.875300:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789518773.875306:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627694592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518773.875336:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627694592:12345-0@lo:400:kworker.0 Request processed in 30us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518773.875342:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789518773.875369:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627694592:0@lo:400:kworker.0 00000100:00100000:1.0:1789518773.876193:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627694848:0@lo:400:kworker.0 00000100:00100000:1.0:1789518773.876236:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518773.876354:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627694848 00000100:00100000:2.0:1789518773.876360:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627694848 00000100:00100000:2.0:1789518773.876393:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789518773.876401:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627694848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518773.876490:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627694976:0@lo:400:kworker.0 00000100:00100000:3.0:1789518773.876530:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518773.876571:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627694976 00000100:00100000:3.0:1789518773.876576:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627694976 00000100:00100000:3.0:1789518773.876607:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789518773.876645:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627694976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518773.876739:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627694976:12345-0@lo:400:kworker.0 Request processed in 79us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518773.876746:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1789518773.876765:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518773.876783:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627694976:0@lo:400:kworker.0 00000100:00100000:0.0:1789518773.877260:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518773.877268:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627695104:0@lo:400:kworker.0 00000100:00100000:0.0:1789518773.877295:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518773.877319:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627695104 00000100:00100000:0.0:1789518773.877322:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627695104 00000100:00100000:0.0:1789518773.877349:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789518773.877355:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627695104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518773.877387:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627695104:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518773.877392:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789518773.877417:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627695104:0@lo:400:kworker.0 00000100:00080000:0.0:1789518773.877434:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518773.877764:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627694848:12345-0@lo:400:kworker.0 Request processed in 1364us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518773.877776:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789518773.877791:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627694848:0@lo:400:kworker.0 00010000:00010000:3.0:1789518774.131932:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518774.790990:0:42787:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518774.791004:0:42787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518774.791059:0:42787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:1.0:1789518774.791069:0:42787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518775.155434:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518775.188817:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518775.188992:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617514496 00000100:00100000:2.0:1789518775.189005:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617514496 00000100:00100000:2.0:1789518775.189128:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:2.0:1789518775.189140:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617514496:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518775.189245:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617514496:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 108us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518775.189254:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:0.0:1789518775.193117:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518775.193167:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518775.193206:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518775.193233:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518775.193280:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617514624 00000100:00100000:0.0:1789518775.193292:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617514624 00000100:00100000:0.0:1789518775.193387:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617515008 00000100:00100000:0.0:1789518775.193392:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617515008 00000100:00100000:2.0:1789518775.193394:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617514880 00000100:00100000:2.0:1789518775.193402:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617514880 00000100:00100000:0.0:1789518775.193424:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:0.0:1789518775.193439:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617514624:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518775.193455:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617514752 00000100:00100000:0.0:1789518775.193539:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617514624:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 104us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518775.193556:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617514752 00000100:00100000:0.0:1789518775.193557:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:0.0:1789518775.193589:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00100000:0.0:1789518775.193599:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617515008:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518775.193659:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617515008:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 61us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518775.193666:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 160 00000100:00080000:0.0:1789518775.193692:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518775.193699:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00080000:0.0:1789518775.193700:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518775.193707:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518775.193717:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617514880:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518775.193795:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617514880:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 84us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518775.193807:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 106 00000100:00100000:2.0:1789518775.193852:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 107 00000100:00100000:2.0:1789518775.193860:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617514752:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518775.193894:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617514752:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518775.193900:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 107 00010000:00010000:1.0:1789518776.180477:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518776.324992:0:42838:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518776.325001:0:42838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518776.325050:0:42838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 14 count 3 00000040:00080000:2.0:1789518776.325058:0:42838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1789518777.011114:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518777.011137:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518777.012045:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 13 count 1 00000040:00080000:0.0:1789518777.012056:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518777.203667:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518777.840883:0:42889:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518777.840893:0:42889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518777.841480:0:42889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518777.841490:0:42889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518778.226894:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518778.482934:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518778.482966:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627695232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518778.483031:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518778.483169:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627695232 00000100:00100000:0.0:1789518778.483177:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627695232 00000100:00080000:2.0:1789518778.483229:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518778.483248:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789518778.483257:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627695232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518778.483291:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518778.483343:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627695232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518778.483350:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789518778.483456:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627695232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518778.994750:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627695360:0@lo:400:kworker.0 00000100:00100000:0.0:1789518778.994792:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627695616:0@lo:400:kworker.0 00000100:00100000:1.0:1789518778.994834:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518778.994853:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518778.994890:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518778.994894:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627695872:0@lo:400:kworker.0 00000100:00100000:0.0:1789518778.994902:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec81b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627695744:0@lo:400:kworker.0 00000100:00100000:1.0:1789518778.994932:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518778.994942:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627695488:0@lo:400:kworker.0 00000100:00100000:0.0:1789518778.994960:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627695616 00000100:00100000:0.0:1789518778.994968:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627695616 00000100:00100000:3.0:1789518778.994990:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518778.995034:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627695872 00000100:00100000:0.0:1789518778.995038:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627695872 00000100:00100000:3.0:1789518778.995082:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627695488 00000100:00100000:3.0:1789518778.995087:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627695488 00000100:00100000:0.0:1789518778.995088:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789518778.995101:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627695616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518778.995107:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627695360 00000100:00100000:1.0:1789518778.995114:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627695360 00000100:00100000:3.0:1789518778.995129:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789518778.995139:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627695488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518778.995152:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789518778.995158:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627695616:12345-0@lo:400:kworker.0 Request processed in 59us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518778.995166:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789518778.995171:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627695360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518778.995186:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627695488:12345-0@lo:400:kworker.0 Request processed in 48us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518778.995193:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789518778.995198:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789518778.995203:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627695872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518778.995233:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627696000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518778.995246:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627695872:12345-0@lo:400:kworker.0 Request processed in 45us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518778.995254:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1789518778.995279:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518778.995284:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518778.995395:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627695360:12345-0@lo:400:kworker.0 Request processed in 228us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518778.995404:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518778.995408:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789518778.995450:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627695488:0@lo:400:kworker.0 00000100:00100000:3.0:1789518778.995487:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627696000 00000100:00100000:3.0:1789518778.995492:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627696000 00000100:00100000:3.0:1789518778.995523:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789518778.995531:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627696000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518778.995555:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518778.995600:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627696000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518778.995608:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789518778.995657:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627696000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518778.995669:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627695872:0@lo:400:kworker.0 00000100:00100000:3.0:1789518778.995684:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627695360:0@lo:400:kworker.0 00000100:00100000:0.0:1789518778.997463:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518778.997508:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627695616:0@lo:400:kworker.0 00000100:00100000:3.0:1789518778.997582:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627695744 00000100:00100000:3.0:1789518778.997588:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627695744 00000100:00080000:0.0:1789518778.997711:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518778.997726:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789518778.997735:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627695744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518778.997801:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627695744:12345-0@lo:400:kworker.0 Request processed in 67us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518778.997807:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789518778.997848:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec81b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627695744:0@lo:400:kworker.0 00010000:00010000:1.0:1789518779.250935:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518779.377429:0:42940:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518779.377439:0:42940:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518779.377998:0:42940:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518779.378008:0:42940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518780.274786:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518780.301605:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518780.301705:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518780.301731:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617515136 00000100:00100000:2.0:1789518780.301745:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617515136 00000100:00100000:1.0:1789518780.301775:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617515264 00000100:00100000:1.0:1789518780.301782:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617515264 00000100:00100000:1.0:1789518780.301921:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:1.0:1789518780.301932:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617515264:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518780.301959:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:2.0:1789518780.301974:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617515136:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518780.302028:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617515264:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 99us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518780.302036:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617515136:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 62us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518780.302042:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:2.0:1789518780.302051:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00080000:1.0:1789518780.302099:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518780.303570:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518780.303820:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617515392 00000100:00100000:2.0:1789518780.303831:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617515392 00000100:00100000:2.0:1789518780.303904:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:2.0:1789518780.303914:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617515392:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518780.303989:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec81b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617515392:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 77us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518780.303997:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 109 00000100:00100000:0.0:1789518780.304089:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518780.304219:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518780.304247:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617515648 00000100:00100000:0.0:1789518780.304251:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617515648 00000100:00080000:1.0:1789518780.304252:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518780.304264:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518780.304291:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:0.0:1789518780.304301:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617515648:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518780.304353:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617515648:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 53us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518780.304360:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:2.0:1789518780.304766:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617515520 00000100:00100000:2.0:1789518780.304770:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617515520 00000100:00100000:2.0:1789518780.304803:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:2.0:1789518780.304818:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617515520:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518780.304860:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617515520:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 51us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518780.304867:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00080000:1.0:1789518780.305424:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1789518780.896210:0:42992:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518780.896224:0:42992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518780.896799:0:42992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518780.896823:0:42992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518781.300400:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518782.322750:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518782.497297:0:43044:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518782.497311:0:43044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518782.497853:0:43044:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518782.497863:0:43044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518783.346878:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518783.602938:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627696128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518783.603007:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518783.603110:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627696128 00000100:00100000:1.0:1789518783.603118:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627696128 00000100:00100000:1.0:1789518783.603176:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789518783.603185:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627696128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518783.603218:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00080000:3.0:1789518783.603499:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518783.606329:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627696128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3137us (3313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518783.606343:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789518783.608923:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627696128:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789518784.056638:0:43095:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518784.056651:0:43095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518784.057202:0:43095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518784.057212:0:43095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1789518784.115026:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627696384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518784.115042:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627696256:0@lo:400:kworker.0 00000100:00100000:0.0:1789518784.115088:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627696640:0@lo:400:kworker.0 00000100:00100000:2.0:1789518784.115215:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518784.115217:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518784.115261:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518784.115294:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627696896:0@lo:400:kworker.0 00000100:00100000:2.0:1789518784.115296:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627696768:0@lo:400:kworker.0 00000100:00100000:0.0:1789518784.115308:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627696640 00000100:00100000:0.0:1789518784.115317:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627696640 00000100:00100000:2.0:1789518784.115335:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518784.115378:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627696256 00000100:00100000:2.0:1789518784.115383:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627696256 00000100:00100000:2.0:1789518784.115423:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789518784.115434:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627696256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518784.115642:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627696256:12345-0@lo:400:kworker.0 Request processed in 210us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518784.115651:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789518784.115694:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627696768 00000100:00100000:2.0:1789518784.115698:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627696768 00000100:00100000:2.0:1789518784.115731:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789518784.115738:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627696768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518784.115773:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627696768:12345-0@lo:400:kworker.0 Request processed in 36us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518784.115780:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789518784.115839:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627696768:0@lo:400:kworker.0 00000100:00100000:2.0:1789518784.115849:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627696256:0@lo:400:kworker.0 00000100:00100000:2.0:1789518784.115894:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627696384 00000100:00100000:2.0:1789518784.115899:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627696384 00000100:00100000:2.0:1789518784.115931:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789518784.115940:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627696384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518784.115964:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789518784.115980:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518784.115990:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789518784.116000:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627696512:0@lo:400:kworker.0 00000100:00100000:2.0:1789518784.116041:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1876445627696384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518784.116048:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789518784.116087:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627696896 00000100:00100000:2.0:1789518784.116091:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627696896 00000100:00100000:2.0:1789518784.116122:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789518784.116129:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627696896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518784.116170:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627696896:12345-0@lo:400:kworker.0 Request processed in 41us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518784.116178:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789518784.116235:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789518784.116263:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627696640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518784.116369:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627696640:12345-0@lo:400:kworker.0 Request processed in 121us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518784.116377:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1789518784.116408:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518784.116414:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518784.116485:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627696640:0@lo:400:kworker.0 00000100:00100000:1.0:1789518784.116809:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518784.116847:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff738b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627697024:0@lo:400:kworker.0 00000100:00100000:1.0:1789518784.116885:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518784.116915:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627696512 00000100:00100000:2.0:1789518784.116922:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627696512 00000100:00100000:1.0:1789518784.116930:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627696896:0@lo:400:kworker.0 00000100:00100000:1.0:1789518784.116953:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627696384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518784.116966:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789518784.116977:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627696512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518784.117093:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627696512:12345-0@lo:400:kworker.0 Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518784.117102:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789518784.117111:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627697024 00000100:00100000:0.0:1789518784.117117:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627697024 00000100:00080000:2.0:1789518784.117156:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518784.117166:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789518784.117176:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627697024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518784.117215:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627697024:12345-0@lo:400:kworker.0 Request processed in 41us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518784.117221:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789518784.117289:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627696512:0@lo:400:kworker.0 00000100:00100000:1.0:1789518784.117300:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff738b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627697024:0@lo:400:kworker.0 00010000:00010000:2.0:1789518784.371694:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518785.395820:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518785.423480:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518785.423940:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617515904 00000100:00100000:1.0:1789518785.423953:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617515904 00000100:00100000:1.0:1789518785.424032:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:1.0:1789518785.424043:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2344:x1876445617515904:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518785.424195:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00080000:3.0:1789518785.424278:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518785.425851:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518785.425895:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518785.425931:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518785.425970:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617515776 00000100:00100000:0.0:1789518785.425980:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617515776 00000100:00100000:0.0:1789518785.426029:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 183 00000100:00100000:0.0:1789518785.426038:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617515776:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518785.426213:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2344:x1876445617515904:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2170us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518785.426225:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:1.0:1789518785.426249:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617516288 00000100:00100000:1.0:1789518785.426253:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617516288 00000100:00100000:1.0:1789518785.426288:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:1.0:1789518785.426293:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617516288:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518785.426410:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617516288:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518785.426418:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 170 00000100:00100000:0.0:1789518785.426653:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617515776:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 616us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518785.426661:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 183 00000100:00100000:3.0:1789518785.426666:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617516160 00000100:00100000:3.0:1789518785.426672:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617516160 00000100:00100000:0.0:1789518785.426693:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617516032 00000100:00100000:0.0:1789518785.426696:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617516032 00000100:00100000:3.0:1789518785.426707:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00100000:3.0:1789518785.426714:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2344:x1876445617516160:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518785.426745:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2344:x1876445617516160:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518785.426751:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 113 00000100:00080000:3.0:1789518785.426818:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518785.426823:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518785.428655:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518785.429031:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 114 00000100:00100000:0.0:1789518785.429049:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617516032:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518785.429409:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617516032:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 82us (3227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518785.429420:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 114 00000040:00080000:2.0:1789518785.650605:0:43146:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518785.650638:0:43146:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518785.651177:0:43146:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518785.651189:0:43146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518786.418932:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518787.235845:0:43198:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518787.235853:0:43198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518787.237302:0:43198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518787.237316:0:43198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1789518787.250931:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518787.250939:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518787.251807:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518787.251820:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518787.443603:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518788.466788:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518788.722812:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627697152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518788.722992:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518788.723076:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627697152 00000100:00100000:2.0:1789518788.723085:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627697152 00000100:00100000:2.0:1789518788.723154:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789518788.723163:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627697152:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518788.723175:0:36536:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789518788.723188:0:36536:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1789518788.723204:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518788.723256:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627697152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518788.723264:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789518788.723316:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627697152:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518788.723731:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789518788.869981:0:43250:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518788.869991:0:43250:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518788.870515:0:43250:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518788.870525:0:43250:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518789.235022:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627697280:0@lo:400:kworker.0 00000100:00100000:3.0:1789518789.235048:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627697664:0@lo:400:kworker.0 00000100:00100000:2.0:1789518789.235141:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627697536:0@lo:400:kworker.0 00000100:00100000:1.0:1789518789.235176:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627697408:0@lo:400:kworker.0 00000100:00100000:0.0:1789518789.236215:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518789.236298:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627697792:0@lo:400:kworker.0 00000100:00100000:0.0:1789518789.236340:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518789.236390:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627697792 00000100:00100000:0.0:1789518789.236399:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627697792 00000100:00100000:0.0:1789518789.236469:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789518789.236479:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627697792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518789.236643:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627697792:12345-0@lo:400:kworker.0 Request processed in 165us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518789.236651:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789518789.236755:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627697792:0@lo:400:kworker.0 00000100:00080000:0.0:1789518789.236863:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518789.236883:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627697280 00000100:00100000:0.0:1789518789.236887:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627697280 00000100:00100000:0.0:1789518789.236916:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789518789.236923:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627697280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518789.236962:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627697280:12345-0@lo:400:kworker.0 Request processed in 39us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518789.236969:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789518789.237008:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627697280:0@lo:400:kworker.0 00000100:00100000:3.0:1789518789.238387:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518789.238523:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627697664 00000100:00100000:0.0:1789518789.238533:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627697664 00000100:00100000:0.0:1789518789.238590:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789518789.238600:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627697664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518789.239743:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518789.239786:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518789.239838:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627697536 00000100:00100000:3.0:1789518789.239847:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627697536 00000100:00100000:2.0:1789518789.239884:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627698048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518789.239884:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627697920:0@lo:400:kworker.0 00000100:00100000:3.0:1789518789.239921:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627697408 00000100:00100000:3.0:1789518789.239925:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627697408 00000100:00100000:2.0:1789518789.239945:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518789.239953:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789518789.239954:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518789.239965:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627697536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518789.240010:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789518789.240021:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627697408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518789.240063:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627698048 00000100:00100000:2.0:1789518789.240068:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627698048 00000100:00100000:2.0:1789518789.240104:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789518789.240113:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff738b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627698048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518789.240126:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627697408:12345-0@lo:400:kworker.0 Request processed in 107us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518789.240135:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00002000:00000024:2.0:1789518789.240151:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518789.240166:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627697920 00000100:00100000:1.0:1789518789.240172:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627697920 00000100:00100000:1.0:1789518789.240207:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789518789.240216:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627697920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518789.240231:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627697536:12345-0@lo:400:kworker.0 Request processed in 267us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518789.240233:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff738b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627698048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518789.240245:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789518789.240252:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789518789.240260:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627697920:12345-0@lo:400:kworker.0 Request processed in 46us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518789.240269:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1789518789.240285:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518789.240290:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518789.240310:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627698048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518789.240325:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627697408:0@lo:400:kworker.0 00000100:00100000:2.0:1789518789.240330:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627697536:0@lo:400:kworker.0 00000100:00100000:1.0:1789518789.240344:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627697920:0@lo:400:kworker.0 00000100:00100000:0.0:1789518789.241117:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627697664:12345-0@lo:400:kworker.0 Request processed in 2515us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518789.241127:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789518789.241498:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627697664:0@lo:400:kworker.0 00010000:00010000:3.0:1789518789.491188:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518790.427801:0:43301:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518790.427809:0:43301:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518790.428337:0:43301:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518790.428346:0:43301:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518790.518528:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518790.543324:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518790.543379:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518790.543425:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617516416 00000100:00100000:0.0:1789518790.543432:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518790.543448:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617516416 00000100:00100000:0.0:1789518790.543470:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518790.543517:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518790.543526:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 185 00000100:00100000:3.0:1789518790.543540:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617516416:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518790.543541:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617516672 00000100:00100000:2.0:1789518790.543549:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617516672 00000100:00100000:0.0:1789518790.543550:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617516800 00000100:00100000:0.0:1789518790.543556:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617516800 00000100:00100000:1.0:1789518790.543635:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617516928 00000100:00100000:1.0:1789518790.543639:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617516928 00000100:00100000:3.0:1789518790.543658:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617516416:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518790.543667:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 185 00000100:00100000:3.0:1789518790.543706:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617516544 00000100:00100000:3.0:1789518790.543710:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617516544 00000100:00100000:3.0:1789518790.543746:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:3.0:1789518790.543753:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617516544:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518790.543803:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617516544:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518790.543810:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00080000:3.0:1789518790.543833:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518790.543838:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518790.543840:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518790.543921:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:2.0:1789518790.543934:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617516672:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518790.543977:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:0.0:1789518790.543987:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617516800:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518790.544019:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617516672:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 87us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518790.544029:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617516800:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518790.544030:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:0.0:1789518790.544041:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:2.0:1789518790.544174:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:2.0:1789518790.544184:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617516928:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518790.544228:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617516928:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 46us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518790.544245:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 175 00010000:00010000:1.0:1789518791.538751:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518792.081001:0:43352:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518792.081014:0:43352:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518792.081942:0:43352:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518792.081958:0:43352:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518792.562930:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518793.586920:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518793.721928:0:43404:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518793.721940:0:43404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518793.722467:0:43404:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518793.722476:0:43404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518793.843093:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518793.843811:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627698176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518793.843900:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518793.845105:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627698176 00000100:00100000:3.0:1789518793.845119:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627698176 00000100:00100000:3.0:1789518793.845198:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789518793.845210:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627698176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518793.845258:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518793.845350:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627698176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518793.845359:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789518793.845420:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627698176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518793.847925:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518794.355054:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627698560:0@lo:400:kworker.0 00000100:00100000:3.0:1789518794.355065:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627698688:0@lo:400:kworker.0 00000100:00100000:1.0:1789518794.355140:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627698304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518794.355794:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627698432:0@lo:400:kworker.0 00000100:00100000:0.0:1789518794.356241:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518794.356333:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518794.356337:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627699072:0@lo:400:kworker.0 00000100:00100000:3.0:1789518794.356376:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627698560 00000100:00100000:0.0:1789518794.356383:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518794.356385:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627698560 00000100:00100000:0.0:1789518794.356421:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627698688 00000100:00100000:0.0:1789518794.356437:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627698688 00000100:00100000:3.0:1789518794.356440:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789518794.356462:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627698560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518794.356493:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789518794.356503:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627698688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518794.356547:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627698688:12345-0@lo:400:kworker.0 Request processed in 46us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518794.356555:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789518794.356586:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627699072 00000100:00100000:0.0:1789518794.356590:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627699072 00000100:00100000:0.0:1789518794.356640:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789518794.356648:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627699072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518794.356693:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627698560:12345-0@lo:400:kworker.0 Request processed in 242us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518794.356699:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627699072:12345-0@lo:400:kworker.0 Request processed in 50us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518794.356717:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789518794.356717:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1789518794.356756:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518794.356763:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518794.356802:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627698688:0@lo:400:kworker.0 00000100:00100000:0.0:1789518794.357420:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627699072:0@lo:400:kworker.0 00000100:00100000:0.0:1789518794.357436:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627698560:0@lo:400:kworker.0 00000100:00100000:1.0:1789518794.357448:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518794.357542:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec82d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627698816:0@lo:400:kworker.0 00000100:00100000:1.0:1789518794.357571:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518794.357717:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627698304 00000100:00100000:3.0:1789518794.357723:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627698304 00000100:00100000:3.0:1789518794.357816:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789518794.357826:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec348aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627698304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518794.357864:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518794.357899:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627698816 00000100:00100000:0.0:1789518794.357906:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627698816 00000100:00100000:3.0:1789518794.357916:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec348aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627698304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518794.357925:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789518794.357952:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789518794.357961:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627698816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518794.358000:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627698816:12345-0@lo:400:kworker.0 Request processed in 41us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518794.358007:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789518794.358059:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff4b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627698304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518794.358073:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec82d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627698816:0@lo:400:kworker.0 00000100:00100000:2.0:1789518794.358142:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518794.358169:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627698944:0@lo:400:kworker.0 00000100:00100000:2.0:1789518794.358196:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518794.358278:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627698944 00000100:00100000:1.0:1789518794.358283:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627698944 00000100:00100000:0.0:1789518794.358325:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627698432 00000100:00100000:0.0:1789518794.358330:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627698432 00000100:00100000:1.0:1789518794.358372:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789518794.358380:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627698944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518794.358420:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627698944:12345-0@lo:400:kworker.0 Request processed in 41us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518794.358428:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789518794.358437:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789518794.358447:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627698432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518794.358486:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627698432:12345-0@lo:400:kworker.0 Request processed in 42us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518794.358493:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789518794.358664:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff7883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627698432:0@lo:400:kworker.0 00000100:00100000:3.0:1789518794.358682:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627698944:0@lo:400:kworker.0 00000100:00080000:2.0:1789518794.358710:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789518794.610798:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518795.281555:0:43456:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518795.281566:0:43456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518795.282177:0:43456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518795.282188:0:43456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518795.636000:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518795.662025:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518795.662065:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518795.662082:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617517184 00000100:00100000:3.0:1789518795.662093:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617517184 00000100:00100000:0.0:1789518795.662204:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00080000:2.0:1789518795.662241:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518795.662251:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617517056 00000100:00100000:0.0:1789518795.662256:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617517056 00000100:00100000:3.0:1789518795.662289:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:2.0:1789518795.662289:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518795.662297:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:3.0:1789518795.662303:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617517184:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518795.662318:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617517056:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518795.662377:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617517056:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518795.662385:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:3.0:1789518795.662473:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff4b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617517184:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 174us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518795.662480:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:1.0:1789518795.663306:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617517440 00000100:00100000:1.0:1789518795.663313:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617517440 00000100:00100000:0.0:1789518795.663320:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617517312 00000100:00100000:0.0:1789518795.663323:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617517312 00000100:00100000:0.0:1789518795.663353:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:1.0:1789518795.663359:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:2.0:1789518795.663366:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518795.663366:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617517312:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518795.663367:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617517440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518795.663399:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617517568 00000100:00100000:2.0:1789518795.663404:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617517568 00000100:00100000:1.0:1789518795.663410:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617517440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 42us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518795.663410:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617517312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 49us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518795.663417:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:1.0:1789518795.663421:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:2.0:1789518795.663444:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:2.0:1789518795.663454:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617517568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518795.663487:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617517568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518795.663493:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00080000:0.0:1789518795.663666:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518795.663670:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518795.663672:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789518796.659097:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518796.800468:0:43507:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518796.800479:0:43507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518796.801082:0:43507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518796.801093:0:43507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1789518797.490895:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518797.490903:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518797.492069:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518797.492939:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789518797.682812:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518798.324942:0:43558:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518798.324951:0:43558:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518798.325498:0:43558:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518798.325652:0:43558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518798.707768:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518798.963817:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518798.963840:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627699200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518798.963903:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518798.964016:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627699200 00000100:00100000:2.0:1789518798.964023:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627699200 00000100:00100000:2.0:1789518798.964080:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789518798.964088:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627699200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518798.964120:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518798.964168:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627699200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518798.964174:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789518798.964213:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffed746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627699200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518798.964270:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518799.474780:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec25cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627699328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518799.474856:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518799.474883:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627699584:0@lo:400:kworker.0 00000100:00100000:2.0:1789518799.474920:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627699840:0@lo:400:kworker.0 00000100:00100000:0.0:1789518799.474927:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518799.474953:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627700096:0@lo:400:kworker.0 00000100:00100000:2.0:1789518799.474962:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518799.474964:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627699456:0@lo:400:kworker.0 00000100:00100000:2.0:1789518799.474990:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518799.474990:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518799.475001:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627699712:0@lo:400:kworker.0 00000100:00100000:3.0:1789518799.475016:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518799.475035:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518799.475036:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627699584 00000100:00100000:0.0:1789518799.475044:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627699584 00000100:00100000:3.0:1789518799.475057:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec201b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627699968:0@lo:400:kworker.0 00000100:00100000:3.0:1789518799.475092:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518799.475093:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627699712 00000100:00100000:0.0:1789518799.475097:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627699712 00000100:00100000:0.0:1789518799.475199:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789518799.475208:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627699584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518799.475253:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627699584:12345-0@lo:400:kworker.0 Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518799.475259:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789518799.475274:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789518799.475278:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627699712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518799.475512:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627699712:12345-0@lo:400:kworker.0 Request processed in 232us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518799.475518:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789518799.475540:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518799.475567:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627699584:0@lo:400:kworker.0 00000100:00100000:0.0:1789518799.475593:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627699712:0@lo:400:kworker.0 00000100:00100000:2.0:1789518799.475814:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627699840 00000100:00100000:3.0:1789518799.475816:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627700096 00000100:00100000:2.0:1789518799.475820:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627699840 00000100:00100000:3.0:1789518799.475823:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627700096 00000100:00100000:2.0:1789518799.475855:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627699968 00000100:00100000:2.0:1789518799.475860:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627699968 00000100:00100000:3.0:1789518799.475867:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789518799.475878:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627699840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518799.475889:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789518799.475899:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627700096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518799.475979:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627699840:12345-0@lo:400:kworker.0 Request processed in 105us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518799.475986:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789518799.476001:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789518799.476007:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627699968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518799.476043:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffbb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627699968:12345-0@lo:400:kworker.0 Request processed in 36us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518799.476050:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789518799.476061:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627700096:12345-0@lo:400:kworker.0 Request processed in 163us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518799.476083:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627699456 00000100:00100000:3.0:1789518799.476088:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627699456 00000100:00100000:3.0:1789518799.476113:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789518799.476119:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627699456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518799.476137:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789518799.476153:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627699456:12345-0@lo:400:kworker.0 Request processed in 33us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518799.476161:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789518799.476169:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627699328 00000100:00100000:2.0:1789518799.476175:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627699328 00000100:00080000:3.0:1789518799.476202:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518799.476210:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789518799.476219:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffed746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627699328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518799.476247:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518799.476282:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffed746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627699328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518799.476289:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789518799.476346:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627699456:0@lo:400:kworker.0 00000100:00100000:3.0:1789518799.476362:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec201b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627699968:0@lo:400:kworker.0 00000100:00100000:1.0:1789518799.476507:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627700096:0@lo:400:kworker.0 00000100:00100000:0.0:1789518799.476592:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627699840:0@lo:400:kworker.0 00000100:00100000:0.0:1789518799.476607:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec25cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627699328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789518799.730783:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518799.804733:0:43609:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518799.804743:0:43609:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518799.805300:0:43609:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518799.805309:0:43609:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789518800.754799:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518800.784264:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518800.784307:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518800.784353:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518800.784441:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617517696 00000100:00100000:2.0:1789518800.784451:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617517696 00000100:00100000:2.0:1789518800.784503:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:2.0:1789518800.784512:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617517696:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518800.784572:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617517696:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 60us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518800.784580:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:3.0:1789518800.784874:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617517824 00000100:00100000:3.0:1789518800.784879:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617517824 00000100:00100000:3.0:1789518800.784934:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00100000:3.0:1789518800.784942:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617517824:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518800.784977:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617517824:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 37us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518800.784984:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00080000:0.0:1789518800.785045:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518800.785194:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617518080 00000100:00100000:1.0:1789518800.785198:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617518080 00000100:00100000:1.0:1789518800.785248:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:1.0:1789518800.785256:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617518080:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518800.785299:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617518080:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 43us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518800.785306:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00080000:0.0:1789518800.785494:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518800.787794:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518800.787837:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518800.787917:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617517952 00000100:00100000:0.0:1789518800.787927:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617517952 00000100:00100000:0.0:1789518800.787997:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:0.0:1789518800.788007:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617517952:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518800.788069:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617517952:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518800.788081:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00080000:1.0:1789518800.788214:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518800.788242:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617518208 00000100:00100000:3.0:1789518800.788248:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617518208 00000100:00100000:3.0:1789518800.788307:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 185 00000100:00100000:3.0:1789518800.788314:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617518208:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518800.788352:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617518208:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518800.788359:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 185 00000100:00080000:1.0:1789518800.789563:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789518801.438425:0:43661:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518801.438433:0:43661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518801.441729:0:43661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518801.441792:0:43661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518801.779553:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518802.802779:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518802.987998:0:43713:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518802.988006:0:43713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518802.989064:0:43713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518802.989074:0:43713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789518803.827021:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518804.083067:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627700224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518804.083132:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518804.083366:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627700224 00000100:00100000:2.0:1789518804.083373:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627700224 00000100:00100000:2.0:1789518804.083441:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789518804.083450:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec2019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627700224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518804.083482:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518804.083525:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec2019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627700224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518804.083532:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789518804.083600:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518804.083658:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627700224:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789518804.532945:0:43764:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518804.532954:0:43764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518804.533462:0:43764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518804.533471:0:43764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518804.594750:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627700352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518804.594817:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518804.594825:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627700480:0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.594874:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518804.594878:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627700864:0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.594909:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627700992:0@lo:400:kworker.0 00000100:00100000:0.0:1789518804.594916:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518804.594948:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627700608:0@lo:400:kworker.0 00000100:00100000:0.0:1789518804.594965:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518804.594974:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627700736:0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.594992:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518804.595007:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518804.595033:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627700352 00000100:00100000:2.0:1789518804.595040:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627700352 00000100:00100000:0.0:1789518804.595070:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627700864 00000100:00100000:0.0:1789518804.595075:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627700864 00000100:00100000:2.0:1789518804.595101:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789518804.595110:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627700352:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518804.595118:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627700736 00000100:00100000:0.0:1789518804.595124:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627700736 00002000:00000024:2.0:1789518804.595144:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518804.595150:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789518804.595160:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec25cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627700864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.595194:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627700352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518804.595203:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789518804.595208:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec25cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627700864:12345-0@lo:400:kworker.0 Request processed in 48us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518804.595215:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789518804.595223:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789518804.595230:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627700736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.595231:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627700480 00000100:00100000:2.0:1789518804.595236:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627700480 00000100:00100000:2.0:1789518804.595264:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789518804.595277:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627700480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518804.595278:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627700736:12345-0@lo:400:kworker.0 Request processed in 49us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518804.595289:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789518804.595315:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627700480:12345-0@lo:400:kworker.0 Request processed in 43us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518804.595322:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789518804.595352:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627700608 00000100:00100000:2.0:1789518804.595355:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627700608 00000100:00100000:2.0:1789518804.595384:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789518804.595392:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627700608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.595438:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627700608:12345-0@lo:400:kworker.0 Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518804.595446:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1789518804.595468:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518804.595474:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518804.595478:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627700608:0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.595495:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518804.595518:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627700992 00000100:00100000:0.0:1789518804.595523:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627700992 00000100:00100000:2.0:1789518804.595533:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627700480:0@lo:400:kworker.0 00000100:00100000:0.0:1789518804.595556:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789518804.595564:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627700992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518804.595602:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627700992:12345-0@lo:400:kworker.0 Request processed in 39us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518804.595609:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1789518804.595704:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518804.596176:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627700992:0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.596206:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627700736:0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.596215:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627700864:0@lo:400:kworker.0 00000100:00100000:2.0:1789518804.596229:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627700352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789518804.850832:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518805.875449:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518805.901118:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518805.901177:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518805.901217:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518805.901247:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518805.901278:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617518592 00000100:00100000:3.0:1789518805.901294:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518805.901296:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617518592 00000100:00100000:3.0:1789518805.901328:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617518464 00000100:00100000:3.0:1789518805.901333:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617518464 00000100:00100000:2.0:1789518805.901375:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617518720 00000100:00100000:3.0:1789518805.901378:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617518848 00000100:00100000:2.0:1789518805.901381:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617518720 00000100:00100000:3.0:1789518805.901384:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617518848 00000100:00100000:2.0:1789518805.901426:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:2.0:1789518805.901440:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617518592:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518805.901483:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:3.0:1789518805.901494:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617518464:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518805.901545:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617518592:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518805.901551:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617518464:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 57us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518805.901559:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:1.0:1789518805.901563:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:3.0:1789518805.901572:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:1.0:1789518805.901578:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617518848:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518805.901586:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:2.0:1789518805.901597:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec82d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617518720:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518805.901646:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617518848:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 72us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518805.901657:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec82d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617518720:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 60us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518805.901657:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:2.0:1789518805.901667:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:0.0:1789518805.901762:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617518336 00000100:00100000:0.0:1789518805.901769:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617518336 00000100:00100000:0.0:1789518805.901812:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 191 00000100:00080000:3.0:1789518805.901820:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518805.901822:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617518336:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:3.0:1789518805.901827:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518805.901830:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518805.901867:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617518336:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 47us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518805.901876:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 191 00000040:00080000:3.0:1789518806.047679:0:43815:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518806.047704:0:43815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518806.048335:0:43815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518806.048347:0:43815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789518806.898805:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518807.593324:0:43866:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518807.593333:0:43866:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518807.594064:0:43866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518807.594075:0:43866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1789518807.730814:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518807.730823:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518807.731908:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518807.731920:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518807.923044:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518808.947018:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518809.151125:0:43918:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518809.151133:0:43918:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518809.152083:0:43918:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518809.152095:0:43918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518809.203825:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627701120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518809.203888:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518809.203960:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627701120 00000100:00100000:2.0:1789518809.203967:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627701120 00000100:00100000:2.0:1789518809.204018:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789518809.204026:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627701120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518809.204064:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518809.204104:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627701120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518809.204111:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789518809.204130:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518809.204161:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627701120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518809.715006:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627701504:0@lo:400:kworker.0 00000100:00100000:2.0:1789518809.715076:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518809.715140:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518809.715147:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627701632:0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.715391:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627701376:0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.715423:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518809.715448:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789518809.715454:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627701248:0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.715480:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518809.715504:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627701760:0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.715534:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627701376 00000100:00100000:3.0:1789518809.715541:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627701376 00000100:00100000:3.0:1789518809.715600:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789518809.715609:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627701376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.715698:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627701376:12345-0@lo:400:kworker.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518809.715704:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789518809.715726:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627701248 00000100:00100000:3.0:1789518809.715730:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627701248 00000100:00100000:3.0:1789518809.715755:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789518809.715761:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627701248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.715790:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627701248:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518809.715795:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:3.0:1789518809.715819:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518809.717133:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518809.717348:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518809.717472:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518809.717487:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627701888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518809.717527:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518809.717554:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627701888 00000100:00100000:2.0:1789518809.717560:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627701888 00000100:00100000:2.0:1789518809.717591:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789518809.717598:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627701888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518809.717641:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518809.717693:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627701888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518809.717701:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789518809.717744:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627701888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518809.718359:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627701376:0@lo:400:kworker.0 00000100:00100000:1.0:1789518809.718377:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627701248:0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.718493:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627701504 00000100:00100000:3.0:1789518809.718498:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627701504 00000100:00100000:3.0:1789518809.718534:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627701632 00000100:00100000:3.0:1789518809.718538:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627701632 00000100:00100000:3.0:1789518809.718565:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627701760 00000100:00100000:3.0:1789518809.718568:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627701760 00000100:00100000:3.0:1789518809.718583:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789518809.718589:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627701504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.718652:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627701504:12345-0@lo:400:kworker.0 Request processed in 62us (3576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518809.718658:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789518809.718688:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789518809.718694:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627701632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.718725:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627701632:12345-0@lo:400:kworker.0 Request processed in 32us (3552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518809.718734:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789518809.718745:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789518809.718751:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627701760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.718785:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627701760:12345-0@lo:400:kworker.0 Request processed in 34us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518809.718790:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1789518809.718807:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518809.718827:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627701632:0@lo:400:kworker.0 00000100:00100000:3.0:1789518809.718838:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627701504:0@lo:400:kworker.0 00000100:00100000:1.0:1789518809.718922:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627701760:0@lo:400:kworker.0 00010000:00010000:1.0:1789518809.970882:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518810.742757:0:43969:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518810.742765:0:43969:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518810.743571:0:43969:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518810.743580:0:43969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518810.995302:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518811.023336:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518811.023419:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518811.023456:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518811.023538:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518811.023633:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518811.023671:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617519488 00000100:00100000:3.0:1789518811.023713:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617519488 00000100:00100000:3.0:1789518811.023758:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617519104 00000100:00100000:3.0:1789518811.023760:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617519104 00000100:00100000:3.0:1789518811.023774:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:3.0:1789518811.023780:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617519488:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518811.023834:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617519488:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 54us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518811.023839:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:3.0:1789518811.023851:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:3.0:1789518811.023854:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617519104:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518811.023868:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617519104:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 14us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518811.023872:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00080000:3.0:1789518811.023881:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518811.024910:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617518976 00000100:00100000:1.0:1789518811.024919:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617518976 00000100:00100000:1.0:1789518811.024970:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:1.0:1789518811.024978:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617518976:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518811.025028:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617518976:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 51us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518811.025035:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:2.0:1789518811.025364:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617519232 00000100:00100000:2.0:1789518811.025370:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617519232 00000100:00100000:2.0:1789518811.025487:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617519360 00000100:00100000:2.0:1789518811.025490:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617519360 00000100:00080000:3.0:1789518811.025524:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518811.025527:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518811.025701:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:0.0:1789518811.025711:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617519232:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518811.025763:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617519232:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 54us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518811.025769:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:0.0:1789518811.025796:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:0.0:1789518811.025804:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617519360:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518811.025829:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617519360:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (2215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518811.025839:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 132 00010000:00010000:3.0:1789518812.028872:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518812.432728:0:44020:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518812.432740:0:44020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518812.433302:0:44020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518812.433313:0:44020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789518813.042786:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518814.014207:0:44071:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518814.014215:0:44071:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518814.014786:0:44071:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518814.014796:0:44071:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789518814.068338:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518814.322828:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627702016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518814.322895:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518814.323073:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627702016 00000100:00100000:2.0:1789518814.323091:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627702016 00000100:00100000:2.0:1789518814.323154:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789518814.323163:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627702016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518814.323194:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518814.323239:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627702016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518814.323246:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789518814.323288:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627702016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789518814.323500:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518814.837457:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627702272:0@lo:400:kworker.0 00000100:00100000:2.0:1789518814.837527:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518814.837587:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518814.837593:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627702400:0@lo:400:kworker.0 00000100:00100000:2.0:1789518814.837651:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518814.837699:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627702272 00000100:00100000:2.0:1789518814.837706:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627702272 00000100:00100000:2.0:1789518814.837758:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789518814.837767:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627702272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518814.837817:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627702272:12345-0@lo:400:kworker.0 Request processed in 52us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518814.837824:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789518814.837847:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627702400 00000100:00100000:2.0:1789518814.837851:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627702400 00000100:00100000:2.0:1789518814.837877:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789518814.837884:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627702400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518814.837917:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc6389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627702400:12345-0@lo:400:kworker.0 Request processed in 34us (279us total) trans 0 rc 0/0 00000100:00080000:0.0:1789518814.838102:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518814.838147:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789518814.838169:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627702784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518814.838197:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518814.838240:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627702400:0@lo:400:kworker.0 00000100:00100000:2.0:1789518814.838251:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627702272:0@lo:400:kworker.0 00000100:00100000:0.0:1789518814.838322:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627702784 00000100:00100000:0.0:1789518814.838327:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627702784 00000100:00100000:0.0:1789518814.838361:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789518814.838369:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec525f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627702784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518814.838393:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518814.838434:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec525f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627702784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518814.838440:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789518814.838469:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627702784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518814.838661:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627702528:0@lo:400:kworker.0 00000100:00100000:1.0:1789518814.838704:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518814.838729:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789518814.838735:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627702144:0@lo:400:kworker.0 00000100:00100000:1.0:1789518814.838764:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518814.838783:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627702656:0@lo:400:kworker.0 00000100:00100000:1.0:1789518814.838803:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518814.838829:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627702528 00000100:00100000:1.0:1789518814.838832:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627702528 00000100:00100000:1.0:1789518814.838862:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789518814.838869:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec201b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627702528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518814.838904:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec201b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627702528:12345-0@lo:400:kworker.0 Request processed in 36us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518814.838911:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789518814.839101:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627702144 00000100:00100000:3.0:1789518814.839106:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627702144 00000100:00100000:1.0:1789518814.839137:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627702656 00000100:00100000:1.0:1789518814.839141:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627702656 00000100:00100000:2.0:1789518814.839229:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789518814.839237:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627702656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518814.839270:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627702656:12345-0@lo:400:kworker.0 Request processed in 34us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518814.839276:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1789518814.839292:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518814.844406:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627702656:0@lo:400:kworker.0 00000100:00100000:0.0:1789518814.844425:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627702528:0@lo:400:kworker.0 00000100:00100000:3.0:1789518814.847141:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789518814.847161:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627702144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518814.847259:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627702144:12345-0@lo:400:kworker.0 Request processed in 107us (8493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518814.847266:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789518814.847915:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627702144:0@lo:400:kworker.0 00010000:00010000:3.0:1789518815.091544:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518815.684074:0:44122:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518815.684083:0:44122:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518815.686270:0:44122:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518815.686286:0:44122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789518816.114766:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518816.143458:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518816.143706:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617519616 00000100:00100000:3.0:1789518816.143716:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518816.143716:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617519616 00000100:00100000:3.0:1789518816.143739:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518816.143768:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617519872 00000100:00100000:0.0:1789518816.143775:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617519872 00000100:00100000:3.0:1789518816.143779:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518816.143840:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:0.0:1789518816.143850:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617519872:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518816.143933:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617519872:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518816.143942:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:0.0:1789518816.143994:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617520128 00000100:00100000:0.0:1789518816.143998:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617520128 00000100:00100000:0.0:1789518816.144023:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617519744 00000100:00100000:0.0:1789518816.144026:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617519744 00000100:00100000:0.0:1789518816.144047:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:0.0:1789518816.144053:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617520128:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518816.144083:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617520128:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518816.144089:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:0.0:1789518816.144101:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00100000:0.0:1789518816.144107:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617519744:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518816.144129:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617519744:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518816.144135:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 200 00000100:00080000:0.0:1789518816.144164:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518816.144168:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518816.144347:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518816.145662:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:2.0:1789518816.145672:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617519616:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518816.145734:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617519616:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518816.145741:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 195 00000100:00100000:1.0:1789518816.146060:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617520000 00000100:00100000:1.0:1789518816.146194:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617520000 00000100:00100000:1.0:1789518816.146310:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00080000:0.0:1789518816.146374:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518816.146546:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617520000:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518816.146595:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617520000:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 277us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518816.146603:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00010000:00010000:0.0:1789518817.138993:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518817.359251:0:44174:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518817.359259:0:44174:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518817.359859:0:44174:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518817.359868:0:44174:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1789518817.970880:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518817.970889:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518817.971486:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518817.971498:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518818.162920:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518818.992792:0:44225:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518818.992804:0:44225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518818.993926:0:44225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518818.993939:0:44225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789518819.186777:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518819.442954:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627702912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518819.443018:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518819.445552:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627702912 00000100:00100000:3.0:1789518819.445563:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627702912 00000100:00100000:3.0:1789518819.445714:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789518819.445724:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627702912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518819.445762:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518819.445839:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627702912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518819.445846:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789518819.447483:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627702912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518819.449139:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518819.954884:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627703168:0@lo:400:kworker.0 00000100:00100000:3.0:1789518819.954958:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518819.954974:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627703424:0@lo:400:kworker.0 00000100:00100000:1.0:1789518819.955016:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518819.955024:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627703680:0@lo:400:kworker.0 00000100:00100000:1.0:1789518819.955043:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518819.955051:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec4a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627703296:0@lo:400:kworker.0 00000100:00100000:3.0:1789518819.955058:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518819.955086:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789518819.955087:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518819.955097:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627703040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518819.955124:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627703424 00000100:00100000:3.0:1789518819.955129:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518819.955133:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627703424 00000100:00100000:3.0:1789518819.955153:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627703552:0@lo:400:kworker.0 00000100:00100000:1.0:1789518819.955179:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627703680 00000100:00100000:1.0:1789518819.955184:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627703680 00000100:00100000:3.0:1789518819.955194:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518819.955220:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627703552 00000100:00100000:1.0:1789518819.955224:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627703552 00000100:00100000:3.0:1789518819.955229:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627703168 00000100:00100000:3.0:1789518819.955235:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627703168 00000100:00100000:1.0:1789518819.955250:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789518819.955261:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627703424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518819.955268:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789518819.955278:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627703168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518819.955324:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627703424:12345-0@lo:400:kworker.0 Request processed in 64us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518819.955331:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627703168:12345-0@lo:400:kworker.0 Request processed in 53us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518819.955335:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789518819.955345:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789518819.955357:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789518819.955365:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627703680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518819.955394:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627703680:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518819.955396:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789518819.955406:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789518819.955412:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627703552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518819.955427:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627703296 00000100:00100000:1.0:1789518819.955432:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627703296 00000100:00100000:3.0:1789518819.955453:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627703552:12345-0@lo:400:kworker.0 Request processed in 45us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518819.955461:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789518819.955467:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789518819.955477:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627703296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518819.955486:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627703040 00000100:00100000:3.0:1789518819.955492:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627703040 00000100:00100000:1.0:1789518819.955515:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1876445627703296:12345-0@lo:400:kworker.0 Request processed in 40us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518819.955524:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789518819.955525:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789518819.955538:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627703040:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789518819.955558:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518819.955564:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:3.0:1789518819.955567:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518819.955588:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627703296:0@lo:400:kworker.0 00000100:00100000:1.0:1789518819.955603:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627703424:0@lo:400:kworker.0 00000100:00100000:3.0:1789518819.955610:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627703040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518819.955657:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789518819.955845:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627703040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518819.955855:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627703552:0@lo:400:kworker.0 00000100:00100000:1.0:1789518819.955862:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627703680:0@lo:400:kworker.0 00000100:00100000:1.0:1789518819.955936:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec4a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627703168:0@lo:400:kworker.0 00010000:00010000:2.0:1789518820.212036:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518820.680023:0:44276:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518820.680034:0:44276:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518820.680601:0:44276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518820.680640:0:44276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518821.238603:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518821.263095:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518821.263145:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518821.263185:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518821.263224:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518821.263255:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518821.263286:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617520640 00000100:00100000:0.0:1789518821.263296:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617520640 00000100:00100000:0.0:1789518821.263351:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617520512 00000100:00100000:0.0:1789518821.263355:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617520512 00000100:00100000:0.0:1789518821.263379:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:0.0:1789518821.263388:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617520640:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518821.263456:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617520640:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518821.263464:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:0.0:1789518821.263481:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:0.0:1789518821.263488:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617520512:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518821.263514:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617520512:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518821.263521:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:0.0:1789518821.263541:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617520384 00000100:00100000:0.0:1789518821.263544:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617520384 00000100:00100000:0.0:1789518821.263569:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617520768 00000100:00100000:0.0:1789518821.263572:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617520768 00000100:00100000:0.0:1789518821.263591:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:0.0:1789518821.263597:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617520384:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518821.263686:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617520384:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 88us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518821.263692:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 204 00000100:00100000:0.0:1789518821.263706:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:0.0:1789518821.263712:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617520768:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518821.263736:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617520768:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518821.263742:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00080000:0.0:1789518821.263759:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518821.263763:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518821.263765:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518821.263935:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617520256 00000100:00100000:3.0:1789518821.263940:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617520256 00000100:00100000:3.0:1789518821.263976:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:3.0:1789518821.263983:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617520256:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518821.264016:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617520256:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518821.264022:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 197 00010000:00010000:1.0:1789518822.258747:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518822.297740:0:44327:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518822.297748:0:44327:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518822.298274:0:44327:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518822.298283:0:44327:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518823.283108:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518823.985760:0:44379:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518823.985771:0:44379:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518823.986321:0:44379:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518823.986329:0:44379:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518824.308253:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518824.564848:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627703808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518824.564990:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518824.565288:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627703808 00000100:00100000:3.0:1789518824.565296:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627703808 00000100:00100000:3.0:1789518824.565374:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789518824.565384:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627703808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518824.565416:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00080000:1.0:1789518824.565520:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518824.565730:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627703808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 347us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518824.565737:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789518824.565827:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627703808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518825.074966:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627704064:0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075041:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518825.075092:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627704576:0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075120:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518825.075156:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789518825.075162:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627704192:0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075187:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518825.075206:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627704704:0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075229:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518825.075271:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627704064 00000100:00100000:0.0:1789518825.075278:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627704064 00000100:00100000:0.0:1789518825.075317:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789518825.075326:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627704064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075371:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627704064:12345-0@lo:400:kworker.0 Request processed in 47us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518825.075378:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789518825.075409:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627704192 00000100:00100000:0.0:1789518825.075413:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627704192 00000100:00100000:0.0:1789518825.075438:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789518825.075444:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627704192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075475:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627704192:12345-0@lo:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518825.075480:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789518825.075497:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627704576 00000100:00100000:0.0:1789518825.075500:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627704576 00000100:00100000:0.0:1789518825.075530:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627704704 00000100:00100000:0.0:1789518825.075533:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627704704 00000100:00100000:0.0:1789518825.075553:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789518825.075559:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627704576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075604:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627704576:12345-0@lo:400:kworker.0 Request processed in 45us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518825.075611:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789518825.075651:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789518825.075658:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627704704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075687:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627704704:12345-0@lo:400:kworker.0 Request processed in 30us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518825.075693:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1789518825.075718:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518825.075747:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627704192:0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075758:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627704704:0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075766:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627704064:0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.075775:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627704576:0@lo:400:kworker.0 00000100:00100000:3.0:1789518825.076002:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627704320:0@lo:400:kworker.0 00000100:00100000:3.0:1789518825.076057:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518825.076087:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789518825.076093:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec48d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627703936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518825.076118:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518825.076148:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627704448:0@lo:400:kworker.0 00000100:00100000:3.0:1789518825.076170:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518825.076204:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627703936 00000100:00100000:3.0:1789518825.076208:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627703936 00000100:00100000:3.0:1789518825.076333:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789518825.076345:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627703936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518825.076373:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518825.076767:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627703936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 425us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518825.076775:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1789518825.076796:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518825.076822:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec48d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627703936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518825.076855:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627704448 00000100:00100000:3.0:1789518825.076858:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627704448 00000100:00100000:3.0:1789518825.076880:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789518825.076886:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627704448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518825.076922:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627704448:12345-0@lo:400:kworker.0 Request processed in 36us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518825.076928:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789518825.076950:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627704448:0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.078450:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627704320 00000100:00100000:0.0:1789518825.078460:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627704320 00000100:00100000:0.0:1789518825.078500:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789518825.078508:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627704320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518825.078602:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627704320:12345-0@lo:400:kworker.0 Request processed in 79us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518825.078609:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789518825.078735:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627704320:0@lo:400:kworker.0 00010000:00010000:3.0:1789518825.332738:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518825.636183:0:44430:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518825.636191:0:44430:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518825.636753:0:44430:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518825.636763:0:44430:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518826.355965:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518826.382012:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518826.382068:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518826.382133:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617520896 00000100:00100000:1.0:1789518826.382149:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617520896 00000100:00100000:1.0:1789518826.382218:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:1.0:1789518826.382228:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617520896:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518826.382324:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617520896:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 97us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518826.382335:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 199 00000100:00100000:0.0:1789518826.382959:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518826.383000:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518826.383030:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617521152 00000100:00100000:1.0:1789518826.383039:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617521152 00000100:00080000:3.0:1789518826.383090:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518826.383119:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:1.0:1789518826.383129:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617521152:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518826.383997:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617521152:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 864us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518826.384008:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:0.0:1789518826.389472:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518826.390317:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617521024 00000100:00100000:2.0:1789518826.390331:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617521024 00000100:00080000:0.0:1789518826.391304:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518826.391311:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617521408 00000100:00100000:1.0:1789518826.391323:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617521408 00000100:00100000:2.0:1789518826.391342:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:2.0:1789518826.391357:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617521024:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:0.0:1789518826.391357:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518826.391387:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:1.0:1789518826.391398:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617521408:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518826.391553:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617521408:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 157us (8551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518826.391561:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 210 00000100:00100000:3.0:1789518826.392137:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617521280 00000100:00100000:3.0:1789518826.392147:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617521280 00000100:00100000:3.0:1789518826.392197:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:3.0:1789518826.392208:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617521280:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:1.0:1789518826.392298:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518826.397047:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617521024:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 5675us (14957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518826.397068:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:3.0:1789518826.401920:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617521280:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 9701us (12449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518826.401938:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 142 00000040:00080000:2.0:1789518827.188798:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518827.188808:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518827.189606:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518827.189673:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:3.0:1789518827.228216:0:44481:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518827.228224:0:44481:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518827.228784:0:44481:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518827.228795:0:44481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518827.379745:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518828.402805:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518828.778709:0:44532:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518828.778718:0:44532:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518828.779240:0:44532:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518828.779249:0:44532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518829.427006:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518829.682866:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518829.682901:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627704832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518829.682995:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518829.683121:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627704832 00000100:00100000:3.0:1789518829.683132:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627704832 00000100:00080000:1.0:1789518829.683259:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518829.683304:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789518829.683316:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627704832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518829.683364:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518829.683439:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627704832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518829.683446:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789518829.683527:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627704832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518830.196074:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627704960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518830.196162:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518830.196241:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627704960 00000100:00100000:3.0:1789518830.196248:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627704960 00000100:00100000:3.0:1789518830.196308:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789518830.196319:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627704960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518830.196358:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518830.196556:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627704960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 238us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518830.196572:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789518830.196596:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518830.196653:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627704960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518830.197058:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627705344:0@lo:400:kworker.0 00000100:00100000:2.0:1789518830.197096:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518830.197189:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518830.197196:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627705472:0@lo:400:kworker.0 00000100:00100000:2.0:1789518830.197227:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518830.197291:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627705088:0@lo:400:kworker.0 00000100:00100000:3.0:1789518830.197325:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518830.197356:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627705600:0@lo:400:kworker.0 00000100:00100000:3.0:1789518830.197381:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518830.197476:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627705088 00000100:00100000:3.0:1789518830.197559:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518830.197580:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627705216:0@lo:400:kworker.0 00000100:00100000:3.0:1789518830.197610:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518830.197663:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627705216 00000100:00100000:3.0:1789518830.197668:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627705216 00000100:00100000:3.0:1789518830.197704:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789518830.197713:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627705216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518830.197755:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627705216:12345-0@lo:400:kworker.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518830.197762:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789518830.197795:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd1008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627705216:0@lo:400:kworker.0 00000100:00100000:2.0:1789518830.197851:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627705088 00000100:00100000:2.0:1789518830.197891:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789518830.197898:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627705088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518830.197937:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627705088:12345-0@lo:400:kworker.0 Request processed in 40us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518830.197943:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789518830.197973:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627705088:0@lo:400:kworker.0 00000100:00100000:0.0:1789518830.198040:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627705344 00000100:00100000:0.0:1789518830.198045:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627705344 00000100:00100000:0.0:1789518830.198080:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627705472 00000100:00100000:0.0:1789518830.198083:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627705472 00000100:00100000:0.0:1789518830.198109:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627705600 00000100:00100000:0.0:1789518830.198111:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627705600 00000100:00100000:2.0:1789518830.198198:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789518830.198207:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627705344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518830.198251:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fffc5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627705344:12345-0@lo:400:kworker.0 Request processed in 45us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518830.198258:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789518830.198273:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789518830.198280:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627705472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518830.198308:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627705472:12345-0@lo:400:kworker.0 Request processed in 29us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518830.198314:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789518830.198340:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627705472:0@lo:400:kworker.0 00000100:00100000:2.0:1789518830.198354:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627705344:0@lo:400:kworker.0 00000100:00100000:0.0:1789518830.198580:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789518830.198588:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627705600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518830.198654:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627705600:12345-0@lo:400:kworker.0 Request processed in 66us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518830.198660:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:0.0:1789518830.198684:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518830.199831:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627705600:0@lo:400:kworker.0 00000040:00080000:2.0:1789518830.402269:0:44584:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518830.402278:0:44584:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518830.403295:0:44584:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518830.403307:0:44584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789518830.452307:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518831.479577:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518831.506333:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518831.506386:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518831.506417:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518831.506443:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617521536 00000100:00100000:0.0:1789518831.506453:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617521536 00000100:00100000:0.0:1789518831.506497:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:0.0:1789518831.506505:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617521536:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518831.506573:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617521536:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518831.506580:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 201 00000100:00100000:1.0:1789518831.506698:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617521664 00000100:00100000:1.0:1789518831.506702:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617521664 00000100:00100000:1.0:1789518831.506752:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 214 00000100:00100000:1.0:1789518831.506760:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617521664:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518831.506792:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617521664:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518831.506799:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 214 00000100:00100000:1.0:1789518831.506818:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617521920 00000100:00100000:1.0:1789518831.506821:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617521920 00000100:00100000:1.0:1789518831.506846:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:1.0:1789518831.506852:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617521920:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518831.506890:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617521920:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518831.506897:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00080000:0.0:1789518831.507441:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518831.507446:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518831.517596:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518831.517645:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518831.517671:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617521792 00000100:00100000:2.0:1789518831.517679:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617521792 00000100:00100000:2.0:1789518831.517729:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:2.0:1789518831.517738:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617521792:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518831.517799:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617521792:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518831.517806:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:2.0:1789518831.517827:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617522048 00000100:00100000:2.0:1789518831.517830:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617522048 00000100:00100000:2.0:1789518831.517870:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:2.0:1789518831.517877:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617522048:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518831.517905:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617522048:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518831.517911:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00080000:2.0:1789518831.517931:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789518831.517935:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789518831.976854:0:44635:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518831.976863:0:44635:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518831.977457:0:44635:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518831.977467:0:44635:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518832.498899:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518833.523033:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518833.624464:0:44686:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518833.624476:0:44686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518833.625269:0:44686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518833.625282:0:44686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518834.548854:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518834.803869:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518834.804016:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627705728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518834.804109:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518834.804261:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627705728 00000100:00100000:0.0:1789518834.804271:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627705728 00000100:00100000:0.0:1789518834.804452:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789518834.804463:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb2a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627705728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518834.804505:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518834.804572:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb2a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627705728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518834.804579:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789518834.804659:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627705728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518834.804685:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789518835.197275:0:44737:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518835.197287:0:44737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518835.197975:0:44737:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518835.197988:0:44737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518835.314954:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627705856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518835.315047:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518835.315116:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627705984:0@lo:400:kworker.0 00000100:00100000:3.0:1789518835.315130:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627706368:0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.315563:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518835.315577:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518835.315600:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627706496:0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.315656:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518835.315712:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627706368 00000100:00100000:3.0:1789518835.315721:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627706368 00000100:00100000:0.0:1789518835.315762:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627706112:0@lo:400:kworker.0 00000100:00100000:3.0:1789518835.315774:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627706496 00000100:00100000:3.0:1789518835.315779:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627706496 00000100:00100000:0.0:1789518835.315797:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518835.315822:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789518835.315826:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627706624:0@lo:400:kworker.0 00000100:00100000:3.0:1789518835.315841:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627706368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.315854:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518835.315876:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789518835.315883:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627706240:0@lo:400:kworker.0 00000100:00080000:2.0:1789518835.315893:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518835.315909:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627706624 00000100:00100000:0.0:1789518835.315913:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518835.315914:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627706624 00000100:00100000:3.0:1789518835.315918:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627706368:12345-0@lo:400:kworker.0 Request processed in 79us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518835.315928:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789518835.315947:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789518835.315955:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627706496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.315956:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627705856 00000100:00100000:3.0:1789518835.315958:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789518835.315961:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627705856 00000100:00100000:0.0:1789518835.315991:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789518835.315996:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627706496:12345-0@lo:400:kworker.0 Request processed in 44us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518835.315998:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627705856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518835.316030:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518835.316044:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627706624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.316071:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627705856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518835.316079:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789518835.316097:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627706624:12345-0@lo:400:kworker.0 Request processed in 56us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518835.316105:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789518835.316106:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627705984 00000100:00100000:0.0:1789518835.316109:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627705984 00000100:00080000:2.0:1789518835.316122:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518835.316125:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518835.316134:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789518835.316139:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627705984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518835.316154:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627706496:0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.316168:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627705984:12345-0@lo:400:kworker.0 Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518835.316171:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627705984:0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.316174:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789518835.316202:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627706112 00000100:00100000:0.0:1789518835.316206:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627706112 00000100:00100000:0.0:1789518835.316228:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627706240 00000100:00100000:0.0:1789518835.316230:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627706240 00000100:00100000:2.0:1789518835.316239:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789518835.316247:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627706112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.316258:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789518835.316264:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627706240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518835.316274:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789518835.316316:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627706368:0@lo:400:kworker.0 00000100:00100000:3.0:1789518835.316333:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627705856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518835.316362:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627706240:12345-0@lo:400:kworker.0 Request processed in 97us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518835.316370:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789518835.316371:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627706112:12345-0@lo:400:kworker.0 Request processed in 126us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518835.316378:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789518835.316411:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627706240:0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.316420:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627706112:0@lo:400:kworker.0 00000100:00100000:0.0:1789518835.316428:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627706624:0@lo:400:kworker.0 00010000:00010000:2.0:1789518835.570916:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518836.595487:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518836.622920:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518836.622961:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518836.622993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518836.623013:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518836.623032:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518836.623059:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617522560 00000100:00100000:1.0:1789518836.623068:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617522560 00000100:00100000:1.0:1789518836.623123:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617522432 00000100:00100000:1.0:1789518836.623126:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617522432 00000100:00100000:1.0:1789518836.623148:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:1.0:1789518836.623157:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617522560:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518836.623217:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617522560:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518836.623224:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:1.0:1789518836.623239:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:1.0:1789518836.623245:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617522432:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518836.623267:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617522432:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 22us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518836.623272:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 149 00000100:00100000:1.0:1789518836.623288:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617522304 00000100:00100000:1.0:1789518836.623291:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617522304 00000100:00100000:1.0:1789518836.623310:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617522688 00000100:00100000:1.0:1789518836.623312:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617522688 00000100:00100000:1.0:1789518836.623326:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:1.0:1789518836.623331:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617522304:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518836.623355:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617522304:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518836.623361:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:1.0:1789518836.623371:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00100000:1.0:1789518836.623376:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617522688:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518836.623394:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617522688:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 18us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518836.623399:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 220 00000100:00080000:1.0:1789518836.623412:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518836.623416:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518836.623418:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518836.623721:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617522176 00000100:00100000:3.0:1789518836.623726:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617522176 00000100:00100000:3.0:1789518836.623767:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 203 00000100:00100000:3.0:1789518836.623774:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617522176:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518836.623806:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617522176:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518836.623812:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 203 00000040:00080000:3.0:1789518836.704552:0:44788:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518836.704562:0:44788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518836.705114:0:44788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518836.705123:0:44788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1789518837.426854:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518837.426864:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518837.429651:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518837.429671:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518837.619399:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518838.250243:0:44840:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518838.250251:0:44840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518838.252232:0:44840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518838.252248:0:44840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518838.642902:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518839.666877:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518839.852698:0:44891:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518839.852707:0:44891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518839.853486:0:44891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518839.853495:0:44891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518839.929778:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518839.929800:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627706752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518839.929867:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518839.929929:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627706752 00000100:00100000:2.0:1789518839.929937:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627706752 00000100:00100000:2.0:1789518839.929988:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789518839.929998:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627706752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518839.930029:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518839.930073:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627706752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518839.930080:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1789518839.930101:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518839.930134:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627706752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518840.434895:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627706880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518840.434962:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518840.435058:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627707008:0@lo:400:kworker.0 00000100:00100000:0.0:1789518840.435099:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627706880 00000100:00100000:3.0:1789518840.435105:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518840.435108:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627706880 00000100:00100000:3.0:1789518840.435163:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627707008 00000100:00100000:3.0:1789518840.435168:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627707008 00000100:00100000:0.0:1789518840.435169:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789518840.435180:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627706880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518840.435207:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00002000:00000024:0.0:1789518840.435212:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518840.435218:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627707008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518840.435270:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627707008:12345-0@lo:400:kworker.0 Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518840.435289:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789518840.435336:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627707008:0@lo:400:kworker.0 00000100:00080000:3.0:1789518840.435362:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518840.438210:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec4a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627706880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3025us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518840.438223:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789518840.438853:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627707136:0@lo:400:kworker.0 00000100:00100000:3.0:1789518840.438908:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518840.439000:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627707136 00000100:00100000:0.0:1789518840.439006:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627707136 00000100:00100000:0.0:1789518840.439041:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789518840.440078:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627707136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518840.440660:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627706880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518840.440720:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627707264:0@lo:400:kworker.0 00000100:00100000:1.0:1789518840.440755:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518840.440797:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627707264 00000100:00100000:1.0:1789518840.440802:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627707264 00000100:00100000:1.0:1789518840.440834:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789518840.440840:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627707264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518840.440876:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627707264:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518840.440882:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789518840.440914:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627707264:0@lo:400:kworker.0 00000100:00100000:0.0:1789518840.441249:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627707136:12345-0@lo:400:kworker.0 Request processed in 1177us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518840.441256:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789518840.444428:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518840.444594:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627707520:0@lo:400:kworker.0 00000100:00100000:3.0:1789518840.444708:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff79ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627707136:0@lo:400:kworker.0 00000100:00100000:0.0:1789518840.444815:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518840.444847:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627707392:0@lo:400:kworker.0 00000100:00100000:0.0:1789518840.444866:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518840.445137:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627707520 00000100:00100000:1.0:1789518840.445144:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627707520 00000100:00100000:1.0:1789518840.445242:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627707392 00000100:00100000:1.0:1789518840.445246:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627707392 00000100:00100000:1.0:1789518840.445270:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789518840.445278:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627707520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518840.445327:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627707520:12345-0@lo:400:kworker.0 Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518840.445333:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789518840.445348:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789518840.445355:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627707392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518840.445382:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627707392:12345-0@lo:400:kworker.0 Request processed in 28us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518840.445388:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789518840.445416:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627707520:0@lo:400:kworker.0 00000100:00100000:1.0:1789518840.445425:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627707392:0@lo:400:kworker.0 00000100:00080000:2.0:1789518840.445489:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518840.691503:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518841.332525:0:44942:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518841.332533:0:44942:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518841.333074:0:44942:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518841.333083:0:44942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518841.714913:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518841.741185:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518841.741223:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518841.741269:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518841.741295:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617522816 00000100:00100000:1.0:1789518841.741318:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617522816 00000100:00100000:3.0:1789518841.741375:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518841.741406:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:1.0:1789518841.741425:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc5620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617522816:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518841.741427:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617523072 00000100:00100000:0.0:1789518841.741435:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617523072 00000100:00100000:0.0:1789518841.741484:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00100000:0.0:1789518841.741491:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617523072:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518841.741551:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc5620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617522816:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 132us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518841.741561:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 205 00000100:00100000:0.0:1789518841.741572:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617523072:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 78us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518841.741580:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 151 00000100:00080000:0.0:1789518841.741669:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518841.741912:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518841.741993:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617523200 00000100:00100000:0.0:1789518841.741998:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617523200 00000100:00100000:0.0:1789518841.742039:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00100000:0.0:1789518841.742046:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617523200:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518841.742084:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617523200:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 38us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518841.742090:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 152 00000100:00080000:3.0:1789518841.742204:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518841.742249:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617523328 00000100:00100000:2.0:1789518841.742254:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617523328 00000100:00100000:2.0:1789518841.742308:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617522944 00000100:00100000:2.0:1789518841.742311:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617522944 00000100:00100000:2.0:1789518841.742379:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:2.0:1789518841.742386:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617523328:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518841.742426:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617523328:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518841.742432:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 224 00000100:00100000:2.0:1789518841.742448:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:2.0:1789518841.742454:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617522944:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518841.742480:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617522944:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518841.742486:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00080000:3.0:1789518841.742645:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518842.739170:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518842.830301:0:44993:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518842.830309:0:44993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518842.830862:0:44993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518842.830870:0:44993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518843.763023:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518844.405828:0:45044:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518844.405846:0:45044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518844.406367:0:45044:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518844.406375:0:45044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518844.787686:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518845.042867:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627707648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518845.042934:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518845.043067:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627707648 00000100:00100000:2.0:1789518845.043074:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627707648 00000100:00100000:2.0:1789518845.043144:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789518845.043154:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627707648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518845.043235:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518845.043291:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627707648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518845.043302:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1789518845.043360:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518845.043507:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627707648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518845.556047:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518845.556071:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627707776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518845.556150:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518845.556220:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627707776 00000100:00100000:2.0:1789518845.556227:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627707776 00000100:00100000:2.0:1789518845.556281:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789518845.556289:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627707776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518845.556328:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518845.556376:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627707776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518845.556383:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1789518845.556412:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518845.556450:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec28ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627707776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518845.556873:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627708160:0@lo:400:kworker.0 00000100:00100000:2.0:1789518845.556941:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518845.556964:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518845.556969:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627708288:0@lo:400:kworker.0 00000100:00100000:2.0:1789518845.556992:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518845.557016:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627708160 00000100:00100000:2.0:1789518845.557021:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627708160 00000100:00100000:2.0:1789518845.557123:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627708288 00000100:00100000:2.0:1789518845.557127:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627708288 00000100:00100000:2.0:1789518845.557149:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789518845.557155:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627708160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518845.557196:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627708160:12345-0@lo:400:kworker.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518845.557203:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789518845.557230:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789518845.557236:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627708288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518845.557265:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627708288:12345-0@lo:400:kworker.0 Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518845.557271:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:2.0:1789518845.557291:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518845.557311:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627708288:0@lo:400:kworker.0 00000100:00100000:2.0:1789518845.557320:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627708160:0@lo:400:kworker.0 00000100:00100000:0.0:1789518845.557396:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627707904:0@lo:400:kworker.0 00000100:00100000:0.0:1789518845.557429:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518845.557461:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518845.557467:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627708032:0@lo:400:kworker.0 00000100:00100000:0.0:1789518845.557501:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518845.557527:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627708032 00000100:00100000:0.0:1789518845.557531:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627708032 00000100:00100000:0.0:1789518845.557553:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789518845.557559:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627708032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518845.557594:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627708032:12345-0@lo:400:kworker.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518845.557599:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789518845.557642:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627708032:0@lo:400:kworker.0 00000100:00100000:2.0:1789518845.557808:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627707904 00000100:00100000:2.0:1789518845.557812:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627707904 00000100:00100000:2.0:1789518845.558116:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789518845.558124:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627707904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518845.558165:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627707904:12345-0@lo:400:kworker.0 Request processed in 42us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518845.558171:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789518845.558302:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627707904:0@lo:400:kworker.0 00010000:00010000:3.0:1789518845.811507:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518845.923276:0:45096:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518845.923284:0:45096:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518845.924007:0:45096:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518845.924017:0:45096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518846.835634:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518846.864214:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518846.864261:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518846.864307:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518846.864336:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617523840 00000100:00100000:3.0:1789518846.864345:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518846.864348:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617523840 00000100:00100000:3.0:1789518846.864381:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518846.864411:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617523712 00000100:00100000:0.0:1789518846.864415:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617523712 00000100:00100000:0.0:1789518846.864439:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:0.0:1789518846.864449:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617523840:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518846.864456:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617523584 00000100:00100000:3.0:1789518846.864461:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617523584 00000100:00100000:1.0:1789518846.864506:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617523456 00000100:00100000:3.0:1789518846.864511:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617523968 00000100:00100000:1.0:1789518846.864514:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617523456 00000100:00100000:3.0:1789518846.864518:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617523968 00000100:00100000:1.0:1789518846.864554:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:3.0:1789518846.864559:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:1.0:1789518846.864566:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617523456:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518846.864575:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617523584:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518846.864649:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617523456:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 85us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518846.864654:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:1.0:1789518846.864656:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 207 00000100:00100000:2.0:1789518846.864664:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617523968:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518846.864720:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 154 00000100:00100000:1.0:1789518846.864728:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617523712:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518846.865241:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617523584:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 670us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518846.865249:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00080000:3.0:1789518846.865290:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518846.865294:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518846.865297:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518846.867591:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617523968:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 2917us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518846.867591:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617523840:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 3132us (3318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518846.867627:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 230 00000100:00100000:0.0:1789518846.867632:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 153 00000100:00100000:1.0:1789518846.869308:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617523712:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 4572us (4953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518846.869320:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 154 00000040:00080000:2.0:1789518847.515225:0:45149:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518847.515234:0:45149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518847.515867:0:45149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518847.515878:0:45149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1789518847.666925:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518847.666935:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518847.668925:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518847.668942:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518847.858837:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518848.882816:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518849.000950:0:45200:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518849.000961:0:45200:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518849.001872:0:45200:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518849.001883:0:45200:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518849.907138:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518850.165210:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789518850.165235:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627708416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518850.166835:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518850.168460:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627708416 00000100:00100000:0.0:1789518850.168482:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627708416 00000100:00100000:0.0:1789518850.168561:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1789518850.168571:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518850.168574:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627708416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518850.168627:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518850.168699:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627708416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518850.168706:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789518850.168790:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627708416:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789518850.538021:0:45251:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518850.538030:0:45251:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518850.538567:0:45251:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518850.538576:0:45251:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518850.675062:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518850.675084:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627708544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518850.675148:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518850.675319:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627708544 00000100:00100000:2.0:1789518850.675326:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627708544 00000100:00100000:2.0:1789518850.675387:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789518850.675396:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627708544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518850.675446:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518850.675511:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627708544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518850.675519:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789518850.675574:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627708544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518850.675927:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627708672:0@lo:400:kworker.0 00000100:00100000:2.0:1789518850.675963:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518850.675997:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518850.676004:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627708800:0@lo:400:kworker.0 00000100:00100000:2.0:1789518850.676029:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518850.676069:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627708800 00000100:00100000:2.0:1789518850.676074:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627708800 00000100:00100000:2.0:1789518850.676101:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789518850.676108:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627708800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518850.676143:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627708800:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518850.676149:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789518850.676175:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627708800:0@lo:400:kworker.0 00000100:00100000:1.0:1789518850.676284:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627708672 00000100:00100000:1.0:1789518850.676289:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627708672 00000100:00100000:1.0:1789518850.676342:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789518850.676350:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627708672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518850.676390:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627708672:12345-0@lo:400:kworker.0 Request processed in 41us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518850.676396:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1789518850.676480:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518850.676517:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627709056:0@lo:400:kworker.0 00000100:00100000:3.0:1789518850.676553:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518850.676588:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518850.676595:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffd03d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627708928:0@lo:400:kworker.0 00000100:00100000:3.0:1789518850.676635:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518850.676714:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627709056 00000100:00100000:1.0:1789518850.676719:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627709056 00000100:00100000:1.0:1789518850.676753:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627708928 00000100:00100000:1.0:1789518850.676756:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627708928 00000100:00100000:1.0:1789518850.676778:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789518850.676785:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627709056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518850.676796:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789518850.676808:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627708928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518850.676823:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff79ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627709056:12345-0@lo:400:kworker.0 Request processed in 37us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518850.676831:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789518850.676854:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627708928:12345-0@lo:400:kworker.0 Request processed in 49us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518850.676862:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:3.0:1789518850.676890:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518850.676911:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffd03d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627708928:0@lo:400:kworker.0 00000100:00100000:3.0:1789518850.676924:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627709056:0@lo:400:kworker.0 00000100:00100000:2.0:1789518850.676949:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627708672:0@lo:400:kworker.0 00010000:00010000:2.0:1789518850.930930:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518851.955416:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518851.981930:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518851.982023:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518851.982059:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518851.982114:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518851.982143:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518851.982183:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617524480 00000100:00100000:1.0:1789518851.982192:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617524480 00000100:00100000:3.0:1789518851.982255:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617524096 00000100:00100000:3.0:1789518851.982259:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617524096 00000100:00100000:3.0:1789518851.982296:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:3.0:1789518851.982305:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617524096:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518851.982371:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617524096:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518851.982379:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 209 00000100:00100000:3.0:1789518851.982410:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617524352 00000100:00100000:3.0:1789518851.982413:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617524352 00000100:00100000:0.0:1789518851.982443:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617524224 00000100:00100000:0.0:1789518851.982447:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617524224 00000100:00100000:0.0:1789518851.982485:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617524608 00000100:00100000:0.0:1789518851.982489:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617524608 00000100:00100000:0.0:1789518851.982511:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:0.0:1789518851.982518:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617524224:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518851.982550:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd1008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617524224:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518851.982557:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 234 00000100:00100000:0.0:1789518851.982572:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:0.0:1789518851.982578:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617524608:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518851.982602:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617524608:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518851.982608:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:3.0:1789518851.982747:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:3.0:1789518851.982754:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617524480:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518851.982780:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617524480:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518851.982787:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 155 00000100:00100000:3.0:1789518851.982798:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00100000:3.0:1789518851.982804:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617524352:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518851.982822:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617524352:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 19us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518851.982827:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 156 00000100:00080000:3.0:1789518851.982840:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518851.982844:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518851.982846:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789518852.046241:0:45303:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518852.046250:0:45303:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518852.047113:0:45303:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518852.047124:0:45303:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518852.979239:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518853.602057:0:45354:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518853.602065:0:45354:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518853.602633:0:45354:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518853.602643:0:45354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518854.002884:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518855.026819:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518855.234397:0:45405:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518855.234406:0:45405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518855.237729:0:45405:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518855.237746:0:45405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1789518855.284480:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627709184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518855.284548:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518855.284782:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627709184 00000100:00100000:3.0:1789518855.284790:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627709184 00000100:00100000:3.0:1789518855.284884:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789518855.284893:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627709184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518855.284929:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518855.284980:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627709184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518855.284988:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1789518855.285363:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518855.285404:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627709184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518855.795115:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627709440:0@lo:400:kworker.0 00000100:00100000:3.0:1789518855.795176:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518855.795229:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518855.795235:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627709568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518855.795257:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518855.795293:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627709312:0@lo:400:kworker.0 00000100:00100000:3.0:1789518855.795294:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627709568 00000100:00100000:3.0:1789518855.795303:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627709568 00000100:00100000:0.0:1789518855.795339:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518855.795356:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789518855.795367:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627709568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518855.795372:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627709824:0@lo:400:kworker.0 00000100:00100000:0.0:1789518855.795403:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518855.795417:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627709440 00000100:00100000:1.0:1789518855.795423:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627709440 00000100:00100000:1.0:1789518855.795478:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789518855.795487:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627709440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518855.795514:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627709312 00000100:00100000:2.0:1789518855.795519:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627709312 00000100:00100000:2.0:1789518855.795546:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789518855.795553:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627709312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518855.796206:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627709568:12345-0@lo:400:kworker.0 Request processed in 841us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518855.796215:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789518855.796232:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627709824 00000100:00100000:3.0:1789518855.796235:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627709824 00000100:00100000:3.0:1789518855.796260:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789518855.796265:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627709824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518855.796299:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627709824:12345-0@lo:400:kworker.0 Request processed in 33us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518855.796305:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789518855.796327:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627709952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518855.796363:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518855.796402:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627709568:0@lo:400:kworker.0 00000100:00100000:3.0:1789518855.796541:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627709952 00000100:00100000:3.0:1789518855.796545:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627709952 00000100:00100000:3.0:1789518855.796569:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789518855.796574:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627709952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518855.796597:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518855.796828:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876445627709952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 252us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518855.796839:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789518855.796867:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627709952:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789518855.796915:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518855.796920:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518855.796930:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627709696:0@lo:400:kworker.0 00000100:00100000:3.0:1789518855.796956:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518855.796985:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627709696 00000100:00100000:3.0:1789518855.796989:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627709696 00000100:00100000:3.0:1789518855.797015:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789518855.797022:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627709696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518855.797055:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627709696:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518855.797061:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:3.0:1789518855.797074:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518855.797089:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627709696:0@lo:400:kworker.0 00000100:00100000:2.0:1789518855.798274:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627709312:12345-0@lo:400:kworker.0 Request processed in 2717us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518855.798287:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789518855.798290:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627709440:12345-0@lo:400:kworker.0 Request processed in 2799us (3108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518855.798302:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789518855.798337:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627709824:0@lo:400:kworker.0 00000100:00100000:0.0:1789518855.798360:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627709312:0@lo:400:kworker.0 00000100:00100000:3.0:1789518855.798396:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627709440:0@lo:400:kworker.0 00010000:00010000:3.0:1789518856.050806:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518856.779450:0:45456:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518856.779458:0:45456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518856.780606:0:45456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518856.781742:0:45456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518857.075310:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518857.102693:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518857.102749:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518857.102789:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518857.103033:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617524864 00000100:00100000:0.0:1789518857.103043:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617524864 00000100:00100000:0.0:1789518857.103107:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 239 00000100:00100000:0.0:1789518857.103117:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617524864:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518857.103183:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617524864:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 68us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518857.103191:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 239 00000100:00100000:1.0:1789518857.103268:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617524736 00000100:00100000:1.0:1789518857.103273:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617524736 00000100:00100000:1.0:1789518857.103311:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00100000:1.0:1789518857.103318:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617524736:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518857.103357:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617524736:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518857.103367:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 211 00000100:00080000:3.0:1789518857.103447:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518857.104689:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518857.105209:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518857.105324:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617525248 00000100:00100000:1.0:1789518857.105331:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617525248 00000100:00100000:1.0:1789518857.105395:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00100000:1.0:1789518857.105405:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617525248:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518857.105475:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617525248:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 71us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518857.105482:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 240 00000100:00080000:3.0:1789518857.105754:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518857.106273:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617525120 00000100:00100000:2.0:1789518857.106279:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617525120 00000100:00100000:2.0:1789518857.106381:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617524992 00000100:00100000:2.0:1789518857.106386:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617524992 00000100:00100000:0.0:1789518857.106503:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:0.0:1789518857.106513:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617525120:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518857.106555:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617525120:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 45us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518857.106562:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 158 00000100:00100000:0.0:1789518857.106576:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00100000:0.0:1789518857.106583:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617524992:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518857.106646:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617524992:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518857.106652:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 159 00000100:00080000:3.0:1789518857.106701:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789518857.106704:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1789518857.908837:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518857.908845:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518857.909357:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518857.909365:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518858.098830:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518858.351551:0:45507:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518858.351558:0:45507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518858.352272:0:45507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518858.352284:0:45507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518859.123813:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518859.889067:0:45559:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518859.889075:0:45559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518859.889789:0:45559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518859.889798:0:45559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518860.146856:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518860.405502:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627710080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518860.405580:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518860.406053:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627710080 00000100:00100000:3.0:1789518860.406061:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627710080 00000100:00080000:0.0:1789518860.406215:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518860.406365:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789518860.406376:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627710080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518860.406421:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518860.406477:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627710080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518860.406483:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789518860.406633:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627710080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518860.915606:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627710464:0@lo:400:kworker.0 00000100:00100000:1.0:1789518860.915697:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518860.915756:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518860.915763:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627710592:0@lo:400:kworker.0 00000100:00100000:1.0:1789518860.915787:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518860.915872:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fecb0e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627710208:0@lo:400:kworker.0 00000100:00100000:0.0:1789518860.915890:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627710336:0@lo:400:kworker.0 00000100:00100000:3.0:1789518860.915924:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518860.915934:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518860.916008:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627710208 00000100:00100000:1.0:1789518860.916015:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627710208 00000100:00100000:1.0:1789518860.916058:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789518860.916066:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627710208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518860.916113:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627710208:12345-0@lo:400:kworker.0 Request processed in 48us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518860.916120:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789518860.916148:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627710336 00000100:00100000:1.0:1789518860.916151:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627710336 00000100:00100000:1.0:1789518860.916185:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789518860.916191:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627710336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518860.916236:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627710336:12345-0@lo:400:kworker.0 Request processed in 45us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518860.916243:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1789518860.916313:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518860.916330:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fecb0e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627710208:0@lo:400:kworker.0 00000100:00100000:3.0:1789518860.916339:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627710720:0@lo:400:kworker.0 00000100:00100000:0.0:1789518860.916342:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627710336:0@lo:400:kworker.0 00000100:00100000:3.0:1789518860.916367:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518860.916402:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627710464 00000100:00100000:3.0:1789518860.916406:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627710464 00000100:00100000:3.0:1789518860.916444:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627710592 00000100:00100000:3.0:1789518860.916448:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627710592 00000100:00100000:3.0:1789518860.916474:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627710720 00000100:00100000:3.0:1789518860.916477:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627710720 00000100:00100000:3.0:1789518860.916492:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789518860.916499:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627710464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518860.916537:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627710464:12345-0@lo:400:kworker.0 Request processed in 39us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518860.916543:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789518860.916555:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789518860.916561:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627710592:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789518860.916579:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518860.916592:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627710592:12345-0@lo:400:kworker.0 Request processed in 31us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518860.916600:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789518860.916609:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789518860.916648:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627710720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518860.916692:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627710720:12345-0@lo:400:kworker.0 Request processed in 47us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518860.916759:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627710592:0@lo:400:kworker.0 00000100:00100000:2.0:1789518860.916772:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627710464:0@lo:400:kworker.0 00000100:00100000:2.0:1789518860.916809:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627710720:0@lo:400:kworker.0 00000100:00100000:2.0:1789518860.916817:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789518860.916823:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627710848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518860.916851:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518860.916878:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627710848 00000100:00100000:2.0:1789518860.916881:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627710848 00000100:00100000:2.0:1789518860.916909:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789518860.916916:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627710848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518860.916943:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518860.916978:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627710848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518860.916984:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789518860.917017:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627710848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518860.921972:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00010000:1.0:1789518861.171037:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518861.406124:0:45610:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518861.406137:0:45610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518861.407131:0:45610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518861.407144:0:45610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518862.194764:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518862.222589:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518862.222673:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518862.222710:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518862.222730:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518862.222753:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518862.222779:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617525632 00000100:00100000:3.0:1789518862.222788:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617525632 00000100:00100000:3.0:1789518862.222837:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617525760 00000100:00100000:3.0:1789518862.222841:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617525760 00000100:00100000:3.0:1789518862.222861:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:3.0:1789518862.222870:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617525632:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518862.222932:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617525632:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518862.222940:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:3.0:1789518862.222957:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:3.0:1789518862.222963:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617525760:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518862.222988:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617525760:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518862.222994:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:1.0:1789518862.223083:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617525888 00000100:00100000:1.0:1789518862.223087:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617525888 00000100:00100000:1.0:1789518862.223126:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617525504 00000100:00100000:1.0:1789518862.223129:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617525504 00000100:00100000:1.0:1789518862.223153:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 244 00000100:00100000:1.0:1789518862.223160:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617525888:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518862.223190:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617525888:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518862.223197:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 244 00000100:00100000:1.0:1789518862.223211:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 245 00000100:00100000:1.0:1789518862.223218:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617525504:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518862.223240:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617525504:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518862.223246:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 245 00000100:00100000:0.0:1789518862.223675:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617525376 00000100:00100000:0.0:1789518862.223680:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617525376 00000100:00100000:0.0:1789518862.223719:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00100000:0.0:1789518862.223727:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617525376:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518862.223767:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617525376:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 41us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518862.223774:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 213 00000100:00080000:0.0:1789518862.223802:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518862.223806:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518862.223808:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789518862.903357:0:45661:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518862.903367:0:45661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518862.903943:0:45661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518862.903953:0:45661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518863.218945:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789518864.242750:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518864.488236:0:45712:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518864.488244:0:45712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518864.489180:0:45712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518864.489191:0:45712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518865.266801:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518865.522890:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789518865.522914:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627710976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518865.522981:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518865.523110:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627710976 00000100:00100000:3.0:1789518865.523118:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627710976 00000100:00100000:3.0:1789518865.523186:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789518865.523196:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627710976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518865.523230:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518865.523288:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627710976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518865.523296:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789518865.523338:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627710976:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518865.523410:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789518865.977178:0:45763:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518865.977187:0:45763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518865.979042:0:45763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518865.979055:0:45763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518866.034825:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627711360:0@lo:400:kworker.0 00000100:00100000:0.0:1789518866.034901:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518866.034953:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789518866.034959:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627711232:0@lo:400:kworker.0 00000100:00100000:0.0:1789518866.034982:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518866.034997:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627711744:0@lo:400:kworker.0 00000100:00100000:0.0:1789518866.035019:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518866.035046:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627711360 00000100:00100000:0.0:1789518866.035052:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627711360 00000100:00100000:0.0:1789518866.035096:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627711232 00000100:00100000:0.0:1789518866.035099:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627711232 00000100:00100000:0.0:1789518866.035133:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789518866.035141:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627711360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518866.035194:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627711360:12345-0@lo:400:kworker.0 Request processed in 54us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518866.035202:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789518866.035225:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789518866.035232:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffedcde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627711232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518866.035262:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffedcde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627711232:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518866.035268:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789518866.035493:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627711744 00000100:00100000:0.0:1789518866.035497:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627711744 00000100:00100000:0.0:1789518866.035532:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789518866.035540:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627711744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518866.035575:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627711744:12345-0@lo:400:kworker.0 Request processed in 36us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518866.035581:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1789518866.035598:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789518866.035603:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518866.035657:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627711232:0@lo:400:kworker.0 00000100:00100000:0.0:1789518866.035667:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627711744:0@lo:400:kworker.0 00000100:00100000:0.0:1789518866.035676:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627711360:0@lo:400:kworker.0 00000100:00100000:1.0:1789518866.035751:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627711104:0@lo:400:kworker.0 00000100:00100000:1.0:1789518866.035788:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518866.035823:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627711616:0@lo:400:kworker.0 00000100:00100000:1.0:1789518866.035843:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518866.035861:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518866.035866:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627711488:0@lo:400:kworker.0 00000100:00100000:1.0:1789518866.035887:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518866.035915:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627711616 00000100:00100000:1.0:1789518866.035918:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627711616 00000100:00100000:1.0:1789518866.035949:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627711488 00000100:00100000:1.0:1789518866.035951:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627711488 00000100:00100000:1.0:1789518866.035971:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789518866.035978:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627711616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518866.036018:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627711616:12345-0@lo:400:kworker.0 Request processed in 40us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518866.036026:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789518866.036043:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789518866.036050:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627711488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518866.036076:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627711488:12345-0@lo:400:kworker.0 Request processed in 27us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518866.036083:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:1.0:1789518866.036101:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518866.036121:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627711488:0@lo:400:kworker.0 00000100:00100000:1.0:1789518866.036133:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627711616:0@lo:400:kworker.0 00000100:00100000:1.0:1789518866.036200:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518866.036210:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627711872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518866.036237:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518866.036277:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627711872 00000100:00100000:1.0:1789518866.036281:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627711872 00000100:00100000:1.0:1789518866.036310:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789518866.036317:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627711872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518866.036345:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518866.036380:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627711872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518866.036399:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789518866.036434:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627711872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518866.039108:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627711104 00000100:00100000:0.0:1789518866.039118:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627711104 00000100:00100000:0.0:1789518866.039162:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789518866.039171:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627711104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518866.039242:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627711104:12345-0@lo:400:kworker.0 Request processed in 72us (3454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518866.039251:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789518866.039277:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9ffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627711104:0@lo:400:kworker.0 00010000:00010000:2.0:1789518866.290852:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518867.122869:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518867.122887:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518867.123506:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518867.123522:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1789518867.316008:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518867.345284:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518867.345330:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518867.345370:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518867.345411:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518867.345434:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518867.345460:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617526400 00000100:00100000:3.0:1789518867.345470:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617526400 00000100:00100000:3.0:1789518867.345527:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617526272 00000100:00100000:3.0:1789518867.345530:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617526272 00000100:00100000:3.0:1789518867.345554:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:3.0:1789518867.345564:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2344:x1876445617526400:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518867.345657:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2344:x1876445617526400:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 95us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518867.345665:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:3.0:1789518867.345682:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:3.0:1789518867.345689:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617526272:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518867.345715:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617526272:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518867.345720:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:1.0:1789518867.345891:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617526144 00000100:00100000:1.0:1789518867.345898:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617526144 00000100:00100000:1.0:1789518867.345929:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617526528 00000100:00100000:1.0:1789518867.345932:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617526528 00000100:00100000:1.0:1789518867.346029:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 249 00000100:00100000:1.0:1789518867.346042:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2344:x1876445617526144:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518867.346085:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2344:x1876445617526144:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 46us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518867.346092:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 249 00000100:00100000:1.0:1789518867.346108:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00100000:1.0:1789518867.346115:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617526528:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518867.346141:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617526528:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518867.346147:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 250 00000100:00080000:1.0:1789518867.346162:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518867.346166:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518867.346169:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518867.347340:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617526016 00000100:00100000:2.0:1789518867.347352:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617526016 00000100:00100000:2.0:1789518867.347424:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 215 00000100:00100000:2.0:1789518867.347433:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617526016:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518867.347742:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617526016:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 308us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518867.347752:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 215 00000040:00080000:2.0:1789518867.472228:0:45815:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518867.472236:0:45815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518867.472924:0:45815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518867.472934:0:45815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518868.339157:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518869.029029:0:45866:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518869.029037:0:45866:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518869.029598:0:45866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518869.029607:0:45866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518869.364240:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789518870.387317:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518870.642771:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518870.642791:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627712000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518870.642858:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518870.642905:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627712000 00000100:00100000:2.0:1789518870.642914:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627712000 00000100:00080000:1.0:1789518870.642946:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518870.642973:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789518870.642984:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627712000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789518870.643015:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:2.0:1789518870.643085:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627712000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518870.643093:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789518870.643155:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627712000:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789518870.654469:0:45917:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518870.654477:0:45917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518870.655440:0:45917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518870.655450:0:45917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518871.155044:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789518871.155069:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627712128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518871.155132:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518871.155210:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627712128 00000100:00100000:2.0:1789518871.155218:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627712128 00000100:00100000:2.0:1789518871.155285:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1789518871.155291:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518871.155306:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627712128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518871.155342:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518871.155408:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627712128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518871.155416:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789518871.155451:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627712128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518871.155534:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518871.155600:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518871.155630:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627712384:0@lo:400:kworker.0 00000100:00100000:1.0:1789518871.155662:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518871.155922:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627712384 00000100:00100000:0.0:1789518871.155928:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627712384 00000100:00100000:0.0:1789518871.155972:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789518871.155980:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627712384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518871.156020:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627712384:12345-0@lo:400:kworker.0 Request processed in 41us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518871.156028:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789518871.156054:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627712384:0@lo:400:kworker.0 00000100:00100000:2.0:1789518871.157214:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627712256:0@lo:400:kworker.0 00000100:00100000:2.0:1789518871.157263:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518871.157407:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627712256 00000100:00100000:0.0:1789518871.157414:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627712256 00000100:00100000:0.0:1789518871.157560:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789518871.157570:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627712256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518871.157638:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627712256:12345-0@lo:400:kworker.0 Request processed in 69us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518871.157645:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789518871.157722:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627712256:0@lo:400:kworker.0 00000100:00100000:3.0:1789518871.159587:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627712640:0@lo:400:kworker.0 00000100:00100000:3.0:1789518871.159654:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518871.159687:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518871.159693:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627712512:0@lo:400:kworker.0 00000100:00100000:3.0:1789518871.159715:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518871.159746:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627712640 00000100:00100000:3.0:1789518871.159752:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627712640 00000100:00100000:0.0:1789518871.159790:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627712768:0@lo:400:kworker.0 00000100:00100000:3.0:1789518871.159803:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627712512 00000100:00100000:3.0:1789518871.159808:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627712512 00000100:00100000:0.0:1789518871.159825:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518871.159932:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627712768 00000100:00100000:3.0:1789518871.159938:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627712768 00000100:00100000:2.0:1789518871.159938:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789518871.159955:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627712640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518871.159971:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789518871.159981:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627712512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518871.160012:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627712640:12345-0@lo:400:kworker.0 Request processed in 64us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518871.160021:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789518871.160029:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627712512:12345-0@lo:400:kworker.0 Request processed in 49us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518871.160038:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789518871.160240:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789518871.160249:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627712768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518871.160284:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627712768:12345-0@lo:400:kworker.0 Request processed in 37us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518871.160289:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789518871.160401:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627712512:0@lo:400:kworker.0 00000100:00100000:2.0:1789518871.160412:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627712640:0@lo:400:kworker.0 00000100:00100000:2.0:1789518871.160460:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627712768:0@lo:400:kworker.0 00000100:00080000:2.0:1789518871.160482:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789518871.410836:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518872.172103:0:45968:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518872.172111:0:45968:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518872.173057:0:45968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518872.173068:0:45968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518872.435112:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518872.461143:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518872.461225:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617526656 00000100:00100000:2.0:1789518872.461235:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617526656 00000100:00100000:2.0:1789518872.461300:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:2.0:1789518872.461310:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617526656:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518872.461402:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617526656:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518872.461411:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 217 00000100:00100000:3.0:1789518872.463263:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518872.463310:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518872.463345:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617526784 00000100:00100000:3.0:1789518872.463362:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518872.463364:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617526784 00000100:00100000:3.0:1789518872.463417:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518872.463429:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617527168 00000100:00100000:2.0:1789518872.463434:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617527168 00000100:00100000:3.0:1789518872.463451:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 254 00000100:00100000:0.0:1789518872.463456:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617527040 00000100:00100000:0.0:1789518872.463463:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617527040 00000100:00100000:3.0:1789518872.463466:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617526784:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518872.463479:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 255 00000100:00100000:2.0:1789518872.463492:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617527168:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518872.463504:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617526912 00000100:00100000:0.0:1789518872.463508:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617526912 00000100:00100000:0.0:1789518872.463537:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 168 00000100:00100000:3.0:1789518872.463545:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617526784:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 84us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518872.463548:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617527040:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518872.463561:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 254 00000100:00100000:2.0:1789518872.463910:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617527168:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 420us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518872.463919:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 255 00000100:00080000:2.0:1789518872.463938:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518872.463941:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518872.463944:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518872.463972:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:2.0:1789518872.463982:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617526912:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518872.464017:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617526912:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 37us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518872.464024:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:0.0:1789518872.464086:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617527040:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 539us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518872.464094:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 168 00010000:00010000:3.0:1789518873.459820:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518873.675134:0:46020:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518873.675145:0:46020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518873.675791:0:46020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518873.675804:0:46020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518874.485117:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518875.146927:0:46071:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518875.146935:0:46071:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518875.147464:0:46071:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518875.147474:0:46071:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518875.507252:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518875.763037:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518875.763058:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627712896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518875.763126:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518875.764402:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627712896 00000100:00100000:0.0:1789518875.764412:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627712896 00000100:00100000:0.0:1789518875.764713:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789518875.764724:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627712896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518875.764825:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518875.765016:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627712896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 294us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518875.765024:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789518875.765127:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627712896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518875.765344:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518876.277891:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518876.277912:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627713024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518876.277987:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518876.278056:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627713024 00000100:00100000:1.0:1789518876.278064:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627713024 00000100:00100000:1.0:1789518876.278119:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789518876.278128:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627713024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518876.278169:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518876.278212:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627713024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518876.278219:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1789518876.278241:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518876.278274:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627713024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518876.282204:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627713152:0@lo:400:kworker.0 00000100:00100000:3.0:1789518876.282272:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518876.282368:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627713152 00000100:00100000:1.0:1789518876.282377:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627713152 00000100:00100000:1.0:1789518876.282423:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789518876.282432:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627713152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518876.283512:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627713408:0@lo:400:kworker.0 00000100:00100000:0.0:1789518876.283551:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518876.283579:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789518876.283585:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627713280:0@lo:400:kworker.0 00000100:00100000:0.0:1789518876.283609:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518876.283669:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627713408 00000100:00100000:0.0:1789518876.283674:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627713408 00000100:00100000:0.0:1789518876.283706:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789518876.283714:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627713408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518876.283755:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627713408:12345-0@lo:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518876.283762:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789518876.283801:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627713408:0@lo:400:kworker.0 00000100:00100000:0.0:1789518876.283829:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627713280 00000100:00100000:0.0:1789518876.283832:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627713280 00000100:00100000:0.0:1789518876.283858:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789518876.283864:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627713280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518876.283899:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627713280:12345-0@lo:400:kworker.0 Request processed in 35us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518876.283906:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789518876.283930:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627713280:0@lo:400:kworker.0 00000100:00100000:3.0:1789518876.286143:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627713664:0@lo:400:kworker.0 00000100:00100000:2.0:1789518876.286179:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627713536:0@lo:400:kworker.0 00000100:00100000:3.0:1789518876.286209:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518876.286241:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627713664 00000100:00100000:2.0:1789518876.286248:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627713664 00000100:00100000:0.0:1789518876.286275:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518876.286293:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627713536 00000100:00100000:2.0:1789518876.286296:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627713536 00000100:00080000:0.0:1789518876.286310:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518876.286319:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789518876.286326:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fecb0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627713664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518876.286347:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789518876.286354:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627713536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518876.286448:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fecb0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627713664:12345-0@lo:400:kworker.0 Request processed in 121us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518876.286455:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789518876.286523:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d183546-773a-47ec-8f5a-25077d1135e5:3283:1876445627713152:0@lo:400:kworker.0 00000100:00100000:3.0:1789518876.286545:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627713664:0@lo:400:kworker.0 00000100:00100000:1.0:1789518876.286598:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3283:x1876445627713152:12345-0@lo:400:kworker.0 Request processed in 4166us (4324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518876.286607:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789518876.286609:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627713536:12345-0@lo:400:kworker.0 Request processed in 256us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518876.286660:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627713536:0@lo:400:kworker.0 00000100:00100000:0.0:1789518876.286675:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00010000:2.0:1789518876.531536:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518876.719000:0:46122:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518876.719008:0:46122:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518876.719880:0:46122:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518876.719891:0:46122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1789518877.362890:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518877.362897:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518877.364190:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518877.364203:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518877.555701:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518877.586607:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518877.586682:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518877.586723:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518877.586855:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617527680 00000100:00100000:2.0:1789518877.586865:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617527680 00000100:00100000:0.0:1789518877.586877:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617527424 00000100:00100000:0.0:1789518877.586884:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617527424 00000100:00100000:2.0:1789518877.586992:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:2.0:1789518877.587003:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617527680:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518877.587074:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617527680:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 73us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518877.587081:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 171 00000100:00100000:2.0:1789518877.587105:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617527296 00000100:00100000:2.0:1789518877.587108:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617527296 00000100:00100000:2.0:1789518877.587133:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:2.0:1789518877.587140:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617527296:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518877.587165:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617527296:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518877.587172:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 219 00000100:00100000:2.0:1789518877.587702:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518877.587734:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518877.587753:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617527808 00000100:00100000:2.0:1789518877.587757:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617527808 00000100:00100000:3.0:1789518877.587800:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617527552 00000100:00100000:3.0:1789518877.587804:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617527552 00000100:00080000:1.0:1789518877.588466:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518877.588472:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789518877.588475:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789518877.588517:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 259 00000100:00100000:0.0:1789518877.588528:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc52bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617527424:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518877.588584:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc52bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617527424:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 57us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518877.588592:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 259 00000100:00100000:2.0:1789518877.589097:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 260 00000100:00100000:2.0:1789518877.589121:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617527808:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518877.589498:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617527808:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 391us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518877.589506:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 260 00000100:00100000:3.0:1789518877.590513:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 172 00000100:00100000:3.0:1789518877.590525:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617527552:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518877.590973:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617527552:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 448us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518877.590981:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 172 00000040:00080000:1.0:1789518878.294460:0:46173:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518878.294469:0:46173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518878.295418:0:46173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518878.295431:0:46173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518878.578807:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518879.603050:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518879.835174:0:46224:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518879.835183:0:46224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518879.837297:0:46224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518879.837434:0:46224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518880.627017:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518880.883237:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789518880.883263:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627713792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518880.883344:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518880.883735:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627713792 00000100:00100000:1.0:1789518880.883743:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627713792 00000100:00080000:0.0:1789518880.883817:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518880.883828:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789518880.883841:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627713792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518880.883875:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:1.0:1789518880.883928:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627713792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518880.883945:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789518880.884009:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627713792:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789518881.323923:0:46276:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518881.323931:0:46276:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518881.324465:0:46276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518881.324475:0:46276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518881.394838:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627714304:0@lo:400:kworker.0 00000100:00100000:0.0:1789518881.394958:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627713920:0@lo:400:kworker.0 00000100:00100000:0.0:1789518881.396724:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518881.396736:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627714048:0@lo:400:kworker.0 00000100:00100000:0.0:1789518881.396767:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627714432:0@lo:400:kworker.0 00000100:00100000:1.0:1789518881.396787:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518881.396796:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518881.396820:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec96f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627714560:0@lo:400:kworker.0 00000100:00100000:0.0:1789518881.396847:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627713920 00000100:00100000:1.0:1789518881.396848:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518881.396855:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627713920 00000100:00100000:1.0:1789518881.396873:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789518881.396883:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627714176:0@lo:400:kworker.0 00000100:00100000:0.0:1789518881.396906:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789518881.396907:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518881.396920:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627713920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518881.396931:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627714688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518881.396956:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518881.396982:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627713920:12345-0@lo:400:kworker.0 Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518881.396989:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789518881.396993:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627714432 00000100:00100000:1.0:1789518881.396998:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627714432 00000100:00100000:0.0:1789518881.397026:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627714048 00000100:00100000:0.0:1789518881.397031:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627714048 00000100:00100000:1.0:1789518881.397039:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627714560 00000100:00100000:1.0:1789518881.397044:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627714560 00000100:00100000:0.0:1789518881.397066:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627714176 00000100:00100000:0.0:1789518881.397070:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627714176 00000100:00100000:1.0:1789518881.397074:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789518881.397083:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627714432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518881.397104:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789518881.397114:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627714048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518881.397121:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627714432:12345-0@lo:400:kworker.0 Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518881.397128:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789518881.397144:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789518881.397152:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627714560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518881.397160:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627714048:12345-0@lo:400:kworker.0 Request processed in 48us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518881.397167:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789518881.397181:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789518881.397193:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876445627714560:12345-0@lo:400:kworker.0 Request processed in 38us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518881.397193:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627714176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518881.397205:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789518881.397230:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627714688 00000100:00100000:1.0:1789518881.397234:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627714688 00000100:00100000:0.0:1789518881.397235:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627714176:12345-0@lo:400:kworker.0 Request processed in 47us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518881.397243:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789518881.397264:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789518881.397272:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627714688:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789518881.397272:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518881.397279:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:1.0:1789518881.397302:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518881.397332:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627713920:0@lo:400:kworker.0 00000100:00100000:1.0:1789518881.397354:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627714688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518881.397362:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789518881.397392:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffc638ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627714176:0@lo:400:kworker.0 00000100:00100000:0.0:1789518881.397433:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627714432:0@lo:400:kworker.0 00000100:00100000:1.0:1789518881.397795:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627714688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518881.397812:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627714048:0@lo:400:kworker.0 00000100:00100000:1.0:1789518881.397821:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec96f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1876445627714560:0@lo:400:kworker.0 00000100:00100000:3.0:1789518881.400063:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518881.400359:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627714304 00000100:00100000:0.0:1789518881.400367:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627714304 00000100:00100000:0.0:1789518881.400417:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789518881.400427:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627714304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518881.400490:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1876445627714304:12345-0@lo:400:kworker.0 Request processed in 65us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518881.400497:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789518881.400649:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1f89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1876445627714304:0@lo:400:kworker.0 00010000:00010000:2.0:1789518881.650877:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518882.675836:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518882.701432:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518882.701468:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518882.701493:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518882.701515:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518882.701538:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518882.701565:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617527936 00000100:00100000:3.0:1789518882.701573:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617527936 00000100:00100000:3.0:1789518882.701641:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:3.0:1789518882.701651:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffee868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617527936:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518882.701713:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffee868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617527936:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 64us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518882.701721:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 221 00000100:00100000:3.0:1789518882.701754:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617528192 00000100:00100000:3.0:1789518882.701758:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617528192 00000100:00100000:3.0:1789518882.701792:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617528320 00000100:00100000:3.0:1789518882.701795:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617528320 00000100:00100000:3.0:1789518882.701817:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:3.0:1789518882.701824:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617528192:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518882.701850:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617528192:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518882.701856:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 175 00000100:00100000:3.0:1789518882.701867:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:3.0:1789518882.701873:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617528320:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518882.701894:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617528320:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518882.701901:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:3.0:1789518882.701922:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617528448 00000100:00100000:3.0:1789518882.701925:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617528448 00000100:00100000:3.0:1789518882.701953:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617528064 00000100:00100000:3.0:1789518882.701956:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617528064 00000100:00100000:3.0:1789518882.701979:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 264 00000100:00100000:3.0:1789518882.701987:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617528448:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518882.702015:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617528448:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518882.702025:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 264 00000100:00100000:3.0:1789518882.702040:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 265 00000100:00100000:3.0:1789518882.702047:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec96f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617528064:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518882.702073:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec96f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617528064:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518882.702079:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 265 00000100:00080000:3.0:1789518882.702201:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518882.702206:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789518882.702208:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789518882.881203:0:46328:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518882.881212:0:46328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518882.881975:0:46328:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518882.881986:0:46328:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518883.698780:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518884.443046:0:46379:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518884.443054:0:46379:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518884.443579:0:46379:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518884.443587:0:46379:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1789518884.722917:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518885.747152:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518886.004007:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627714816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518886.004069:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518886.004138:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627714816 00000100:00100000:0.0:1789518886.004145:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627714816 00000100:00100000:0.0:1789518886.004194:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789518886.004215:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627714816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518886.004249:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518886.004300:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627714816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518886.004307:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789518886.004328:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789518886.004360:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627714816:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789518886.091972:0:46430:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518886.091980:0:46430:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518886.092530:0:46430:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518886.092540:0:46430:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518886.514913:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627715328:0@lo:400:kworker.0 00000100:00100000:1.0:1789518886.514930:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627715200:0@lo:400:kworker.0 00000100:00100000:0.0:1789518886.514945:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627714944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518886.515000:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627715072:0@lo:400:kworker.0 00000100:00100000:1.0:1789518886.517380:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518886.517435:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627715712:0@lo:400:kworker.0 00000100:00100000:1.0:1789518886.517469:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518886.517526:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627715712 00000100:00100000:1.0:1789518886.517532:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627715712 00000100:00100000:1.0:1789518886.517579:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789518886.517587:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627715712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518886.517648:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627715712:12345-0@lo:400:kworker.0 Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518886.517655:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789518886.518878:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627715712:0@lo:400:kworker.0 00000100:00100000:1.0:1789518886.518930:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627715200 00000100:00100000:1.0:1789518886.518935:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627715200 00000100:00100000:1.0:1789518886.518970:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789518886.518976:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627715200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518886.519026:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc638ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627715200:12345-0@lo:400:kworker.0 Request processed in 49us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518886.519033:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789518886.519061:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627715200:0@lo:400:kworker.0 00000100:00080000:1.0:1789518886.519084:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518886.519344:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518886.519382:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627715456:0@lo:400:kworker.0 00000100:00100000:0.0:1789518886.521331:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518886.521383:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627715456 00000100:00100000:0.0:1789518886.521389:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627715456 00000100:00100000:0.0:1789518886.521422:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789518886.521430:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627715456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518886.521471:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627715456:12345-0@lo:400:kworker.0 Request processed in 43us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518886.521478:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789518886.521509:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627715456:0@lo:400:kworker.0 00000100:00100000:1.0:1789518886.522686:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627714944 00000100:00100000:1.0:1789518886.522692:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627714944 00000100:00080000:0.0:1789518886.522726:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518886.522732:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789518886.522740:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627714944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518886.522767:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518886.522821:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627714944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (3477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518886.522827:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789518886.522961:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627714944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518886.523468:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518886.525924:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518886.526000:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec9403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627715584:0@lo:400:kworker.0 00000100:00100000:2.0:1789518886.526034:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518886.526478:0:36531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627715328 00000100:00100000:0.0:1789518886.526485:0:36531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627715328 00000100:00100000:0.0:1789518886.526538:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789518886.526546:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627715328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518886.526605:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627715328:12345-0@lo:400:kworker.0 Request processed in 59us (3137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518886.526611:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789518886.526858:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627715584 00000100:00100000:3.0:1789518886.526863:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627715584 00000100:00100000:3.0:1789518886.526914:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789518886.526922:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627715584:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789518886.526931:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518886.526941:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627715328:0@lo:400:kworker.0 00000100:00100000:3.0:1789518886.526975:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627715584:12345-0@lo:400:kworker.0 Request processed in 53us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518886.526983:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789518886.527009:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627715584:0@lo:400:kworker.0 00000100:00100000:1.0:1789518886.528967:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627715072 00000100:00100000:1.0:1789518886.528976:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627715072 00000100:00100000:1.0:1789518886.529017:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789518886.529025:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627715072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518886.529087:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627715072:12345-0@lo:400:kworker.0 Request processed in 63us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518886.529094:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789518886.529332:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec9401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627715072:0@lo:400:kworker.0 00010000:00010000:3.0:1789518886.770831:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518887.602878:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518887.602886:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518887.605218:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518887.605231:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1789518887.676993:0:46482:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518887.677003:0:46482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518887.677821:0:46482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518887.677834:0:46482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789518887.796475:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518887.821609:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518887.821906:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617528704 00000100:00100000:1.0:1789518887.821915:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617528704 00000100:00100000:1.0:1789518887.821978:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 269 00000100:00100000:1.0:1789518887.821988:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617528704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:0.0:1789518887.822020:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518887.822056:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617528704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518887.822068:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 269 00000100:00100000:0.0:1789518887.822070:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518887.822147:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617528960 00000100:00100000:2.0:1789518887.822153:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617528960 00000100:00100000:1.0:1789518887.822219:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518887.822224:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00080000:0.0:1789518887.822231:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518887.822236:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617528960:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518887.822251:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518887.822257:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617528576 00000100:00100000:0.0:1789518887.822262:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617528576 00000100:00100000:0.0:1789518887.822314:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:0.0:1789518887.822335:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617528576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518887.822552:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617528960:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518887.822563:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 179 00000100:00100000:2.0:1789518887.822577:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617528832 00000100:00100000:2.0:1789518887.822580:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617528832 00000100:00100000:2.0:1789518887.822609:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:2.0:1789518887.822640:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617528832:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518887.823144:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518887.823471:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617528576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1149us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518887.823480:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 223 00000100:00100000:2.0:1789518887.823597:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617528832:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 958us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518887.823605:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00080000:3.0:1789518887.823785:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518887.825003:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617529088 00000100:00100000:1.0:1789518887.825023:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617529088 00000100:00100000:1.0:1789518887.825082:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 270 00000100:00100000:1.0:1789518887.825093:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617529088:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518887.825244:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617529088:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 153us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518887.825252:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 270 00000100:00080000:3.0:1789518887.826153:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789518888.819043:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518889.163609:0:46533:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518889.163774:0:46533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518889.164303:0:46533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518889.164311:0:46533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518889.842845:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518890.722402:0:46584:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518890.722411:0:46584:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518890.723959:0:46584:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518890.723973:0:46584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789518890.866830:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789518891.123289:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627715840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789518891.123358:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518891.124035:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627715840 00000100:00100000:0.0:1789518891.124044:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627715840 00000100:00100000:0.0:1789518891.124121:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789518891.124130:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627715840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518891.124161:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518891.124214:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627715840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518891.124221:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789518891.124348:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627715840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518891.124412:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518891.635568:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627715968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518891.635650:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518891.635912:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627715968 00000100:00100000:0.0:1789518891.635920:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627715968 00000100:00100000:0.0:1789518891.635978:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789518891.635987:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627715968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789518891.636018:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1789518891.636058:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627715968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518891.636064:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1789518891.636182:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518891.636183:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627716352:0@lo:400:kworker.0 00000100:00100000:3.0:1789518891.636219:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518891.636239:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627716096:0@lo:400:kworker.0 00000100:00100000:1.0:1789518891.636299:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518891.636312:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789518891.636321:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627716480:0@lo:400:kworker.0 00000100:00100000:1.0:1789518891.636336:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518891.636345:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627716224:0@lo:400:kworker.0 00000100:00100000:3.0:1789518891.636352:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518891.636396:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627716096 00000100:00100000:0.0:1789518891.636401:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627716096 00000100:00100000:0.0:1789518891.636428:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789518891.636435:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627716096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518891.636466:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627716096:12345-0@lo:400:kworker.0 Request processed in 32us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518891.636473:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789518891.636540:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627715968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518891.637488:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627716352 00000100:00100000:2.0:1789518891.637496:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627716352 00000100:00100000:1.0:1789518891.637527:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518891.637563:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627716096:0@lo:400:kworker.0 00000100:00080000:3.0:1789518891.637565:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518891.637598:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627716480 00000100:00100000:0.0:1789518891.637604:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627716480 00000100:00080000:1.0:1789518891.637679:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518891.637733:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789518891.637743:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627716352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518891.637792:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffffe5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627716352:12345-0@lo:400:kworker.0 Request processed in 52us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518891.637799:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789518891.637811:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627716224 00000100:00100000:2.0:1789518891.637814:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627716224 00000100:00100000:2.0:1789518891.637831:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789518891.637836:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffd03d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627716480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518891.637863:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffd03d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627716480:12345-0@lo:400:kworker.0 Request processed in 27us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518891.637869:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789518891.637879:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789518891.637884:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627716224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518891.637923:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627716224:12345-0@lo:400:kworker.0 Request processed in 24us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518891.637929:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789518891.637961:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627716480:0@lo:400:kworker.0 00000100:00100000:2.0:1789518891.637970:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627716352:0@lo:400:kworker.0 00000100:00100000:1.0:1789518891.638050:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627716224:0@lo:400:kworker.0 00010000:00010000:0.0:1789518891.892993:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789518892.262217:0:46635:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518892.262225:0:46635:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518892.264864:0:46635:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518892.264879:0:46635:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518892.917550:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518892.943418:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518892.943478:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518892.943535:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617529344 00000100:00100000:0.0:1789518892.943550:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617529344 00000100:00100000:1.0:1789518892.943571:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518892.943609:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518892.943692:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:0.0:1789518892.943708:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617529344:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518892.943715:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518892.943775:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617529728 00000100:00100000:1.0:1789518892.943784:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617529728 00000100:00100000:0.0:1789518892.943800:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617529344:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 96us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518892.943809:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 274 00000100:00100000:0.0:1789518892.943834:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 275 00000100:00100000:0.0:1789518892.943844:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617529728:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518892.943869:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617529472 00000100:00100000:1.0:1789518892.943876:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617529472 00000100:00100000:0.0:1789518892.943881:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2343:x1876445617529728:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 36us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518892.943890:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 275 00000100:00100000:1.0:1789518892.943927:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617529600 00000100:00100000:1.0:1789518892.943931:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617529600 00000100:00100000:1.0:1789518892.943959:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:1.0:1789518892.943968:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617529472:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518892.944033:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617529472:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518892.944042:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 181 00000100:00100000:1.0:1789518892.944069:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 182 00000100:00100000:1.0:1789518892.944079:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617529600:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518892.944121:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617529600:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 43us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518892.944128:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 182 00000100:00080000:2.0:1789518892.944263:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518892.944269:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789518892.944272:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518892.945097:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617529216 00000100:00100000:3.0:1789518892.945106:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617529216 00000100:00100000:3.0:1789518892.945215:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 225 00000100:00100000:3.0:1789518892.945228:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617529216:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518892.945314:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617529216:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 89us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518892.945322:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 225 00000040:00080000:1.0:1789518893.832202:0:46686:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518893.832210:0:46686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518893.832896:0:46686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518893.832908:0:46686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789518893.938872:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518894.963192:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518895.299173:0:46738:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518895.299182:0:46738:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518895.299784:0:46738:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518895.299795:0:46738:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518895.987742:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518896.243610:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627716608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789518896.243699:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518896.243899:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627716608 00000100:00100000:0.0:1789518896.243906:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627716608 00000100:00100000:0.0:1789518896.243970:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789518896.243981:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627716608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789518896.244012:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:0.0:1789518896.244064:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627716608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518896.244071:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789518896.244156:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627716608:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789518896.244218:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789518896.754903:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789518896.754930:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627716736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789518896.754995:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518896.755054:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627716736 00000100:00100000:2.0:1789518896.755062:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627716736 00000100:00100000:2.0:1789518896.755128:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789518896.755136:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627716736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789518896.755164:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518896.755202:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627716736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518896.755208:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1789518896.755226:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789518896.755267:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627716736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518896.756841:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518896.757397:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627716992:0@lo:400:kworker.0 00000100:00100000:1.0:1789518896.757445:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518896.757527:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627716864:0@lo:400:kworker.0 00000100:00100000:1.0:1789518896.757555:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518896.757652:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627716864 00000100:00100000:3.0:1789518896.757660:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627716864 00000100:00100000:3.0:1789518896.757698:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789518896.757707:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627716864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518896.757754:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627716864:12345-0@lo:400:kworker.0 Request processed in 48us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518896.757762:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789518896.757812:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627716864:0@lo:400:kworker.0 00000100:00100000:1.0:1789518896.758001:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627717248:0@lo:400:kworker.0 00000100:00100000:1.0:1789518896.758025:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518896.758068:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627717120:0@lo:400:kworker.0 00000100:00100000:2.0:1789518896.758462:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627716992 00000100:00100000:2.0:1789518896.758467:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627716992 00000100:00100000:3.0:1789518896.758511:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518896.758561:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627717248 00000100:00100000:3.0:1789518896.758565:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627717248 00000100:00100000:3.0:1789518896.758583:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627717120 00000100:00100000:3.0:1789518896.758586:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627717120 00000100:00100000:3.0:1789518896.758599:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789518896.758604:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627716992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518896.758665:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1876445627716992:12345-0@lo:400:kworker.0 Request processed in 59us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518896.758671:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789518896.758683:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789518896.758688:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627717248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518896.758711:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876445627717248:12345-0@lo:400:kworker.0 Request processed in 24us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518896.758717:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789518896.758725:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789518896.758730:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627717120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518896.758752:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627717120:12345-0@lo:400:kworker.0 Request processed in 23us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518896.758758:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789518896.758801:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1876445627716992:0@lo:400:kworker.0 00000100:00100000:3.0:1789518896.758825:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627717120:0@lo:400:kworker.0 00000100:00080000:2.0:1789518896.758874:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518896.758986:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1876445627717248:0@lo:400:kworker.0 00000040:00080000:2.0:1789518896.941589:0:46789:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518896.941598:0:46789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518896.942180:0:46789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518896.942190:0:46789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1789518897.010910:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518897.842836:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518897.842845:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518897.843381:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518897.843391:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518898.034871:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518898.061274:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518898.061384:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518898.061543:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617529856 00000100:00100000:1.0:1789518898.061556:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617529856 00000100:00100000:1.0:1789518898.061654:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:1.0:1789518898.061668:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617529856:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518898.061768:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617529856:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 103us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518898.061788:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 227 00000100:00100000:0.0:1789518898.062317:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518898.062500:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518898.062525:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617529984 00000100:00100000:3.0:1789518898.062533:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617529984 00000100:00100000:3.0:1789518898.062588:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617530368 00000100:00100000:3.0:1789518898.062592:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617530368 00000100:00100000:2.0:1789518898.062665:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 279 00000100:00100000:2.0:1789518898.062679:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617529984:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518898.062735:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2343:x1876445617529984:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 60us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518898.062743:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 279 00000100:00080000:0.0:1789518898.062883:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518898.062909:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617530112 00000100:00100000:1.0:1789518898.062915:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617530112 00000100:00100000:1.0:1789518898.062958:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 183 00000100:00100000:1.0:1789518898.062966:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617530112:12345-192.168.206.51@tcp:400:kworker.0 00000100:00080000:0.0:1789518898.062967:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518898.063010:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617530112:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 44us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518898.063017:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 183 00000100:00100000:1.0:1789518898.063162:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 280 00000100:00100000:1.0:1789518898.063170:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617530368:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518898.063201:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617530368:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518898.063207:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 280 00000100:00100000:0.0:1789518898.063260:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518898.063338:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617530240 00000100:00100000:0.0:1789518898.063343:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617530240 00000100:00100000:0.0:1789518898.063580:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00100000:0.0:1789518898.063590:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617530240:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518898.063662:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617530240:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518898.063669:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 184 00000100:00080000:1.0:1789518898.063677:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789518898.515588:0:46840:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518898.515596:0:46840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518898.516160:0:46840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518898.516170:0:46840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518899.059990:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518900.082936:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518900.094177:0:46891:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518900.094187:0:46891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518900.096228:0:46891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518900.096243:0:46891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518901.106881:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518901.363406:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec1335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627717376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518901.363467:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518901.363605:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627717376 00000100:00100000:1.0:1789518901.363645:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627717376 00000100:00100000:1.0:1789518901.363696:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789518901.363707:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627717376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518901.363741:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00080000:0.0:1789518901.363790:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518901.363791:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627717376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518901.363801:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789518901.364165:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec1335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627717376:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789518901.702477:0:46942:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518901.702486:0:46942:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518901.703356:0:46942:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518901.703365:0:46942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518901.874776:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627717504:0@lo:400:kworker.0 00000100:00100000:1.0:1789518901.874833:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627717888:0@lo:400:kworker.0 00000100:00100000:0.0:1789518901.874883:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518901.874895:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518901.874941:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627717888 00000100:00100000:0.0:1789518901.874941:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627718016:0@lo:400:kworker.0 00000100:00100000:2.0:1789518901.874950:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627717888 00000100:00100000:0.0:1789518901.874968:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518901.875009:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627718016 00000100:00100000:0.0:1789518901.875009:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627717504 00000100:00100000:2.0:1789518901.875014:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627718016 00000100:00100000:0.0:1789518901.875016:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627717504 00000100:00100000:2.0:1789518901.875047:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789518901.875057:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627717888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518901.875063:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789518901.875074:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627717504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518901.875117:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1876445627717888:12345-0@lo:400:kworker.0 Request processed in 62us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518901.875124:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3281:x1876445627717504:12345-0@lo:400:kworker.0 Request processed in 51us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518901.875127:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789518901.875136:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789518901.875150:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789518901.875160:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627718016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518901.875184:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d183546-773a-47ec-8f5a-25077d1135e5:3281:1876445627717504:0@lo:400:kworker.0 00000100:00100000:2.0:1789518901.875200:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627718016:12345-0@lo:400:kworker.0 Request processed in 41us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518901.875222:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789518901.875228:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627718016:0@lo:400:kworker.0 00000100:00080000:3.0:1789518901.875246:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518901.875264:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627717632:0@lo:400:kworker.0 00000100:00100000:3.0:1789518901.875301:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518901.876594:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627718144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518901.876643:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518901.876665:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789518901.876671:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627717760:0@lo:400:kworker.0 00000100:00100000:3.0:1789518901.876692:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518901.876721:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627718144 00000100:00100000:3.0:1789518901.876727:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627718144 00000100:00100000:3.0:1789518901.876761:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789518901.876768:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627718144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518901.876797:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518901.876831:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627718144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518901.876838:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789518901.876903:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627717760 00000100:00100000:3.0:1789518901.876907:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627717760 00000100:00100000:3.0:1789518901.876933:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789518901.876938:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627717760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518901.876967:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627717760:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518901.876972:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:3.0:1789518901.876989:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518901.877010:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627717760:0@lo:400:kworker.0 00000100:00100000:3.0:1789518901.877023:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627718144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518901.877055:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627717632 00000100:00100000:3.0:1789518901.877058:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627717632 00000100:00100000:3.0:1789518901.877082:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789518901.877088:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627717632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518901.877121:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627717632:12345-0@lo:400:kworker.0 Request processed in 33us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518901.877127:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789518901.877230:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627717632:0@lo:400:kworker.0 00000100:00100000:1.0:1789518901.877420:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fff78aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1876445627717888:0@lo:400:kworker.0 00010000:00010000:3.0:1789518902.131420:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789518903.154825:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518903.183170:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518903.183229:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518903.183255:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518903.183275:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518903.183337:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518903.183364:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617530624 00000100:00100000:0.0:1789518903.183372:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617530624 00000100:00100000:0.0:1789518903.183421:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617531008 00000100:00100000:0.0:1789518903.183424:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617531008 00000100:00100000:0.0:1789518903.183462:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 284 00000100:00100000:0.0:1789518903.183472:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617530624:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518903.183537:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617530624:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518903.183548:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 284 00000100:00100000:0.0:1789518903.183566:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 285 00000100:00100000:0.0:1789518903.183573:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617531008:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518903.183597:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617531008:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518903.183603:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 285 00000100:00100000:0.0:1789518903.183642:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617530880 00000100:00100000:0.0:1789518903.183645:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617530880 00000100:00100000:0.0:1789518903.183669:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617530752 00000100:00100000:0.0:1789518903.183673:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617530752 00000100:00100000:0.0:1789518903.183693:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00100000:0.0:1789518903.183700:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617530880:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518903.183726:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2342:x1876445617530880:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518903.183731:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 186 00000100:00100000:0.0:1789518903.183743:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00100000:0.0:1789518903.183749:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617530752:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518903.183779:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff78a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2343:x1876445617530752:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518903.183785:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 187 00000100:00080000:0.0:1789518903.183811:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789518903.183815:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518903.183817:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518903.184058:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617530496 00000100:00100000:2.0:1789518903.184063:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617530496 00000100:00100000:2.0:1789518903.184095:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 229 00000100:00100000:2.0:1789518903.184103:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617530496:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518903.184135:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2343:x1876445617530496:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 33us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518903.184142:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 229 00000040:00080000:0.0:1789518903.271848:0:46994:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518903.271857:0:46994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518903.272502:0:46994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518903.272512:0:46994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518904.179707:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518904.844586:0:47045:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518904.844595:0:47045:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518904.845243:0:47045:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518904.845254:0:47045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518905.204242:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518906.227749:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789518906.402156:0:47096:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518906.402166:0:47096:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518906.402806:0:47096:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518906.402815:0:47096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1789518906.484029:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627718272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518906.484095:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518906.484401:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627718272 00000100:00100000:1.0:1789518906.484415:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627718272 00000100:00100000:3.0:1789518906.484678:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789518906.484688:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627718272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789518906.484721:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:3.0:1789518906.484766:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627718272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518906.484773:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789518906.484816:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627718272:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789518906.485060:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518906.994937:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627718400:0@lo:400:kworker.0 00000100:00100000:1.0:1789518906.995016:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518906.995070:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627718912:0@lo:400:kworker.0 00000100:00100000:1.0:1789518906.995101:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518906.995108:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627718528:0@lo:400:kworker.0 00000100:00100000:2.0:1789518906.995147:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518906.995178:0:36533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627718528 00000100:00100000:1.0:1789518906.995197:0:36533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627718528 00000100:00100000:1.0:1789518906.995257:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789518906.995267:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627718528:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518906.995274:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518906.995320:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627718528:12345-0@lo:400:kworker.0 Request processed in 54us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518906.995328:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789518906.995340:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627718656:0@lo:400:kworker.0 00000100:00100000:1.0:1789518906.995369:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627718784:0@lo:400:kworker.0 00000100:00100000:3.0:1789518906.995391:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518906.995457:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627718912 00000100:00100000:2.0:1789518906.995461:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627719040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518906.995464:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627718912 00000100:00100000:1.0:1789518906.995507:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627718400 00000100:00100000:1.0:1789518906.995511:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627718400 00000100:00100000:1.0:1789518906.995538:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789518906.995544:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627718400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518906.996235:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627718656 00000100:00100000:0.0:1789518906.996240:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627718656 00000100:00100000:0.0:1789518906.996260:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789518906.996266:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627718912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518906.996662:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789518906.996684:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518906.996699:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627719040 00000100:00100000:3.0:1789518906.996704:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627719040 00000100:00100000:2.0:1789518906.996708:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627718528:0@lo:400:kworker.0 00000100:00100000:3.0:1789518906.996738:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789518906.996747:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627719040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518906.996775:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1789518906.996847:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789518906.996855:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627718656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518906.996960:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627718656:12345-0@lo:400:kworker.0 Request processed in 106us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518906.996968:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789518906.997027:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1876445627719040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 281us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518906.997036:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789518906.997158:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627719040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518906.997168:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627718656:0@lo:400:kworker.0 00000100:00100000:3.0:1789518906.997227:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518906.997258:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627718784 00000100:00100000:3.0:1789518906.997262:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627718784 00000100:00100000:3.0:1789518906.997289:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789518906.997296:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627718784:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789518906.997314:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518906.997338:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876445627718784:12345-0@lo:400:kworker.0 Request processed in 42us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518906.997346:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789518906.997356:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1876445627718784:0@lo:400:kworker.0 00000100:00100000:1.0:1789518906.998937:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3280:x1876445627718400:12345-0@lo:400:kworker.0 Request processed in 3388us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518906.998949:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789518906.998989:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d183546-773a-47ec-8f5a-25077d1135e5:3280:1876445627718400:0@lo:400:kworker.0 00000100:00100000:0.0:1789518906.999640:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec1ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627718912:12345-0@lo:400:kworker.0 Request processed in 3371us (4535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518906.999649:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789518906.999724:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627718912:0@lo:400:kworker.0 00000040:00080000:0.0:1789518907.058848:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518907.058857:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518907.059605:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518907.059636:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518907.250809:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518907.905503:0:47147:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518907.905511:0:47147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518907.906390:0:47147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518907.906401:0:47147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518908.274902:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789518908.302206:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518908.302264:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518908.302301:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518908.302336:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518908.302375:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518908.302408:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617531392 00000100:00100000:2.0:1789518908.302422:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617531392 00000100:00100000:0.0:1789518908.302475:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617531136 00000100:00100000:0.0:1789518908.302481:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617531136 00000100:00100000:2.0:1789518908.302492:0:36735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617531520 00000100:00100000:2.0:1789518908.302497:0:36735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617531520 00000100:00100000:0.0:1789518908.302518:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:0.0:1789518908.302527:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617531136:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518908.302533:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:2.0:1789518908.302543:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617531392:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518908.302586:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2344:x1876445617531136:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 61us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518908.302591:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 231 00000100:00100000:2.0:1789518908.302598:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2344:x1876445617531392:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 55us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518908.302606:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 189 00000100:00100000:2.0:1789518908.302662:0:36735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00100000:2.0:1789518908.302669:0:36735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617531520:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518908.302697:0:36735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617531520:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518908.302704:0:36735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 190 00000100:00080000:2.0:1789518908.302723:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789518908.302727:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789518908.303582:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617531264 00000100:00100000:3.0:1789518908.303589:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617531264 00000100:00080000:2.0:1789518908.303646:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789518908.303663:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617531648 00000100:00100000:3.0:1789518908.303668:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617531648 00000100:00100000:3.0:1789518908.303697:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 289 00000100:00100000:3.0:1789518908.303705:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617531264:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518908.303750:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617531264:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 46us (1486us total) trans 0 rc 0/0 00000100:00080000:2.0:1789518908.303771:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789518908.303786:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 290 00000100:00100000:0.0:1789518908.303797:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617531648:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518908.303829:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2344:x1876445617531648:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 35us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518908.303848:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 290 00000100:00100000:3.0:1789518908.304419:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 289 00010000:00010000:0.0:1789518909.298769:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518909.448873:0:47199:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518909.448881:0:47199:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518909.449605:0:47199:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518909.449653:0:47199:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518910.322937:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518910.931982:0:47250:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518910.931996:0:47250:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518910.932662:0:47250:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518910.932672:0:47250:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518911.348799:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518911.604990:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99ffdfee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627719168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518911.605056:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518911.605543:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627719168 00000100:00100000:1.0:1789518911.605551:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627719168 00000100:00100000:1.0:1789518911.605685:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789518911.605695:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627719168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518911.605729:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00080000:2.0:1789518911.606006:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518911.606048:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876445627719168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 354us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518911.606056:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789518911.607685:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99ffdfee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1876445627719168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789518912.114944:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627719680:0@lo:400:kworker.0 00000100:00100000:0.0:1789518912.115009:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518912.115076:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789518912.115082:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627719296:0@lo:400:kworker.0 00000100:00100000:0.0:1789518912.115110:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518912.115131:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627719808:0@lo:400:kworker.0 00000100:00100000:1.0:1789518912.115163:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627719424:0@lo:400:kworker.0 00000100:00100000:0.0:1789518912.115171:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518912.115207:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518912.115230:0:35839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627719296 00000100:00100000:1.0:1789518912.115235:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627719936:0@lo:400:kworker.0 00000100:00100000:0.0:1789518912.115239:0:35839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627719296 00000100:00100000:1.0:1789518912.115263:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518912.115284:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518912.115291:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fffbb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627719552:0@lo:400:kworker.0 00000100:00100000:0.0:1789518912.115305:0:35839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789518912.115314:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518912.115322:0:35839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627719296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518912.115344:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627719424 00000100:00100000:1.0:1789518912.115348:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627719424 00000100:00100000:1.0:1789518912.115382:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627719552 00000100:00100000:0.0:1789518912.115382:0:35839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627719296:12345-0@lo:400:kworker.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518912.115388:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627719552 00000100:00100000:0.0:1789518912.115393:0:35839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789518912.115423:0:37973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789518912.115433:0:37973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627719424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518912.115449:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627719680 00000100:00100000:3.0:1789518912.115454:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627719680 00000100:00100000:0.0:1789518912.115457:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627719296:0@lo:400:kworker.0 00000100:00100000:1.0:1789518912.115482:0:37973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627719424:12345-0@lo:400:kworker.0 Request processed in 50us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518912.115490:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627719808 00000100:00100000:1.0:1789518912.115492:0:37973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789518912.115495:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627719808 00000100:00100000:3.0:1789518912.115522:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627719936 00000100:00100000:3.0:1789518912.115525:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627719936 00000100:00100000:3.0:1789518912.115541:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789518912.115547:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627719680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518912.115593:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876445627719680:12345-0@lo:400:kworker.0 Request processed in 46us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518912.115600:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789518912.116182:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789518912.116191:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789518912.116196:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627719808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518912.116205:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627719936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518912.116243:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876445627719808:12345-0@lo:400:kworker.0 Request processed in 52us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518912.116251:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789518912.116256:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1876445627719936:12345-0@lo:400:kworker.0 Request processed in 52us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518912.116264:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789518912.116311:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627720064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789518912.116323:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1876445627719808:0@lo:400:kworker.0 00000100:00100000:3.0:1789518912.116338:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876445627719680:0@lo:400:kworker.0 00000100:00100000:2.0:1789518912.116346:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789518912.116379:0:43232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627720064 00000100:00100000:3.0:1789518912.116384:0:43232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627720064 00000100:00100000:3.0:1789518912.116417:0:43232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789518912.116423:0:43232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec84fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627720064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789518912.116450:0:43232:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1789518912.116487:0:43232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec84fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1876445627720064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518912.116493:0:43232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1789518912.116520:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789518912.116524:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789518912.116543:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627719424:0@lo:400:kworker.0 00000100:00100000:3.0:1789518912.116553:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1876445627719936:0@lo:400:kworker.0 00000100:00100000:3.0:1789518912.116588:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1876445627720064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789518912.117863:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789518912.117881:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627719552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518912.117952:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627719552:12345-0@lo:400:kworker.0 Request processed in 79us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518912.117960:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789518912.118007:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fffbb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627719552:0@lo:400:kworker.0 00010000:00010000:0.0:1789518912.371063:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789518912.471563:0:47302:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518912.471571:0:47302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518912.473466:0:47302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518912.473482:0:47302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518913.397320:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518913.423977:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518913.424023:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518913.424138:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617531776 00000100:00100000:3.0:1789518913.424157:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617531776 00000100:00100000:0.0:1789518913.424189:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1789518913.424212:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518913.424217:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:3.0:1789518913.424229:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617531776:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518913.424245:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1789518913.424277:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617532288 00000100:00100000:2.0:1789518913.424281:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617532288 00000100:00100000:3.0:1789518913.424292:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2345:x1876445617531776:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 66us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518913.424300:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 233 00000100:00100000:2.0:1789518913.424314:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617531904 00000100:00100000:2.0:1789518913.424317:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617531904 00000100:00100000:3.0:1789518913.424331:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 294 00000100:00100000:2.0:1789518913.424336:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 295 00000100:00100000:3.0:1789518913.424337:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617532288:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518913.424341:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617531904:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518913.424368:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2345:x1876445617532288:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518913.424372:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2345:x1876445617531904:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518913.424375:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 294 00000100:00100000:2.0:1789518913.424378:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 295 00000100:00080000:2.0:1789518913.424391:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789518913.425444:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617532032 00000100:00100000:1.0:1789518913.425450:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617532032 00000100:00100000:1.0:1789518913.425491:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617532160 00000100:00100000:1.0:1789518913.425495:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617532160 00000100:00080000:0.0:1789518913.425505:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789518913.425509:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789518913.425521:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:1.0:1789518913.425530:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617532032:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518913.425567:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffdfee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2345:x1876445617532032:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 39us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518913.425660:0:36531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 194 00000100:00100000:0.0:1789518913.425671:0:36531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617532160:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1789518913.425701:0:36531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2345:x1876445617532160:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 34us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518913.425709:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 193 00000100:00100000:0.0:1789518913.425896:0:36531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 194 00000040:00080000:0.0:1789518914.032557:0:47353:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518914.032565:0:47353:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518914.034833:0:47353:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518914.034849:0:47353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518914.419059:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518915.443265:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789518915.559169:0:47404:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1789518915.559177:0:47404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789518915.559824:0:47404:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1789518915.559834:0:47404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518916.467204:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789518916.723794:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789518916.723814:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627720192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789518916.723869:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518916.724072:0:36536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627720192 00000100:00100000:1.0:1789518916.724079:0:36536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627720192 00000100:00100000:1.0:1789518916.724148:0:36536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789518916.724157:0:36536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627720192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789518916.724188:0:36536:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3775922176 avail 3773825024 00000100:00100000:1.0:1789518916.724231:0:36536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627720192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518916.724238:0:36536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789518916.724334:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627720192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789518916.724406:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789518917.086231:0:47456:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1789518917.086241:0:47456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789518917.086962:0:47456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1789518917.086975:0:47456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1789518917.234832:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789518917.234926:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627720448:0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.234989:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518917.235038:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789518917.235043:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627720576:0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.235061:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518917.235084:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627720448 00000100:00100000:1.0:1789518917.235091:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627720448 00000100:00100000:1.0:1789518917.235126:0:36532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627720576 00000100:00100000:1.0:1789518917.235140:0:36532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627720576 00000100:00100000:1.0:1789518917.235169:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789518917.235176:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627720448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.235220:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627720448:12345-0@lo:400:kworker.0 Request processed in 44us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518917.235226:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789518917.235241:0:36532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789518917.235246:0:36532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627720576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.235268:0:36532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1876445627720576:12345-0@lo:400:kworker.0 Request processed in 23us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518917.235273:0:36532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1789518917.235288:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789518917.235296:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec84fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627720832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518917.235318:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518917.235337:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789518917.235342:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627720704:0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.235365:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518917.235390:0:36534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627720832 00000100:00100000:1.0:1789518917.235393:0:36534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627720832 00000100:00100000:1.0:1789518917.235415:0:36534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789518917.235421:0:36534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627720832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789518917.235446:0:36534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 323682304 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1789518917.235480:0:36534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876445627720832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518917.235486:0:36534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789518917.235502:0:37723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627720704 00000100:00100000:1.0:1789518917.235505:0:37723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627720704 00000100:00100000:1.0:1789518917.235527:0:37723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789518917.235532:0:37723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec9ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627720704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.235560:0:37723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec9ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876445627720704:12345-0@lo:400:kworker.0 Request processed in 27us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789518917.235565:0:37723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789518917.235600:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876445627720704:0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.235671:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec84fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1876445627720832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789518917.235702:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627720576:0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.235711:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1876445627720448:0@lo:400:kworker.0 00000100:00100000:0.0:1789518917.237664:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627720320:0@lo:400:kworker.0 00000100:00100000:0.0:1789518917.237734:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789518917.237926:0:35837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627720320 00000100:00100000:0.0:1789518917.237933:0:35837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627720320 00000100:00100000:0.0:1789518917.237970:0:35837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789518917.237977:0:35837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627720320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789518917.238039:0:35837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d183546-773a-47ec-8f5a-25077d1135e5+19:3282:x1876445627720320:12345-0@lo:400:kworker.0 Request processed in 61us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789518917.238047:0:35837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789518917.238100:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec8ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d183546-773a-47ec-8f5a-25077d1135e5:3282:1876445627720320:0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.239271:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec2018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627721088:0@lo:400:kworker.0 00000100:00100000:1.0:1789518917.239316:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789518917.239348:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789518917.239355:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99fec201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627720960:0@lo:400:kworker.0 00000100:00100000:3.0:1789518917.239364:0:35846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627721088 00000100:00100000:3.0:1789518917.239371:0:35846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627721088 00000100:00100000:1.0:1789518917.239383:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789518917.239414:0:35847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445627720960 00000100:00100000:2.0:1789518917.239419:0:35847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445627720960 00000100:00100000:3.0:1789518917.239468:0:35846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789518917.239477:0:35846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627721088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789518917.239545:0:35846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1876445627721088:12345-0@lo:400:kworker.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518917.239553:0:35846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789518917.239588:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec2018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1876445627721088:0@lo:400:kworker.0 00000100:00080000:0.0:1789518917.239919:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789518917.242856:0:35847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789518917.242869:0:35847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fff7a5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627720960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789518917.242962:0:35847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fff7a5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1876445627720960:12345-0@lo:400:kworker.0 Request processed in 95us (3579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518917.243262:0:35847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789518917.243269:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99fec201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1876445627720960:0@lo:400:kworker.0 00000040:00080000:0.0:1789518917.298830:0:35881:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1789518917.298838:0:35881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789518917.299520:0:35881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1789518917.299530:0:35881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518917.490826:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518918.514961:0:35833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789518918.542186:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1789518918.542277:0:35840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617532416 00000100:00100000:3.0:1789518918.542289:0:35840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617532416 00000100:00100000:3.0:1789518918.542436:0:35840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:3.0:1789518918.542447:0:35840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffef5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617532416:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1789518918.542548:0:35840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffef5c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061efaa1-25c0-4433-a9a7-9d7c1729c993+13:2342:x1876445617532416:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 103us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789518918.542556:0:35840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 235 00000100:00100000:1.0:1789518918.543670:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518918.543705:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518918.543731:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518918.543800:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1789518918.543839:0:35845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617532544 00000100:00100000:1.0:1789518918.543847:0:35845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617532544 00000100:00100000:2.0:1789518918.543869:0:39157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617532928 00000100:00100000:2.0:1789518918.543876:0:39157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617532928 00000100:00100000:1.0:1789518918.543912:0:35845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 299 00000100:00100000:2.0:1789518918.543921:0:39157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 300 00000100:00100000:1.0:1789518918.543925:0:35845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617532544:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518918.543935:0:39157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617532928:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1789518918.544001:0:35845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a240d1d-1bdd-4db2-880d-9900b335b1a6+56:2342:x1876445617532544:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 78us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518918.544002:0:39157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a9ad140-f959-4b2d-8b2e-c3ac1f7164c0+5:2342:x1876445617532928:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518918.544018:0:39157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 300 00000100:00100000:1.0:1789518918.544026:0:35845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 299 00000100:00100000:1.0:1789518918.544054:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617532800 00000100:00100000:1.0:1789518918.544060:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617532800 00000100:00100000:1.0:1789518918.544279:0:37973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876445617532672 00000100:00100000:1.0:1789518918.544292:0:37973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876445617532672 00000100:00100000:2.0:1789518918.545498:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:2.0:1789518918.545522:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617532800:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518918.545609:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+13:2343:x1876445617532800:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 97us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518918.545649:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 197 00000100:00100000:2.0:1789518918.545677:0:36533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 198 00000100:00100000:2.0:1789518918.545685:0:36533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99fec8ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617532672:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1789518918.545715:0:36533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99fec8ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a240d1d-1bdd-4db2-880d-9900b335b1a6+10:2342:x1876445617532672:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789518918.545722:0:36533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 198 00000100:00080000:1.0:1789518918.546201:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789518918.546207:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789518918.546210:0:35841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789518918.677302:0:47507:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1789518918.677316:0:47507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789518918.677928:0:47507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1789518918.677941:0:47507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1789518919.539980:0:36743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789518920.562839:0:35834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789518920.579038:0:47557:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_13a: @@@@@@ FAIL: request on 0x2000032e1:0x3a:0x0 is not SUCCEED on mds1 Debug log: 74415 lines, 74415 kept, 0 dropped, 0 bad.